Data Engineer

Company: Leidos
Location: Reston
Posted on: November 21, 2020

Job Description:

Description Job Description Are you ready to join Leidos all-star team? Through training, teamwork, and exposure to challenging technical work, let Leidos show how to accelerate your career path. The Leidos Innovations Center has an exciting opening for you, our next Data Engineer to assist with the design, development and implementation of alternative data ingestion pipelines to augment the National Media Exploitation Center (NMEC) data services in Reston, VA. The DOMEX Data Discovery Platform (D3P) program is a next generation machine learning pipeline platform providing cutting edge data enrichment, triage, and analytics capabilities to Defense and Intelligence Community members. This engineer will collaborate as part of a cross-functional Agile team to create and enhance data ingestion pipelines and addressing Big data challenges. You will work closely with the chief architect, systems engineers, software engineers, and data scientists on the following key tasks Provide Extraction, Transformation, and Load (ETL) experience coupled with enterprise search capabilities to solve Big Data challenges Design and implement high-volume data ingestion and streaming pipelines using Open Source frameworks like Apache Spark, Flink, Nifi, and Kafka on AWS Cloud Leverage strategic and analytical skills to understand and solve customer and business centric questions Create prototypes and proofs of concept for iterative development Learn new technologies and apply the knowledge in production systems Monitor and troubleshoot performance issues on the enterprise data pipelines and the data lake Partner with various teams to define and execute data acquisition, transformation, processing and make data actionable for operational and analytics initiatives This is you? BS in Computer Science, Systems Engineering, or related technical field or equivalent experience with at least 8 years in systems engineering or administration (4 years with a MSMIS Degree). Must have an active Top Secret security clearance and able to obtain a TSSCI with Polygraph. 2 years of experience with big data tools Hadoop, Spark, Kafka, NiFi 2 years of experience with object-orientedobject function scripting languages Python (preferred) andor Java 2 years of experience with and managing data across relational SQL and NoSQL databases like MySQL, Postgres, Cassandra, HDFS, Redis, and Elasticsearch 2 years of experience working in a Linux environment Experience working with and designing REST APIs Experience developing data ingest workflows with stream-processing systems Spark-Streaming, Kafka Streams andor Flink Experience transforming data in various formats, including JSON, XML, CSV, and zipped files Experience developing flexible ontologies to fit data from multiple sources and implementing the ontology in the form of database mappings schemas Good interpersonal and communication skills necessary to work effectively with customers and other team members. You will wow us if you have these skills Data engineering experience in Intelligence Community or other government agencies Experience with Microservices architecture components, including Docker and Kubernetes. Experience with AWS cloud services EC2, S3, EMR, RDS, Redshift, Athena andor Glue Experience with Jira, Confluence and extensive experience with Agile methodologies. Knowledge about security and best practices. Experience developing flexible data ingest and enrichment pipelines, to easily accommodate new and existing data sources Experience with software configuration management tools such as GitGitlab, Salt, Confluence, etc. Experience with continuous integration and deployment (CICD) pipelines and their enabling tools such as Jenkins, Nexus, etc. Detailed orientedself-motivated with the ability to learn and deploy new technology quickly Additional Program Information The DOMEX Data Discovery Platform (D3P) program will advance the state of the art in mission-focused big data analytics tools and micro-service development spanning the breadth of Agile sprints to multiyear research and development cycles. We are looking for you to have a demonstrated aptitude for problem solving complex technical issues, identifying, transforming, thinking outside the box, and a strong sense of accountability. Have a mix of technical excellence, intellectual curiosity, communications skills, customer-focus, and operational experience to improve the performance and user adoption of high-end data analytics platforms in partnership with a highly qualified, highly motivated team. Be motivated, self-driven team player who can multi-task and interact well with others and adviseconsult with other team members on systems engineering and software development related issues. LInC D3P External Referral Eligible External Referral Bonus Eligible Potential for Telework No Clearance Level Required Top Secret Travel Yes, 10 of the time Scheduled Weekly Hours 40 Shift Day Requisition Category Professional Job Family Software Engineering Leidos is a Fortune 500 Registered information technology, engineering, and science solutions and services leader working to solve the world's toughest challenges in the defense, intelligence, homeland security, civil, and health markets. The company's 38,000 employees support vital missions for government and commercial customers. Headquartered in Reston, Va., Leidos reported annual revenues of approximately 11.09 billion for the fiscal year ended January 3, 2020. For more information, visit www.Leidos.com httpwww.Leidos.com . Pay and benefits are fundamental to any career decision. That's why we craft compensation packages that reflect the importance of the work we do for our customers. Employment benefits include competitive compensation, Health and Wellness programs, Income Protection, Paid Leave and Retirement. More details are available here httpswww.leidos.comcareerspay-benefits . Leidos will never ask you to provide payment-related information at any part of the employment application process. And Leidos will communicate with you only through emails that are sent from a Leidos.com email address. If you receive an email purporting to be from Leidos that asks for payment-related information or any other personal information, please report the email to mailto . All qualified applicants will receive consideration for employment without regard to sex, race, ethnicity, age, national origin, citizenship, religion, physical or mental disability, medical condition, genetic information, pregnancy, family structure, marital status, ancestry, domestic partner status, sexual orientation, gender identity or expression, veteran or military status, or any other basis prohibited by law. Leidos will also consider for employment qualified applicants with criminal histories consistent with relevant laws.

Keywords: Leidos, Reston , Data Engineer, Other , Reston, Virginia