RestonRecruiter Since 2001
the smart solution for Reston jobs

Data Engineer - 21-00783

Company: Infinity Consulting Solutions
Location: Reston
Posted on: February 21, 2021

Job Description:

Job Description

We are looking for an Experienced Data Engineer who will be responsible for standardizing our data ingestion pipelines and improving performance of data storage and retrieval. Our projects ingest structured and unstructured data from multiple sources, that eventually ends up in a unified Data Lake. This data is available for reporting and analytics by various other teams. This candidate should be comfortable working with SQL as well as NoSQL databases. Cloud experience is required.
Your primary focus will be the continuous development/improvement of our data ingestion pipeline, and data parsing. Major technologies involved include NiFi, Python, ElasticSearch, AWS, MongoDB, and SQL.

Skills And Responsibilities

  • Design and develop stream and batch processing data pipelines
  • Ability to write intermediate to advanced Python and SQL for data ingestion and processing.
  • Support existing and develop new data flows as needed by developing processes that verify, standardize, and scale data input, transformation and storage.
  • Collaborate with product managers and other engineers to implement and document complex and evolving requirements
  • Research and implement cutting edge solutions to solve challenges related to ETL, data processing, and analytics.
  • Support efforts by the Data Science and Data Analytics teams.
  • Ability to debug complex data issues without frequent guidance from senior team members.
  • Occasional Linux server management including the review or management of log files, crontab, security configuration, etc.
  • Developing techniques to work with both tabular and hierarchical data.
  • Strong attention to detail, good work ethic, ability to work on multiple projects simultaneously, and good communication skills
    Required Skills
    • 3 to 6 years of experience working in Data Engineering or related roles.
    • A degree in Computer Science or an equivalent major.
    • Must have strong programming & ETL skills in Python & SQL.
    • Experience working with various database systems: MongoDB/SQL Server/PostgreSQL etc.
    • Experience working with NiFi and ElasticSearch.
    • Experience with agile methodologies and short release cycles
    • Distributed System Development for large-scale applications
    • Enjoys collaborating with other engineers on architecture and sharing designs with the team
    • Experience with cloud technologies preferably AWS.
      Desired Experience
      • Hands-on experience with writing CloudFormation templates.
      • Experience working with PHI/Healthcare data.
      • AI / Client experience.

Keywords: Infinity Consulting Solutions, Reston , Data Engineer - 21-00783, Engineering , Reston, Virginia

Click here to apply!

Didn't find what you're looking for? Search again!

I'm looking for
in category
within


Other Engineering Jobs


Principal, DevOps Engineer - Telecommute
Description: Combine two of the fastest-growing fields on the planet with a culture of performance, collaboration and opportunity and this is what you get. Leading edge technology in an industry that's improving (more...)
Company: UnitedHealth Group
Location: Baltimore
Posted on: 02/27/2021

Cloud Development Engineer, Mid
Description: Work as a Cloud development engineer with a team to design and implement solutions for complex deployments in the Cloud using any of the major Cloud providers. Participate in architecture reviews of IAAS, (more...)
Company: Booz Allen Hamilton
Location: Annapolis
Posted on: 02/27/2021

Fire Protection Engineer
Description: Join a global professional services leader. We are committed to solving the world's biggest challenges in the areas of water, energy and urbanization. GHD's Southeast Region is looking for a Fire Protection (more...)
Company: GHD
Location: Baltimore
Posted on: 02/27/2021


Auto Mechanic
Description: 7121 - White Marsh - 10201 Philadelphia Rd, White Marsh, Maryland, 21162CarMax, the way your career should be Tune up your skills in vehicle repair and build a great careerIf you want to learn how to (more...)
Company: Carmax
Location: White Marsh
Posted on: 02/27/2021

Mac Tools Seeking Mechanics - Technicians - Training Provided
Description: Build a Great Career and a Quality Life with Mac Tools. br br Feel the freedom and independence of working on your own, in a stress free environment - with no one to answer to, except yourself Join (more...)
Company: Mac Tools
Location: Arnold
Posted on: 02/27/2021

RF Electrical Engineer
Description: Pay: 90-120K--Ideal Salary Range DOE-- Direct Hire We are seeking a highly motivated and skilled engineering professional with a proven track record of providing excellent service in a fast paced and (more...)
Company: Latitude Inc.
Location: Baltimore
Posted on: 02/27/2021

Cloud Storage Engineer
Description: Manager of Cloud Infrastructure - Job Description Reports to: Vice President of Engineering Description: Cloud Storage Engineer is responsible for the design, build, maintenance and troubleshooting (more...)
Company: Latitude Inc.
Location: Baltimore
Posted on: 02/27/2021

Diesel Mechanic
Description: IMMEDIATE OPENING We are Hiring and Offer Sign-On and Safety Bonuses Job DescriptionCandidates wishing to be considered for the Diesel Mechanic opportunity must have a minimum of 2 years of prior experience (more...)
Company: Apple Valley Waste
Location: Baltimore
Posted on: 02/27/2021

Break Fix Technician- Salisbury, MD
Description: Please reach out to if interested in a Break Fix Technician opportunity in the below locations Break Fix Technician Driving position - you will need to provide your own vehicle for the first month Monday- (more...)
Company: Apex Systems
Location: Salisbury
Posted on: 02/27/2021

Quality Engineering - Project Manager
Description: Provide person-in-plant support for the tech transfer and GMP production of COVID Vaccine Drug Substance at Company, Baltimore, MD. Perform review and approval of equipment and facility qualification, (more...)
Company: Infobahn Softworld Inc.
Location: Baltimore
Posted on: 02/27/2021

Log In or Create An Account

Get the latest Virginia jobs by following @recnetVA on Twitter!

Reston RSS job feeds