Data Engineer

Company: Morphworks
Location: Reston
Posted on: January 16, 2022

Job Description:

MorphWorks is seeking an experienced Data Engineer to join our team to provide support to the Continuous Diagnostic & Mitigation (CDM) Program. The role will take direction from the clients Program Team and work across the organization delivering quality support.

Position Requirements

• Connecting to APIs or ingesting data from CSV flat files using Azure Services ingesting the data into Azure Blob storage for staging
• Create data mapping and transform pipelines in Azure Data Factory putting the staged JSON data into an Azure SQL Database. Support either relational or non-relational/NoSQL structures.
• Create and continuously evaluate the effectiveness and efficiency of the data pipeline and SQL to enhance the overall efficacy of the data pipeline. This may require scripting to supplement SQL and tool processes
• Design stable, reliable, and secure SQL databases that perform optimally at scale. This includes developing complex SQL to perform analysis, aggregations, complex joins, store procedures, views, etc. Includes troubleshooting errors with data outputs and/or identifying that data issues are coming from a downstream sensor tool itself
• Support releases with updates to SQL schema, API data mappings, and ETL pipelines
• Document all work including version control of all source code in the pipeline. This includes data requirements, relationships, data flows, and lineage. This also includes working with the test team on documenting test cases
• Collaborate with other project stakeholders and provide Subject Matter Expertise with all questions around data in the pipeline and the ETL processes.
• Actively participate in Agile ceremonies
• Perform other duties as assigned
  
  Qualifications And Education/Certification Requirements
  • BS in Computer Science or related field
  • Minimum 5+ years of experience in data with:
    • Experience in building and optimizing data architectures and pipelines with importance on Azure Data Factory or SQL Server Integration Services (SSIS)
    • Strong experience with data ETL/ELT tools, processes, and data validation
    • Complex SQL development in creating and maintaining relational database schemas
    • Data analysis looking for trend, issues, and quality across multiple data sets by querying and joining data
    • Experience with finding trends and issues across multiple data sets
    • Experience with adding metadata such as with tags and enriching data from other sources
    • Experience with relational database design, security, performance tuning, and SQL Experience with SQL Database or other relational database design, security, performance tuning, SQL queries, stored procedures, and views
    • Experience with dashboard and report generation, data analytics logic including defining queries or filters and building visualizations
    • Experience with parsing and storing non relational file formats (e.g., JSON, XML, and CSV)
    • Experience in data lifecycle management
    • Awareness of APIs types and call and responses to get data
    • Experience with database authentication and access and securing data in transit and at rest
    • Release management and version control system tools (e.g., Git, SVN)
      Preferred Skills
      
      • Experience architecting and implementing data ETL/ELT pipeline with using Azure Data Factory, SQL Server Integration Services (SSIS), AWS Glue, Google Fusion, Informatica, DataStage, etc.
      • Experience with non-relational JSON based databases
      • Overall strong background in data engineering and architecting an enterprise integration solution using multi data sources
      • Understanding of technical, operational, and management issues related to data design, development, and deployment within multiple distributed systems
      • Scripting or programming skills (PowerShell, Python, Java, data science frameworks)
      • Building visualizations with Microsoft Power BI
      • Certification(s) in SQL a plus
        
        Clearance Requirements
        
        • Candidate is required to be a U.S. citizen (non-dual citizenship) with the ability to obtain DHS Suitability/Entry on Duty (EOD).
          
          About Us
          
          MorphWorks is a strategic consulting firm focused on Risk and Technology solutions. Headquartered in Northern Virginia, MorphWorks is recognized as a best practice company, specializing in IT Modernization and infrastructure efficiency. Our team operates with a culture of execution and brings that approach to each of our client engagements, focusing on delivering high-quality work to all project components.by Jobble

Keywords: Morphworks, Reston , Data Engineer, Engineering , Reston, Virginia