Insight

Data Engineer

⭐ - Featured Role | Apply direct with Data Freelance Hub
This role is for a Data Engineer with a contract length of "unknown," offering a pay rate of "$XX/hour." Required skills include 8+ years of ETL production support, IBM DataStage, DB2, SQL Server, and AWS experience.
🌎 - Country
United States
πŸ’± - Currency
$ USD
-
πŸ’° - Day rate
Unknown
-
πŸ—“οΈ - Date
July 14, 2026
πŸ•’ - Duration
Unknown
-
🏝️ - Location
Unknown
-
πŸ“„ - Contract
Unknown
-
πŸ”’ - Security
Unknown
-
πŸ“ - Location detailed
United States
-
🧠 - Skills detailed
#Spark (Apache Spark) #Data Access #Leadership #Cloud #Apache Airflow #Oracle #RDS (Amazon Relational Database Service) #Alation #Business Analysis #Schema Design #SAS #Unix #Classification #Data Transformations #Scripting #Documentation #Monitoring #S3 (Amazon Simple Storage Service) #Data Pipeline #Mathematics #Redshift #IAM (Identity and Access Management) #SQL (Structured Query Language) #Delta Lake #Compliance #Data Engineering #Migration #Automation #AWS (Amazon Web Services) #DataStage #Data Science #Airflow #Agile #Data Quality #Collibra #Tableau #Lambda (AWS Lambda) #Scala #SQL Server #Data Integration #FHIR (Fast Healthcare Interoperability Resources) #AWS Glue #Computer Science #Disaster Recovery #Oracle GoldenGate #CMS (Content Management System) #Deployment #"ETL (Extract #Transform #Load)" #Statistics #Data Layers #DevOps #dbt (data build tool) #Replication
Role description
JOB DESCRIPTION The Data Engineer is responsible for the development, maintenance, and operational support of enterprise data pipelines, ETL processes, and data platform components within the Data & Analytics Managed Services. The Data Engineer is accountable for the reliability, performance, and evolution of enterprise data pipelines, ensuring the organization transitions from foundational stabilization toward a modern, cloud-native data platform. This individual sets the technical direction, drives delivery excellence, and represents the data engineering function at the leadership level. Working across a complex environment of stored procedures, scheduled and streaming jobs, and a recently AWS-migrated data platform, this role ensures reliable, high-quality data flows that power enterprise reporting, analytics, and decision-making across clinical, operational, financial, and health plan domains. Key Responsibilities β€’ Develop, maintain, and optimize SQL-based ETL processes, stored procedures, and data transformations across DB2, SQL Server, Datastage, Collibra and AWS β€’ Define the enterprise data engineering architecture and technology standards across DB2, SQL Server, IBM DataStage, IBM Workload Scheduler, Oracle GoldenGate, Collibra and AWS β€’ Develop and maintain data integration workflows from source systems to analytics platforms, including validation and reconciliation logic β€’ Build and maintain data pipelines using IBM DataStage and UNIX scripting for enterprise data integration workflows β€’ Govern platform health including capacity planning, performance benchmarks, upgrade management, and disaster recovery compliance with BCP/DR standards β€’ Lead workload rationalization β€” identifying pipelines, stored procedures, and jobs for consolidation, retirement, or re-architecture β€’ Evaluate and drive adoption of modern data engineering capabilities (Apache Airflow, dbt, AWS Glue, Spark) aligned to Project Catalyst objectives β€’ Monitor pipeline health proactively, detect anomalies, and resolve data quality and availability issues within defined SLAs β€’ Support Dev/QA/Prod environment management including release coordination and production readiness validation β€’ Assist with AWS stabilization activities for analytics data layers post migration from on-premises infrastructure β€’ Track and manage all work through ServiceNow, ensuring accurate classification, status updates, and SLA compliance β€’ Collaborate with Tableau, SAS and BusinessObjects developers to ensure data availability and pipeline reliability for reporting β€’ Participate in L1/L2 triage for pipeline incidents, data quality failures, and integration issues β€’ Contribute to runbook documentation and standard operating procedures for supported pipelines and jobs β€’ Collaborate with cross-functional teams, including data engineers, data scientists, and business analysts, to deliver end-to-end solutions across client domains β€’ Own SLA and KPI adherence across all data engineering queues β€” incidents, service requests, small-ticket enhancements, and larger backlog-driven work β€’ Lead root cause analysis (RCA) for critical data incidents and drive permanent fixes to prevent recurrence β€’ Maintain full backlog visibility in ServiceNow β€” classification, aging, capacity tracking, and executive-level reporting β€’ Define and oversee data quality monitoring frameworks, escalation procedures, and continuous improvement programs β€’ Own CSAT measurement and improvement for the data engineering domain, proactively addressing data trust and availability concerns β€’ Deliver weekly operational and monthly executive reporting on pipeline health, throughput, SLA performance, and platform KPIs β€’ Identify and implement automation opportunities to reduce manual pipeline interventions, dataset refreshes, and extract requests β€’ Lead knowledge management across the engineering team β€” runbooks, architecture diagrams, onboarding playbooks, and continuity documentation β€’ Oversee end-to-end delivery of managed data analytics services to clients, ensuring projects meet business requirements, timelines, and quality standards β€’ Manage client escalations and ensure timely resolution of issues. REQUIRED SKILLS AND EXPERIENCE Bachelors Degree 8-12 yrs experience ETL production support IBM DataStage w/ DB2 SQL Server and stored procedures AWS preferred L1/L2/L3 support Customer facing On call rotation (1 week at a time) After hours on call Working with an offshore team β€’ Minimum Degree Required: Bachelor’s Degree in Engineering, Statistics, Mathematics, Computer Science, Data Science, Economics, or a related quantitative field β€’ 8+ years of data engineering experience with deep expertise in enterprise ETL/ELT architecture, pipeline design, and large-scale data platform operations β€’ Expert-level SQL proficiency in IBM DB2 and SQL Server including complex schema design, query optimization, and stored procedure management β€’ Expert-level IBM DataStage experience including architecture, parallel job design, performance tuning, and enterprise deployment β€’ Deep expertise in IBM Workload Scheduler β€” complex job stream design, dependency management, SLA configuration, and production operations β€’ Advanced Oracle GoldenGate experience including replication architecture, CDC design, and production support β€’ Proven AWS data engineering experience in production β€” S3, Glue, RDS, Redshift, Lambda, and IAM-governed data access β€’ Demonstrated ability to develop and execute multi-year technology roadmaps and lead platform modernization programs β€’ Experience leading managed services or outsourced delivery models with SLA, CSAT, and throughput accountability NICE TO HAVE SKILLS AND EXPERIENCE β€’ Healthcare data engineering experience across claims, clinical (HL7/FHIR), EMR, pharmacy, population health, or regulatory reporting domains β€’ AWS certification β€” Data Engineer Professional, Solutions Architect Professional, or equivalent β€’ Experience with modern data stack adoption in enterprise settings β€” Apache Airflow, dbt, Spark, Delta Lake, or equivalent β€’ Knowledge of HIPAA, HITRUST, CMS, and healthcare data regulatory compliance requirements β€’ Experience leading on-premises to cloud migrations for large-scale enterprise data platforms β€’ Familiarity with Tableau, BusinessObjects, or SAS as downstream analytics consumers of engineered data β€’ Background in agile delivery, DevOps practices, and CI/CD pipelines for data engineering