

Insight
Data Engineer
β - Featured Role | Apply direct with Data Freelance Hub
This role is for a Data Engineer with a contract length of "unknown," offering a pay rate of "$XX/hour." Required skills include 8+ years of ETL production support, IBM DataStage, DB2, SQL Server, and AWS experience.
π - Country
United States
π± - Currency
$ USD
-
π° - Day rate
Unknown
-
ποΈ - Date
July 14, 2026
π - Duration
Unknown
-
ποΈ - Location
Unknown
-
π - Contract
Unknown
-
π - Security
Unknown
-
π - Location detailed
United States
-
π§ - Skills detailed
#Spark (Apache Spark) #Data Access #Leadership #Cloud #Apache Airflow #Oracle #RDS (Amazon Relational Database Service) #Alation #Business Analysis #Schema Design #SAS #Unix #Classification #Data Transformations #Scripting #Documentation #Monitoring #S3 (Amazon Simple Storage Service) #Data Pipeline #Mathematics #Redshift #IAM (Identity and Access Management) #SQL (Structured Query Language) #Delta Lake #Compliance #Data Engineering #Migration #Automation #AWS (Amazon Web Services) #DataStage #Data Science #Airflow #Agile #Data Quality #Collibra #Tableau #Lambda (AWS Lambda) #Scala #SQL Server #Data Integration #FHIR (Fast Healthcare Interoperability Resources) #AWS Glue #Computer Science #Disaster Recovery #Oracle GoldenGate #CMS (Content Management System) #Deployment #"ETL (Extract #Transform #Load)" #Statistics #Data Layers #DevOps #dbt (data build tool) #Replication
Role description
JOB DESCRIPTION
The Data Engineer is responsible for the development, maintenance, and operational support of enterprise data pipelines, ETL processes, and data platform components within the Data & Analytics Managed Services. The Data Engineer is accountable for the reliability, performance, and evolution of enterprise data pipelines, ensuring the organization transitions from foundational stabilization toward a modern, cloud-native data platform. This individual sets the technical direction, drives delivery excellence, and represents the data engineering function at the leadership level. Working across a complex environment of stored procedures, scheduled and streaming jobs, and a recently AWS-migrated data platform, this role ensures reliable, high-quality data flows that power enterprise reporting, analytics, and decision-making across clinical, operational, financial, and health plan domains.
Key Responsibilities
β’ Develop, maintain, and optimize SQL-based ETL processes, stored procedures, and data transformations across DB2, SQL Server, Datastage, Collibra and AWS
β’ Define the enterprise data engineering architecture and technology standards across DB2, SQL Server, IBM DataStage, IBM Workload Scheduler, Oracle GoldenGate, Collibra and AWS
β’ Develop and maintain data integration workflows from source systems to analytics platforms, including validation and reconciliation logic
β’ Build and maintain data pipelines using IBM DataStage and UNIX scripting for enterprise data integration workflows
β’ Govern platform health including capacity planning, performance benchmarks, upgrade management, and disaster recovery compliance with BCP/DR standards
β’ Lead workload rationalization β identifying pipelines, stored procedures, and jobs for consolidation, retirement, or re-architecture
β’ Evaluate and drive adoption of modern data engineering capabilities (Apache Airflow, dbt, AWS Glue, Spark) aligned to Project Catalyst objectives
β’ Monitor pipeline health proactively, detect anomalies, and resolve data quality and availability issues within defined SLAs
β’ Support Dev/QA/Prod environment management including release coordination and production readiness validation
β’ Assist with AWS stabilization activities for analytics data layers post migration from on-premises infrastructure
β’ Track and manage all work through ServiceNow, ensuring accurate classification, status updates, and SLA compliance
β’ Collaborate with Tableau, SAS and BusinessObjects developers to ensure data availability and pipeline reliability for reporting
β’ Participate in L1/L2 triage for pipeline incidents, data quality failures, and integration issues
β’ Contribute to runbook documentation and standard operating procedures for supported pipelines and jobs
β’ Collaborate with cross-functional teams, including data engineers, data scientists, and business analysts, to deliver end-to-end solutions across client domains
β’ Own SLA and KPI adherence across all data engineering queues β incidents, service requests, small-ticket enhancements, and larger backlog-driven work
β’ Lead root cause analysis (RCA) for critical data incidents and drive permanent fixes to prevent recurrence
β’ Maintain full backlog visibility in ServiceNow β classification, aging, capacity tracking, and executive-level reporting
β’ Define and oversee data quality monitoring frameworks, escalation procedures, and continuous improvement programs
β’ Own CSAT measurement and improvement for the data engineering domain, proactively addressing data trust and availability concerns
β’ Deliver weekly operational and monthly executive reporting on pipeline health, throughput, SLA performance, and platform KPIs
β’ Identify and implement automation opportunities to reduce manual pipeline interventions, dataset refreshes, and extract requests
β’ Lead knowledge management across the engineering team β runbooks, architecture diagrams, onboarding playbooks, and continuity documentation
β’ Oversee end-to-end delivery of managed data analytics services to clients, ensuring projects meet business requirements, timelines, and quality standards
β’ Manage client escalations and ensure timely resolution of issues.
REQUIRED SKILLS AND EXPERIENCE
Bachelors Degree 8-12 yrs experience ETL production support IBM DataStage w/ DB2 SQL Server and stored procedures AWS preferred L1/L2/L3 support Customer facing On call rotation (1 week at a time) After hours on call Working with an offshore team
β’ Minimum Degree Required: Bachelorβs Degree in Engineering, Statistics, Mathematics, Computer Science, Data Science, Economics, or a related quantitative field
β’ 8+ years of data engineering experience with deep expertise in enterprise ETL/ELT architecture, pipeline design, and large-scale data platform operations
β’ Expert-level SQL proficiency in IBM DB2 and SQL Server including complex schema design, query optimization, and stored procedure management
β’ Expert-level IBM DataStage experience including architecture, parallel job design, performance tuning, and enterprise deployment
β’ Deep expertise in IBM Workload Scheduler β complex job stream design, dependency management, SLA configuration, and production operations
β’ Advanced Oracle GoldenGate experience including replication architecture, CDC design, and production support
β’ Proven AWS data engineering experience in production β S3, Glue, RDS, Redshift, Lambda, and IAM-governed data access
β’ Demonstrated ability to develop and execute multi-year technology roadmaps and lead platform modernization programs
β’ Experience leading managed services or outsourced delivery models with SLA, CSAT, and throughput accountability
NICE TO HAVE SKILLS AND EXPERIENCE
β’ Healthcare data engineering experience across claims, clinical (HL7/FHIR), EMR, pharmacy, population health, or regulatory reporting domains
β’ AWS certification β Data Engineer Professional, Solutions Architect Professional, or equivalent
β’ Experience with modern data stack adoption in enterprise settings β Apache Airflow, dbt, Spark, Delta Lake, or equivalent
β’ Knowledge of HIPAA, HITRUST, CMS, and healthcare data regulatory compliance requirements
β’ Experience leading on-premises to cloud migrations for large-scale enterprise data platforms
β’ Familiarity with Tableau, BusinessObjects, or SAS as downstream analytics consumers of engineered data
β’ Background in agile delivery, DevOps practices, and CI/CD pipelines for data engineering
JOB DESCRIPTION
The Data Engineer is responsible for the development, maintenance, and operational support of enterprise data pipelines, ETL processes, and data platform components within the Data & Analytics Managed Services. The Data Engineer is accountable for the reliability, performance, and evolution of enterprise data pipelines, ensuring the organization transitions from foundational stabilization toward a modern, cloud-native data platform. This individual sets the technical direction, drives delivery excellence, and represents the data engineering function at the leadership level. Working across a complex environment of stored procedures, scheduled and streaming jobs, and a recently AWS-migrated data platform, this role ensures reliable, high-quality data flows that power enterprise reporting, analytics, and decision-making across clinical, operational, financial, and health plan domains.
Key Responsibilities
β’ Develop, maintain, and optimize SQL-based ETL processes, stored procedures, and data transformations across DB2, SQL Server, Datastage, Collibra and AWS
β’ Define the enterprise data engineering architecture and technology standards across DB2, SQL Server, IBM DataStage, IBM Workload Scheduler, Oracle GoldenGate, Collibra and AWS
β’ Develop and maintain data integration workflows from source systems to analytics platforms, including validation and reconciliation logic
β’ Build and maintain data pipelines using IBM DataStage and UNIX scripting for enterprise data integration workflows
β’ Govern platform health including capacity planning, performance benchmarks, upgrade management, and disaster recovery compliance with BCP/DR standards
β’ Lead workload rationalization β identifying pipelines, stored procedures, and jobs for consolidation, retirement, or re-architecture
β’ Evaluate and drive adoption of modern data engineering capabilities (Apache Airflow, dbt, AWS Glue, Spark) aligned to Project Catalyst objectives
β’ Monitor pipeline health proactively, detect anomalies, and resolve data quality and availability issues within defined SLAs
β’ Support Dev/QA/Prod environment management including release coordination and production readiness validation
β’ Assist with AWS stabilization activities for analytics data layers post migration from on-premises infrastructure
β’ Track and manage all work through ServiceNow, ensuring accurate classification, status updates, and SLA compliance
β’ Collaborate with Tableau, SAS and BusinessObjects developers to ensure data availability and pipeline reliability for reporting
β’ Participate in L1/L2 triage for pipeline incidents, data quality failures, and integration issues
β’ Contribute to runbook documentation and standard operating procedures for supported pipelines and jobs
β’ Collaborate with cross-functional teams, including data engineers, data scientists, and business analysts, to deliver end-to-end solutions across client domains
β’ Own SLA and KPI adherence across all data engineering queues β incidents, service requests, small-ticket enhancements, and larger backlog-driven work
β’ Lead root cause analysis (RCA) for critical data incidents and drive permanent fixes to prevent recurrence
β’ Maintain full backlog visibility in ServiceNow β classification, aging, capacity tracking, and executive-level reporting
β’ Define and oversee data quality monitoring frameworks, escalation procedures, and continuous improvement programs
β’ Own CSAT measurement and improvement for the data engineering domain, proactively addressing data trust and availability concerns
β’ Deliver weekly operational and monthly executive reporting on pipeline health, throughput, SLA performance, and platform KPIs
β’ Identify and implement automation opportunities to reduce manual pipeline interventions, dataset refreshes, and extract requests
β’ Lead knowledge management across the engineering team β runbooks, architecture diagrams, onboarding playbooks, and continuity documentation
β’ Oversee end-to-end delivery of managed data analytics services to clients, ensuring projects meet business requirements, timelines, and quality standards
β’ Manage client escalations and ensure timely resolution of issues.
REQUIRED SKILLS AND EXPERIENCE
Bachelors Degree 8-12 yrs experience ETL production support IBM DataStage w/ DB2 SQL Server and stored procedures AWS preferred L1/L2/L3 support Customer facing On call rotation (1 week at a time) After hours on call Working with an offshore team
β’ Minimum Degree Required: Bachelorβs Degree in Engineering, Statistics, Mathematics, Computer Science, Data Science, Economics, or a related quantitative field
β’ 8+ years of data engineering experience with deep expertise in enterprise ETL/ELT architecture, pipeline design, and large-scale data platform operations
β’ Expert-level SQL proficiency in IBM DB2 and SQL Server including complex schema design, query optimization, and stored procedure management
β’ Expert-level IBM DataStage experience including architecture, parallel job design, performance tuning, and enterprise deployment
β’ Deep expertise in IBM Workload Scheduler β complex job stream design, dependency management, SLA configuration, and production operations
β’ Advanced Oracle GoldenGate experience including replication architecture, CDC design, and production support
β’ Proven AWS data engineering experience in production β S3, Glue, RDS, Redshift, Lambda, and IAM-governed data access
β’ Demonstrated ability to develop and execute multi-year technology roadmaps and lead platform modernization programs
β’ Experience leading managed services or outsourced delivery models with SLA, CSAT, and throughput accountability
NICE TO HAVE SKILLS AND EXPERIENCE
β’ Healthcare data engineering experience across claims, clinical (HL7/FHIR), EMR, pharmacy, population health, or regulatory reporting domains
β’ AWS certification β Data Engineer Professional, Solutions Architect Professional, or equivalent
β’ Experience with modern data stack adoption in enterprise settings β Apache Airflow, dbt, Spark, Delta Lake, or equivalent
β’ Knowledge of HIPAA, HITRUST, CMS, and healthcare data regulatory compliance requirements
β’ Experience leading on-premises to cloud migrations for large-scale enterprise data platforms
β’ Familiarity with Tableau, BusinessObjects, or SAS as downstream analytics consumers of engineered data
β’ Background in agile delivery, DevOps practices, and CI/CD pipelines for data engineering






