Altak Group Inc.
Abinitio Developer
⭐ - Featured Role | Apply direct with Data Freelance Hub
This role is for an Abinitio Developer with a contract length of "unknown," offering a pay rate of "unknown." Candidates should have 5+ years of Ab Initio development experience, strong SQL skills, and cloud integration experience with AWS or Azure.
🌎 - Country
United States
💱 - Currency
$ USD
-
💰 - Day rate
Unknown
-
🗓️ - Date
October 31, 2025
🕒 - Duration
Unknown
-
🏝️ - Location
Unknown
-
📄 - Contract
Unknown
-
🔒 - Security
Unknown
-
📍 - Location detailed
United States
-
🧠 - Skills detailed
#Unix #Monitoring #AWS (Amazon Web Services) #SQL Server #Scripting #Version Control #Terraform #Airflow #Agile #DevOps #GIT #Data Engineering #Lambda (AWS Lambda) #Metadata #Observability #Python #Batch #Linux #Snowflake #VPC (Virtual Private Cloud) #Compliance #Synapse #Databricks #Bash #Infrastructure as Code (IaC) #SQL (Structured Query Language) #Spark (Apache Spark) #Cloud #Security #Azure #Delta Lake #Data Management #Kafka (Apache Kafka) #S3 (Amazon Simple Storage Service) #Grafana #Vault #Data Architecture #Oracle #Ab Initio #Splunk #Data Quality #ADF (Azure Data Factory) #Redshift #ADLS (Azure Data Lake Storage) #"ETL (Extract #Transform #Load)" #RDBMS (Relational Database Management System) #IAM (Identity and Access Management) #Prometheus
Role description
Job Description:
Role summary
• Design & develop Ab Initio graphs/plans using GDE, Co>Operating System, EME, and Conduct>It to ingest, transform, and publish data.
• Migrate pipelines from on-prem to cloud targets (batch and near-real-time), ensuring restartability, parameterization (PDL), metadata management, and resiliency.
• Integrate with AWS (e.g., S3, Redshift, Glue/Glue Catalog, Lambda, EMR, MSK/Kinesis) and/or Azure (e.g., ADLS Gen2, Synapse, Data Factory, Event Hubs).
• Source systems & CDC: Build connectors/jobs for Oracle, SQL Server, DB2, files, MQ/Kafka; implement incremental loads/CDC patterns where applicable.
• Performance & reliability: Tune memory/parallelism/partitioning, optimize file and database I/O, and implement robust error handling, alerting, and SLA monitoring.
• Security & governance: Apply data quality checks (e.g., Ab Initio DQE), lineage/metadata practices, and enterprise security controls (IAM, KMS/Key Vault, tokenization).
• DevOps & CI/CD: Version control (Git/EME), automated build/deploy, environment promotion, and infrastructure coordination with platform teams.
• Operations: Troubleshoot production issues, perform capacity planning, and deliver clear runbooks.
• Collaboration: Partner with data architects, platform/cloud engineers, and analysts; contribute to standards and best practices.
Required qualifications
• 5+ years hands-on Ab Initio development (GDE, EME, Co>Operating System; Conduct>It scheduling).
• Proven delivery of high-volume batch and near-real-time pipelines, including restart/recovery, parameterization, and metadata-driven design.
• Strong SQL and performance tuning across major RDBMS (Oracle/SQL Server/DB2; plus Redshift/Synapse/Snowflake a plus).
• Production experience integrating Ab Initio with AWS and/or Azure for data landing, processing, and analytics.
• Solid Linux/Unix fundamentals and scripting (bash, Python preferred).
• Experience with Kafka/MQ (publish/subscribe), file transfer patterns, and secure networking (VPC/VNet, PrivateLink/Private Endpoints).
• Familiarity with data quality, lineage, and compliance for sensitive data (e.g., PHI/PII).
• Excellent troubleshooting skills and the ability to own solutions end-to-end.
Preferred/“nice to have”
• Cloud certs (e.g., AWS Data Analytics / Solutions Architect, Azure Data Engineer Associate).
• Experience with Glue/Spark or Synapse Spark for complementary processing; EMR/Databricks exposure a plus.
• Orchestration with Airflow/ADF alongside Conduct>It; event-driven designs with Lambda/Functions.
• IaC awareness (Terraform/CloudFormation/Bicep) to collaborate with platform teams.
• Experience with Snowflake or Delta Lake patterns on S3/ADLS.
• Monitoring/observability (CloudWatch, Azure Monitor, Prometheus/Grafana, Splunk).
• Agile/SAFe delivery in regulated environments (healthcare/financial services).
Job Description:
Role summary
• Design & develop Ab Initio graphs/plans using GDE, Co>Operating System, EME, and Conduct>It to ingest, transform, and publish data.
• Migrate pipelines from on-prem to cloud targets (batch and near-real-time), ensuring restartability, parameterization (PDL), metadata management, and resiliency.
• Integrate with AWS (e.g., S3, Redshift, Glue/Glue Catalog, Lambda, EMR, MSK/Kinesis) and/or Azure (e.g., ADLS Gen2, Synapse, Data Factory, Event Hubs).
• Source systems & CDC: Build connectors/jobs for Oracle, SQL Server, DB2, files, MQ/Kafka; implement incremental loads/CDC patterns where applicable.
• Performance & reliability: Tune memory/parallelism/partitioning, optimize file and database I/O, and implement robust error handling, alerting, and SLA monitoring.
• Security & governance: Apply data quality checks (e.g., Ab Initio DQE), lineage/metadata practices, and enterprise security controls (IAM, KMS/Key Vault, tokenization).
• DevOps & CI/CD: Version control (Git/EME), automated build/deploy, environment promotion, and infrastructure coordination with platform teams.
• Operations: Troubleshoot production issues, perform capacity planning, and deliver clear runbooks.
• Collaboration: Partner with data architects, platform/cloud engineers, and analysts; contribute to standards and best practices.
Required qualifications
• 5+ years hands-on Ab Initio development (GDE, EME, Co>Operating System; Conduct>It scheduling).
• Proven delivery of high-volume batch and near-real-time pipelines, including restart/recovery, parameterization, and metadata-driven design.
• Strong SQL and performance tuning across major RDBMS (Oracle/SQL Server/DB2; plus Redshift/Synapse/Snowflake a plus).
• Production experience integrating Ab Initio with AWS and/or Azure for data landing, processing, and analytics.
• Solid Linux/Unix fundamentals and scripting (bash, Python preferred).
• Experience with Kafka/MQ (publish/subscribe), file transfer patterns, and secure networking (VPC/VNet, PrivateLink/Private Endpoints).
• Familiarity with data quality, lineage, and compliance for sensitive data (e.g., PHI/PII).
• Excellent troubleshooting skills and the ability to own solutions end-to-end.
Preferred/“nice to have”
• Cloud certs (e.g., AWS Data Analytics / Solutions Architect, Azure Data Engineer Associate).
• Experience with Glue/Spark or Synapse Spark for complementary processing; EMR/Databricks exposure a plus.
• Orchestration with Airflow/ADF alongside Conduct>It; event-driven designs with Lambda/Functions.
• IaC awareness (Terraform/CloudFormation/Bicep) to collaborate with platform teams.
• Experience with Snowflake or Delta Lake patterns on S3/ADLS.
• Monitoring/observability (CloudWatch, Azure Monitor, Prometheus/Grafana, Splunk).
• Agile/SAFe delivery in regulated environments (healthcare/financial services).
