TalentOla
Senior Data Engineer
⭐ - Featured Role | Apply direct with Data Freelance Hub
This role is for a Senior Data Engineer with 10+ years of experience in clinical data. Required skills include SQL Server, Azure SQL, Databricks, ETL/ELT, Python, and PySpark. Location is Chicago, IL (Hybrid – 3 days in-office).
🌎 - Country
United States
💱 - Currency
$ USD
-
💰 - Day rate
Unknown
-
🗓️ - Date
May 23, 2026
🕒 - Duration
Unknown
-
🏝️ - Location
Hybrid
-
📄 - Contract
Unknown
-
🔒 - Security
Unknown
-
📍 - Location detailed
Chicago, IL
-
🧠 - Skills detailed
#Data Engineering #Automation #Logging #PySpark #Delta Lake #ADLS (Azure Data Lake Storage) #Monitoring #"ETL (Extract #Transform #Load)" #Storage #Python #Spark (Apache Spark) #Cloud #Azure #Azure Portal #ADF (Azure Data Factory) #Databricks #Debugging #SQL Server #SQL (Structured Query Language) #Azure Data Factory #Azure SQL #Triggers #Scala
Role description
Job: Senior Data Engineer
Location: (Chicago, IL (Hybrid – 3 days Work from Office)
What is in it for you?
Seeking a Senior Data Engineer with deep expertise in SQL Server, Azure SQL, and Databricks to design, optimize, and deliver scalable cloud-based data solutions supporting analytics and enterprise data platforms.
(Must) Domain : Clinical (Health care)
(Must) Experience Required: 10+ years
Mandatory skills
· ETL / ELT Concepts: Strong understanding of pipeline patterns, incremental loads, data validation, and troubleshooting.
· SQL: Advanced querying (CTEs, views, joins, complex query logic) and performance tuning for transformations and validation. Python: Production-quality development (modular code, testing, logging, integration with APIs/files, CICD, Unit Test/Integration test automation, Code Coverage).
· PySpark: Distributed transformations and performance optimization (joins, partitions, debugging), CICD, Unit Test/Integration test automation, Code Coverage.
· Azure Data Factory (ADF): Build/operate ADF pipelines, parameterization, triggers, monitoring, retry/error handling; integrate with Databricks/ADLS.
· Databricks: Develop and operationalize notebooks/jobs/workflows; Delta Lake patterns; basic cluster/job configuration.
· Azure Fundamentals + Pulumi: Hands-on with ADLS Gen2, Azure Portal, Storage Explorer, Resource Groups, Azure SQL, and familiarity integrating with Azure OpenAI. Able to use/maintain Pulumi scripts for provisioning and managing Azure resources across environments
· Local to Chicago, IL required as this needs candidates to go for in – person client interview and 3 days Work from Office per Week.
If you are interested in applying for this position,
Please share me your updated resume for further conversation.
Mail: Arun.bijwe@talentola.com
Job: Senior Data Engineer
Location: (Chicago, IL (Hybrid – 3 days Work from Office)
What is in it for you?
Seeking a Senior Data Engineer with deep expertise in SQL Server, Azure SQL, and Databricks to design, optimize, and deliver scalable cloud-based data solutions supporting analytics and enterprise data platforms.
(Must) Domain : Clinical (Health care)
(Must) Experience Required: 10+ years
Mandatory skills
· ETL / ELT Concepts: Strong understanding of pipeline patterns, incremental loads, data validation, and troubleshooting.
· SQL: Advanced querying (CTEs, views, joins, complex query logic) and performance tuning for transformations and validation. Python: Production-quality development (modular code, testing, logging, integration with APIs/files, CICD, Unit Test/Integration test automation, Code Coverage).
· PySpark: Distributed transformations and performance optimization (joins, partitions, debugging), CICD, Unit Test/Integration test automation, Code Coverage.
· Azure Data Factory (ADF): Build/operate ADF pipelines, parameterization, triggers, monitoring, retry/error handling; integrate with Databricks/ADLS.
· Databricks: Develop and operationalize notebooks/jobs/workflows; Delta Lake patterns; basic cluster/job configuration.
· Azure Fundamentals + Pulumi: Hands-on with ADLS Gen2, Azure Portal, Storage Explorer, Resource Groups, Azure SQL, and familiarity integrating with Azure OpenAI. Able to use/maintain Pulumi scripts for provisioning and managing Azure resources across environments
· Local to Chicago, IL required as this needs candidates to go for in – person client interview and 3 days Work from Office per Week.
If you are interested in applying for this position,
Please share me your updated resume for further conversation.
Mail: Arun.bijwe@talentola.com
