Avance Consulting
Senior Data Engineer
⭐ - Featured Role | Apply direct with Data Freelance Hub
This role is for a Senior Data Engineer with 7-8 years of DWH/Big Data experience, focusing on Azure Data Bricks, Informatica, Snowflake, and SQL. Contract length is unspecified, with a competitive pay rate. Remote work is available.
🌎 - Country
United States
💱 - Currency
$ USD
-
💰 - Day rate
Unknown
-
🗓️ - Date
October 25, 2025
🕒 - Duration
Unknown
-
🏝️ - Location
Unknown
-
📄 - Contract
Unknown
-
🔒 - Security
Unknown
-
📍 - Location detailed
Plano, TX
-
🧠 - Skills detailed
#Azure Data Factory #Scala #Apache Spark #Synapse #Oracle #Dimensional Data Models #Data Transformations #Big Data #ADF (Azure Data Factory) #Snowflake #Cloud #Data Manipulation #Informatica #Datasets #Version Control #Microsoft Power BI #Azure DevOps #Azure Synapse Analytics #Data Pipeline #SQL Queries #Scripting #Data Bricks #Spark (Apache Spark) #Data Engineering #Data Processing #DevOps #Data Ingestion #Databricks #SQL (Structured Query Language) #BI (Business Intelligence) #"ETL (Extract #Transform #Load)" #Azure #Batch #Data Modeling #PySpark #Indexing #Python
Role description
We are hiring a Senior Data Engineer with deep expertise in Azure Data Bricks(Must have) , Informatica, Snowflake & SQL to join our high-performing team. The ideal candidate will have a proven track record in designing, building, and optimizing big data pipelines and architecture while leveraging their technical proficiency in cloud-based data engineering.
Key Responsibilities:
1. Data Engineering & Architecture:
• Design, develop, and maintain high-performance data pipelines for structured and unstructured data using Azure Data Bricks and Apache Spark.
• Build and manage scalable data ingestion frameworks for batch and real-time data processing.
• Develop and optimize data models and queries in Azure Synapse Analytics to power BI and analytics use cases.
1. ETL/ELT Development:
• Should be able to derive insights by analyzing existing informatica mappings.
• Develop robust ETL/ELT pipelines using Data Bricks notebooks, and PySpark & Python.
• Perform data transformations, cleansing, and validation to prepare datasets for analysis.
• Manage and monitor job orchestration, ensuring pipelines run efficiently and reliably.
1. Performance Optimization:
• Optimize SQL queries for large-scale data processing.
• Implement partitioning, caching, and indexing strategies to improve performance and scalability of big data workloads.
• Conduct capacity planning and recommend infrastructure optimizations for cost-effectiveness.
Required Qualifications:
• Experience:
• Must have 7-8 years’ experience in DWH/Big Data background (preferably in Telco domain)
• Proven expertise with Azure Data Bricks & basic understanding of Informatica mappings.
• Technical Skills:
• Advanced proficiency in Python and SQL for data manipulation and pipeline development.
• Deep understanding of data modeling for OLAP, OLTP, and dimensional data models.
• Experience with ETL/ELT tools like Azure Data Factory or Informatica.
• Familiarity with Azure DevOps for CI/CD pipelines and version control.
• Must have good experience in Databricks on Azure (3-4 years)
• Must have Oracle PL/SQL scripting experience (3-4 years)
• Must have good communication skills to handle client and to coordinate with onsite and offshore team
We are hiring a Senior Data Engineer with deep expertise in Azure Data Bricks(Must have) , Informatica, Snowflake & SQL to join our high-performing team. The ideal candidate will have a proven track record in designing, building, and optimizing big data pipelines and architecture while leveraging their technical proficiency in cloud-based data engineering.
Key Responsibilities:
1. Data Engineering & Architecture:
• Design, develop, and maintain high-performance data pipelines for structured and unstructured data using Azure Data Bricks and Apache Spark.
• Build and manage scalable data ingestion frameworks for batch and real-time data processing.
• Develop and optimize data models and queries in Azure Synapse Analytics to power BI and analytics use cases.
1. ETL/ELT Development:
• Should be able to derive insights by analyzing existing informatica mappings.
• Develop robust ETL/ELT pipelines using Data Bricks notebooks, and PySpark & Python.
• Perform data transformations, cleansing, and validation to prepare datasets for analysis.
• Manage and monitor job orchestration, ensuring pipelines run efficiently and reliably.
1. Performance Optimization:
• Optimize SQL queries for large-scale data processing.
• Implement partitioning, caching, and indexing strategies to improve performance and scalability of big data workloads.
• Conduct capacity planning and recommend infrastructure optimizations for cost-effectiveness.
Required Qualifications:
• Experience:
• Must have 7-8 years’ experience in DWH/Big Data background (preferably in Telco domain)
• Proven expertise with Azure Data Bricks & basic understanding of Informatica mappings.
• Technical Skills:
• Advanced proficiency in Python and SQL for data manipulation and pipeline development.
• Deep understanding of data modeling for OLAP, OLTP, and dimensional data models.
• Experience with ETL/ELT tools like Azure Data Factory or Informatica.
• Familiarity with Azure DevOps for CI/CD pipelines and version control.
• Must have good experience in Databricks on Azure (3-4 years)
• Must have Oracle PL/SQL scripting experience (3-4 years)
• Must have good communication skills to handle client and to coordinate with onsite and offshore team
