

New York Technology Partners
Data Engineering Manager
⭐ - Featured Role | Apply direct with Data Freelance Hub
This role is a Data Engineering Manager position for 6 months, offering a pay rate of "competitive" and remote work. Key skills include Databricks, AWS, Python, and data engineering leadership. Requires 8+ years of experience and expertise in cloud data platforms.
🌎 - Country
United States
💱 - Currency
$ USD
-
💰 - Day rate
Unknown
-
🗓️ - Date
July 1, 2026
🕒 - Duration
Unknown
-
🏝️ - Location
Unknown
-
📄 - Contract
Unknown
-
🔒 - Security
Unknown
-
📍 - Location detailed
Irvine, CA
-
🧠 - Skills detailed
#Python #SQL (Structured Query Language) #Automation #Data Lake #dbt (data build tool) #Leadership #Data Modeling #Spark (Apache Spark) #ML (Machine Learning) #Delta Lake #Kafka (Apache Kafka) #GIT #Cloud #Data Engineering #AWS (Amazon Web Services) #PySpark #Data Pipeline #AI (Artificial Intelligence) #Databricks #Scala #Data Warehouse #DevOps #Airflow
Role description
We are seeking an experienced Data Engineering Manager to lead the design, architecture, and delivery of modern cloud-based data platforms. In this role, you'll provide technical leadership for a distributed engineering team, establish engineering best practices, and partner with business stakeholders to deliver scalable, high-performance data solutions built on Databricks and AWS.
Responsibilities
• Lead the architecture, development, and delivery of enterprise data platforms using Databricks and AWS.
• Establish coding standards, data engineering best practices, and CI/CD processes.
• Design and optimize scalable data pipelines, data models, and cloud data lake architectures.
• Drive technical design reviews, code quality, and platform performance optimization.
• Mentor and lead onshore and offshore engineering teams.
• Collaborate with business and client stakeholders to translate requirements into technical solutions.
• Champion modern data engineering practices, automation, and AI-assisted development to improve engineering productivity.
Qualifications
• 8+ years of experience in data engineering, with prior technical leadership or management experience.
• Strong expertise in Databricks, PySpark, Spark, Python, SQL, and AWS.
• Experience building modern data warehouses and cloud data platforms.
• Hands-on experience with Airflow, Git, CI/CD, and data modeling best practices.
• Strong communication skills with experience leading distributed teams and engaging directly with stakeholders.
Preferred Qualifications
• Experience with dbt, Kafka, and streaming data platforms.
• Background in financial services or asset management.
• Knowledge of Delta Lake, Unity Catalog, Medallion Architecture, and Databricks performance tuning.
• Exposure to DevOps practices and AI/ML-enabled data engineering workflows.
We are seeking an experienced Data Engineering Manager to lead the design, architecture, and delivery of modern cloud-based data platforms. In this role, you'll provide technical leadership for a distributed engineering team, establish engineering best practices, and partner with business stakeholders to deliver scalable, high-performance data solutions built on Databricks and AWS.
Responsibilities
• Lead the architecture, development, and delivery of enterprise data platforms using Databricks and AWS.
• Establish coding standards, data engineering best practices, and CI/CD processes.
• Design and optimize scalable data pipelines, data models, and cloud data lake architectures.
• Drive technical design reviews, code quality, and platform performance optimization.
• Mentor and lead onshore and offshore engineering teams.
• Collaborate with business and client stakeholders to translate requirements into technical solutions.
• Champion modern data engineering practices, automation, and AI-assisted development to improve engineering productivity.
Qualifications
• 8+ years of experience in data engineering, with prior technical leadership or management experience.
• Strong expertise in Databricks, PySpark, Spark, Python, SQL, and AWS.
• Experience building modern data warehouses and cloud data platforms.
• Hands-on experience with Airflow, Git, CI/CD, and data modeling best practices.
• Strong communication skills with experience leading distributed teams and engaging directly with stakeholders.
Preferred Qualifications
• Experience with dbt, Kafka, and streaming data platforms.
• Background in financial services or asset management.
• Knowledge of Delta Lake, Unity Catalog, Medallion Architecture, and Databricks performance tuning.
• Exposure to DevOps practices and AI/ML-enabled data engineering workflows.






