New York Technology Partners

Data Engineering Manager

⭐ - Featured Role | Apply direct with Data Freelance Hub
This role is a Data Engineering Manager position for 6 months, offering a pay rate of "competitive" and remote work. Key skills include Databricks, AWS, Python, and data engineering leadership. Requires 8+ years of experience and expertise in cloud data platforms.
🌎 - Country
United States
💱 - Currency
$ USD
-
💰 - Day rate
Unknown
-
🗓️ - Date
July 1, 2026
🕒 - Duration
Unknown
-
🏝️ - Location
Unknown
-
📄 - Contract
Unknown
-
🔒 - Security
Unknown
-
📍 - Location detailed
Irvine, CA
-
🧠 - Skills detailed
#Python #SQL (Structured Query Language) #Automation #Data Lake #dbt (data build tool) #Leadership #Data Modeling #Spark (Apache Spark) #ML (Machine Learning) #Delta Lake #Kafka (Apache Kafka) #GIT #Cloud #Data Engineering #AWS (Amazon Web Services) #PySpark #Data Pipeline #AI (Artificial Intelligence) #Databricks #Scala #Data Warehouse #DevOps #Airflow
Role description
We are seeking an experienced Data Engineering Manager to lead the design, architecture, and delivery of modern cloud-based data platforms. In this role, you'll provide technical leadership for a distributed engineering team, establish engineering best practices, and partner with business stakeholders to deliver scalable, high-performance data solutions built on Databricks and AWS. Responsibilities • Lead the architecture, development, and delivery of enterprise data platforms using Databricks and AWS. • Establish coding standards, data engineering best practices, and CI/CD processes. • Design and optimize scalable data pipelines, data models, and cloud data lake architectures. • Drive technical design reviews, code quality, and platform performance optimization. • Mentor and lead onshore and offshore engineering teams. • Collaborate with business and client stakeholders to translate requirements into technical solutions. • Champion modern data engineering practices, automation, and AI-assisted development to improve engineering productivity. Qualifications • 8+ years of experience in data engineering, with prior technical leadership or management experience. • Strong expertise in Databricks, PySpark, Spark, Python, SQL, and AWS. • Experience building modern data warehouses and cloud data platforms. • Hands-on experience with Airflow, Git, CI/CD, and data modeling best practices. • Strong communication skills with experience leading distributed teams and engaging directly with stakeholders. Preferred Qualifications • Experience with dbt, Kafka, and streaming data platforms. • Background in financial services or asset management. • Knowledge of Delta Lake, Unity Catalog, Medallion Architecture, and Databricks performance tuning. • Exposure to DevOps practices and AI/ML-enabled data engineering workflows.