New York Technology Partners
Data Engineer
⭐ - Featured Role | Apply direct with Data Freelance Hub
This role is for a Data Engineer, contract length unspecified, offering a competitive pay rate. Key skills include PySpark, SQL, AWS, and experience with data pipelines. Familiarity with Airflow, Databricks, and MPP data warehouses is required.
🌎 - Country
United States
💱 - Currency
$ USD
-
💰 - Day rate
Unknown
-
🗓️ - Date
May 1, 2026
🕒 - Duration
Unknown
-
🏝️ - Location
Unknown
-
📄 - Contract
Unknown
-
🔒 - Security
Unknown
-
📍 - Location detailed
Irvine, CA
-
🧠 - Skills detailed
#Databricks #AWS (Amazon Web Services) #Data Pipeline #GIT #Data Warehouse #Spark (Apache Spark) #PySpark #Kafka (Apache Kafka) #Redshift #Scala #Data Engineering #GitHub #Version Control #SQL (Structured Query Language) #BitBucket #Cloud #Data Modeling #Python #Datasets #Airflow
Role description
We’re looking for a Data Engineer to design, build, and optimize scalable data pipelines in a modern cloud environment. This role requires strong technical expertise and the ability to collaborate effectively with cross-functional and client-facing teams.
Key Responsibilities
• Design, develop, and maintain scalable data pipelines and processing systems
• Work with large datasets using distributed frameworks
• Partner with internal teams and client stakeholders to deliver data solutions
• Optimize performance across platforms such as Databricks and Kafka
• Apply best practices in data modeling, warehousing, and governance
• Support global delivery through offshore coordination
Required Skills & Experience
• Strong hands-on experience with PySpark, Hive, SQL, and Python
• Experience with cloud platforms (preferably AWS)
• Familiarity with workflow orchestration tools like Airflow
• Experience with MPP data warehouses (e.g., Redshift)
• Understanding of data warehousing concepts and best practices
• Exposure to Databricks
• Experience with Git-based version control (GitHub, Bitbucket)
• Strong communication and client-facing skills
Nice to Have
• Experience working with Kafka or similar streaming platforms
• Prior experience collaborating with offshore teams
We’re looking for a Data Engineer to design, build, and optimize scalable data pipelines in a modern cloud environment. This role requires strong technical expertise and the ability to collaborate effectively with cross-functional and client-facing teams.
Key Responsibilities
• Design, develop, and maintain scalable data pipelines and processing systems
• Work with large datasets using distributed frameworks
• Partner with internal teams and client stakeholders to deliver data solutions
• Optimize performance across platforms such as Databricks and Kafka
• Apply best practices in data modeling, warehousing, and governance
• Support global delivery through offshore coordination
Required Skills & Experience
• Strong hands-on experience with PySpark, Hive, SQL, and Python
• Experience with cloud platforms (preferably AWS)
• Familiarity with workflow orchestration tools like Airflow
• Experience with MPP data warehouses (e.g., Redshift)
• Understanding of data warehousing concepts and best practices
• Exposure to Databricks
• Experience with Git-based version control (GitHub, Bitbucket)
• Strong communication and client-facing skills
Nice to Have
• Experience working with Kafka or similar streaming platforms
• Prior experience collaborating with offshore teams
