Quantum World Technologies Inc.
Data Engineer
⭐ - Featured Role | Apply direct with Data Freelance Hub
This role is a Data Engineer position with a contract length of "unknown" and a pay rate of "unknown." It requires proficiency in Python, SQL, and AWS services, along with experience in CI/CD automation and ETL processes.
🌎 - Country
United States
💱 - Currency
$ USD
-
💰 - Day rate
Unknown
-
🗓️ - Date
August 19, 2026
🕒 - Duration
Unknown
-
🏝️ - Location
Unknown
-
📄 - Contract
Unknown
-
🔒 - Security
Unknown
-
📍 - Location detailed
United States
-
🧠 - Skills detailed
#Data Integration #Deployment #Data Engineering #Programming #Shell Scripting #AWS Glue #Scripting #Python #Jenkins #AWS (Amazon Web Services) #Automation #"ETL (Extract #Transform #Load)" #Observability #Automated Testing #Data Quality #Redshift #SQL (Structured Query Language) #Cloud #Terraform #Lambda (AWS Lambda) #Scala #Data Pipeline #S3 (Amazon Simple Storage Service) #Monitoring
Role description
Role Summary
The Data Engineer will build and maintain secure, scalable, and automated data pipelines to support the ingestion, transformation, and curation of data products. This role will focus on implementing CI/CD pipelines, automated testing, and monitoring solutions.
Key Responsibilities
• Data Pipelines: Develop configuration driven ingestion and transformation pipelines using AWS Glue, Lambda, and Redshift.
• Automation: Implement CI/CD pipelines for automated build, test, and deployment of data products.
• Testing: Establish automated test frameworks for schema validation, data quality, and performance testing.
• Monitoring: Set up monitoring and observability dashboards for product level metrics (CloudWatch, custom metrics).
• Collaboration: Work with data modelers and architects to ensure alignment with business requirements.
Required Skills
• Programming: Proficiency in Python, SQL, and shell scripting.
• AWS Expertise: Hands on experience with AWS services (Glue, Redshift, S3, Lambda, CloudWatch).
• Automation: Experience with CI/CD tools (Terraform, Jenkins, AWS CodePipeline).
• Data Integration: Strong knowledge of ETL/ELT processes and frameworks.
• Soft Skills: Strong problem solving, collaboration, and communication skills.
Role Summary
The Data Engineer will build and maintain secure, scalable, and automated data pipelines to support the ingestion, transformation, and curation of data products. This role will focus on implementing CI/CD pipelines, automated testing, and monitoring solutions.
Key Responsibilities
• Data Pipelines: Develop configuration driven ingestion and transformation pipelines using AWS Glue, Lambda, and Redshift.
• Automation: Implement CI/CD pipelines for automated build, test, and deployment of data products.
• Testing: Establish automated test frameworks for schema validation, data quality, and performance testing.
• Monitoring: Set up monitoring and observability dashboards for product level metrics (CloudWatch, custom metrics).
• Collaboration: Work with data modelers and architects to ensure alignment with business requirements.
Required Skills
• Programming: Proficiency in Python, SQL, and shell scripting.
• AWS Expertise: Hands on experience with AWS services (Glue, Redshift, S3, Lambda, CloudWatch).
• Automation: Experience with CI/CD tools (Terraform, Jenkins, AWS CodePipeline).
• Data Integration: Strong knowledge of ETL/ELT processes and frameworks.
• Soft Skills: Strong problem solving, collaboration, and communication skills.
