

Data Processing Engineer
Our client in Rochester, NY, is looking to hire a remote Data Processing Engineer.
This is a fully-remote/part-time/3-month contract position (No Third Party Employers please)
Hourly range based on experience: $50-$55/HR
Primary Responsibilities:
• Implement AWS SNS topic as GCP PubSub equivalent
• Convert Apache Beam configurations to AWS Managed Flink for ~16 jobs
• Integrate AWS Managed Flink with AWS Glue
• Configure Glue Data Catalog for processed data storage
• Set up and configure AWS Managed Airflow
• Migrate workflows from Google Composer to AWS MWAA
• Assist with testing and documentation of data processing components
• Support AWS Marketplace integration for data processing aspects
Required AWS Service Skills:
• AWS Managed Flink
• AWS SNS
• AWS Glu
• AWS MWAA (Managed Airflow)
• AWS Lambda
• Amazon CloudWatch
• AWS IAM
Required Technical Skills:
• Python (advanced)
• Terraform
• Apache Beam
• Apache Airflow
• ETL Pipeline Development
• Data Processing
• Streaming Data Architecture
Required Soft Skills:
• Problem-solving
• Team Collaboration
• Technical Documentation
• Communication Adaptability
Our client in Rochester, NY, is looking to hire a remote Data Processing Engineer.
This is a fully-remote/part-time/3-month contract position (No Third Party Employers please)
Hourly range based on experience: $50-$55/HR
Primary Responsibilities:
• Implement AWS SNS topic as GCP PubSub equivalent
• Convert Apache Beam configurations to AWS Managed Flink for ~16 jobs
• Integrate AWS Managed Flink with AWS Glue
• Configure Glue Data Catalog for processed data storage
• Set up and configure AWS Managed Airflow
• Migrate workflows from Google Composer to AWS MWAA
• Assist with testing and documentation of data processing components
• Support AWS Marketplace integration for data processing aspects
Required AWS Service Skills:
• AWS Managed Flink
• AWS SNS
• AWS Glu
• AWS MWAA (Managed Airflow)
• AWS Lambda
• Amazon CloudWatch
• AWS IAM
Required Technical Skills:
• Python (advanced)
• Terraform
• Apache Beam
• Apache Airflow
• ETL Pipeline Development
• Data Processing
• Streaming Data Architecture
Required Soft Skills:
• Problem-solving
• Team Collaboration
• Technical Documentation
• Communication Adaptability