Data Platform/Cloud Engineer

Data Platform Engineer (AWS & Python) Job at a Glance • Title: Data Platform Engineer (AWS & Python) • Location: Fully Remote - EST hours • Contract: W2 only, 22-month contract with potential for extension or full-time conversion with either the client or CEI • Pay: $80 /hour + optional medical, dental, vision, 401(k) match Overview This role involves establishing and enhancing data pipelines within a cloud-based, serverless AWS environment. Candidates will work on setting up a new platform aimed at centralizing and transforming guest data to generate real-time insights, supporting a large-scale data infrastructure across Disney Parks Experience and Products. Key Responsibilities • Develop and maintain data pipelines utilizing AWS services such as Lambda, Kinesis, and DynamoDB • Implement infrastructure-as-code solutions using AWS CDK and Terraform • Collaborate on integrating multiple data sources, including Kinesis streams, Kafka, and Snowflake • Support operations with system administration and the development of business logic scripts • Assist in deploying real-time data streaming and processing solutions for guest data pipelines • Support deployment of production environments ensuring reliable data distribution to various consumers • Enable data ingestion, transformation, and distribution, leveraging API endpoints and stream processing Required Skills • Proven experience in DevOps practices, including CI/CD pipelines, Docker, testing, and automation • Strong background in Python development, capable of developing scalable solutions • Extensive knowledge of AWS, particularly IAM, S3, Kinesis, Lambda, and SNS • Hands-on experience with infrastructure-as-code tools such as Terraform, CloudFormation, or CDK • Minimum of 5 years of software development experience across diverse domains, especially data management or distributed systems • Ability to develop and support system administration tasks alongside software development • Familiarity with real-time data pipelines, guest data integration, and data distribution methods Preferred Skills • Proficiency in at least one of the following languages: Typescript, Java, or other strongly typed languages • Experience with Snowflake or similar data warehousing solutions • Understanding of trade-offs between different data storage systems and architectures (e.g., SQL vs NoSQL, data warehouses, partitioning) • Knowledge of various ingestion patterns, such as Kafka or equivalent streaming services Call to Action Candidates with a strong background in AWS, Python, and DevOps practices are encouraged to apply. This is an excellent opportunity to contribute to a vital platform transformation for a globally renowned organization. About CEI As a trusted technology partner, CEI delivers solutions that help our customers transform their business and achieve meaningful results. From strategy and custom application development through application management - our technology and digital experience services are tailored to meet each unique need of our customers. Our staffing solutions bring specialized skills to complement our customers' workforce and project requirements.