AWS Data Engineer

Join our team as an AWS Data Engineer, where you'll innovate and develop scalable AWS-native platforms and data layers. This role offers the chance to work on advanced cloud engineering projects in a collaborative and dynamic environment. Responsibilities • Design and implement AWS Lakehouse architectures to enhance data storage and processing efficiency. • Develop modular, testable Python code for data engineering and production-grade pipelines. • Create and manage Bronze, Silver, and Gold data layers using Medallion Architecture. • Utilize AWS services like S3, Glue, and Athena for efficient ETL processes. • Work closely with cross-functional teams to ensure smooth integration of data solutions. • Document processes and communicate effectively with stakeholders throughout project lifecycles. Skills • Strong proficiency in Python programming tailored for data engineering tasks. • Proven experience with AWS services and cloud architecture design. • Solid understanding of open table formats such as Apache Iceberg, Delta Lake, or Apache Hudi. • Experience with Slowly Changing Dimensions (SCD Type 2) in distributed data systems. • Excellent communication and teamwork abilities. Preferred Skills • Familiarity with orchestration tools like EMR on EKS or Argo Workflows. • Experience with data visualization tools such as AWS Quicksights, Tableau, or Cognos. • Knowledge of best practices for data ingestion, transformation, and curation. At Horizontal, we are committed to fostering a diverse and inclusive workplace where all individuals are valued and empowered to contribute to our collaborative culture. Once you apply for this position, you may receive a phone call, SMS or email at the time of application from our Virtual AI Recruiter, Alex, to conduct an initial interview.