Data Engineer (AWS)

Data Engineer (AWS) Location: London (Hybrid Working) Contract Length: 12 Months Day Rate: Up to £400 per day Inside IR35 Start Date: ASAP The Opportunit yWe're looking for an experienced Data Engineer to join a high-performing data team supporting one of the world's largest streaming platforms .Working within a fast-paced, data-driven environment, you'll be responsible for designing, building and maintaining scalable data solutions that power business-critical analytics, reporting and customer-facing products. This role offers the opportunity to work with large-scale datasets, modern AWS technologies and advanced data engineering practices, helping to shape how data is consumed across the organisation .You'll collaborate closely with engineering, analytics, science and business teams to develop robust data platforms, optimise data processing pipelines and deliver trusted, high-quality data products that support strategic decision-making .The Rol e As a Data Engineer, you will be responsible for building and maintaining highly scalable data pipelines and data models capable of processing large volumes of structured and unstructured dat a. You will play a key role in developing cloud-native data solutions, implementing data quality frameworks, and ensuring data platforms remain reliable, efficient and scalable as business demands continue to gr ow. This is an ideal opportunity for someone who enjoys solving complex data challenges, working with modern AWS technologies and taking ownership of end-to-end data engineering soluti ons. Key Responsibil • itiesDesign, build and maintain scalable ETL and ELT data pipel • ines.Develop and optimise data models and data warehouse solut • ions.Build and support event-driven and batch-processing data pipel • ines.Develop high-performance SQL queries and data transformation proce • sses.Work with large-scale datasets across multiple business dom • ains.Implement automated data quality controls, validation frameworks and monitoring solut • ions.Build and maintain cloud-native data platforms using AWS serv • ices.Develop infrastructure-as-code solutions to support scalable data environm • ents.Collaborate with business stakeholders to understand requirements and translate them into technical solut • ions.Support reporting, analytics and self-service data capabili • ties.Optimise data processing performance, scalability and operational c • osts.Work closely with software engineering teams to support data requirements for customer-facing prod • ucts.Participate in production support and on-call activities where requ • ired.Contribute to continuous improvement initiatives across data engineering practices and too ling. Essential Skills & Expe • rienceProven experience as a Data Engineer, Software Engineer, Analytics Engineer or similar data-focused • role.Strong experience designing and delivering end-to-end data engineering solu • tions.Extensive SQL development exper • ience.Strong programming experience in Python, Java, Scala or similar lang • uages.Experience building and maintaining ETL and ELT pipe • lines.Strong understanding of data modelling and data warehousing con • cepts.Experience working with large-scale datasets in distributed environ • ments.Experience delivering projects independently from design through to production deplo • yment.Understanding of software engineering best practices including version control, testing, CI/CD and code re views. AWS Experience R equiredExperience with several of the fol • lowing:AWS R • edshiftAm • azon S3A • WS GlueAWS • LambdaAma • zon EMRAmazon • KinesisAma • zon SNSAma • zon SQSIAM Roles and Perm issions Desirabl • e SkillsApac • he SparkElastic Map Redu • ce (EMR)Infrastructure as Code (AWS CDK, Terraform or CloudFo • rmation)Event-driven architectures and streaming data p • latformsData quality frameworks and monitoring s • olutionsNon-relational databases and dat • a storesAnalytics and reporting p latforms If you are interested please apply or send your CV to luke.sandiland s@cpl.com