Data Engineer

AWS Data Engineer – Government Project Contract: 6 months Day rate: £550 per day, Inside IR35 Location: Fully remote (UK) Security clearance: Active SC clearance required The role We are seeking an experienced AWS Data Engineer to join a high-profile government project on an initial six-month contract. You will design, build and maintain secure, scalable data pipelines and cloud-based data platforms within AWS. Working closely with architects, analysts, developers and government stakeholders, you will help deliver reliable data solutions in a highly regulated environment. Key responsibilities • Design, develop and maintain scalable ETL/ELT data pipelines on AWS. • Build and optimise cloud data lakes, warehouses and data-processing solutions. • Ingest and transform structured and unstructured data from multiple sources. • Develop production-quality solutions using Python, PySpark and SQL. • Implement automated data-quality checks, monitoring and alerting. • Apply AWS security, governance and access-control best practices. • Build infrastructure and deployment pipelines using Infrastructure as Code. • Troubleshoot performance, reliability and data-integrity issues. • Produce clear technical documentation and contribute to architectural decisions. • Collaborate within an Agile, multidisciplinary delivery team. Essential experience • Strong commercial experience as an AWS Data Engineer. • Hands-on experience building production data pipelines and platforms in AWS. • Advanced Python and SQL skills. • Experience with Spark or PySpark and large-scale data processing. • Strong understanding of data modelling, ETL/ELT patterns and data warehousing. • Experience implementing cloud security, monitoring and data governance. • Experience with Infrastructure as Code and CI/CD practices. • Previous experience delivering within government or another regulated environment. • Strong communication and stakeholder-management skills. • Must hold active, transferable SC clearance. Technology stack • AWS: S3, Glue, Lambda, Redshift, Athena, EMR, Step Functions and CloudWatch • Data engineering: Python, PySpark, Spark and SQL • Orchestration: Apache Airflow or Amazon MWAA • Streaming: Amazon Kinesis • Security and governance: IAM, KMS and Lake Formation • Infrastructure: Terraform or AWS CloudFormation • DevOps: Git, CI/CD and Docker • Data formats: Parquet, JSON, CSV and Avro Desirable experience • AWS certification, such as AWS Certified Data Engineer or Solutions Architect. • Experience with event-driven and real-time data architectures. • Knowledge of data mesh, medallion or lakehouse architecture. • Experience working to government security and data-protection standards. Important This role requires active SC clearance at the point of application. Candidates without current SC clearance cannot be considered. To apply, please submit your latest CV, confirmation of your active SC clearance, availability and current notice period. Sellick Partnership is proud to be an inclusive and accessible recruitment business and we support applications from candidates of all backgrounds and circumstances. Please note, our advertisements use years' experience, hourly rates, and salary levels purely as a guide and we assess applications based on the experience and skills evidenced on the CV. For information on how your personal details may be used by Sellick Partnership, please review our data processing notice on our website.