Whitehall Resources
Senior Data Engineer
⭐ - Featured Role | Apply direct with Data Freelance Hub
This role is for a Senior Data Engineer, offering a 5-month remote contract. Candidates must be SC cleared, with expertise in AWS, Spark, and Informatica. Required skills include Python, SQL, and CI/CD practices. The position is inside IR35.
🌎 - Country
United Kingdom
💱 - Currency
£ GBP
-
💰 - Day rate
Unknown
-
🗓️ - Date
June 9, 2026
🕒 - Duration
3 to 6 months
-
🏝️ - Location
Remote
-
📄 - Contract
Inside IR35
-
🔒 - Security
Yes
-
📍 - Location detailed
London Area, United Kingdom
-
🧠 - Skills detailed
#EC2 #GIT #DevOps #Batch #Lambda (AWS Lambda) #Terraform #Redshift #PySpark #AWS (Amazon Web Services) #Agile #S3 (Amazon Simple Storage Service) #Azure #Spark (Apache Spark) #IAM (Identity and Access Management) #GitLab #Jira #Microsoft Power BI #Automated Testing #Athena #dbt (data build tool) #Documentation #Amazon EMR (Amazon Elastic MapReduce) #AI (Artificial Intelligence) #Python #SQL (Structured Query Language) #Cloud #Version Control #Informatica #Infrastructure as Code (IaC) #ML (Machine Learning) #BI (Business Intelligence) #Data Engineering
Role description
Data Engineer – SC Cleared
Whitehall Resources are currently looking for a Data Engineer on a remote basis for an initial 5-month contract.
•
•
• MUST BE SC CLEARED
•
•
•
•
•
• INSIDE IR35
•
•
• Job Spec:
Main responsibilities:
· Data engineering at scale in government or similarly complex domains, including performance tuning and data‑quality management
· Hands‑on expertise in AWS & Spark: Amazon EMR, S3, Lambda; strong PySpark/Python and SQL for large‑scale batch processing.
· CI/CD & DevOps: pipelines and IaC (e.g., Terraform), automated testing, and release governance.
· Version control & collaboration: Git/GitLab, code review, branching strategies, and trunk/PR workflows
· APIs & integration: building/consuming data services to move and expose data safely and reliably.
· Agile ways of working with Jira/Confluence; clear stakeholder communication and concise technical documentation
· Data warehousing & modeling (e.g., Redshift; dimensional modeling; dbt).
· Basic Power BI familiarity to partner with BI developers and validate end‑to‑end data flows.
Required Skills:
• Informatica experience
• Data project experience
• AWS
• Azure
Desirable Skills:
· AWS ecosystem depth (Athena, Redshift, EC2, CloudWatch, IAM) and event‑driven patterns.
· AWS Certified Cloud Practitioner (or higher), Azure AI Fundamentals (awareness of ML/AI services).
Data Engineer – SC Cleared
Whitehall Resources are currently looking for a Data Engineer on a remote basis for an initial 5-month contract.
•
•
• MUST BE SC CLEARED
•
•
•
•
•
• INSIDE IR35
•
•
• Job Spec:
Main responsibilities:
· Data engineering at scale in government or similarly complex domains, including performance tuning and data‑quality management
· Hands‑on expertise in AWS & Spark: Amazon EMR, S3, Lambda; strong PySpark/Python and SQL for large‑scale batch processing.
· CI/CD & DevOps: pipelines and IaC (e.g., Terraform), automated testing, and release governance.
· Version control & collaboration: Git/GitLab, code review, branching strategies, and trunk/PR workflows
· APIs & integration: building/consuming data services to move and expose data safely and reliably.
· Agile ways of working with Jira/Confluence; clear stakeholder communication and concise technical documentation
· Data warehousing & modeling (e.g., Redshift; dimensional modeling; dbt).
· Basic Power BI familiarity to partner with BI developers and validate end‑to‑end data flows.
Required Skills:
• Informatica experience
• Data project experience
• AWS
• Azure
Desirable Skills:
· AWS ecosystem depth (Athena, Redshift, EC2, CloudWatch, IAM) and event‑driven patterns.
· AWS Certified Cloud Practitioner (or higher), Azure AI Fundamentals (awareness of ML/AI services).
