Data Engineer

📍 Location: Hybrid – Cardiff, UK (2-3 days on-site per week) 📅 Duration: Initial 6 months (extensions likely) 💸 Rate: Competitive / Market Rates (Inside IR35) 🚀 Start Date: ASAP 🖥️ Engagement: Contract (Inside IR35) We’re looking for a Data Quality Engineer to join a dynamic data platform team supporting cloud-native data transformation projects. This role is ideal for engineers passionate about data quality, automation, and ETL testing in cloud environments. ✅ Key Responsibilities: • Define, build, and maintain test automation frameworks and tools • Collaborate with developers to shift-left testing and integrate into CI/CD pipelines • Own and manage the QA process across sprints and releases • Perform ETL, DWH, and data pipeline testing using tools like SQL, Python, PySpark • Maintain test automation aligned with BDD (Cucumber or similar) • Drive best practices, documentation, and quality strategies across the QA function • Support continuous integration using Azure DevOps, Jenkins, or GitLab • Liaise with internal teams and stakeholders to ensure robust delivery 🧠 Ideal Candidate Profile: • Strong hands-on experience in ETL/Data Warehouse Testing using Python or PySpark • Expertise with SQL, relational databases (preferably Oracle) • Experience with cloud platforms, ideally GCP (BigQuery, Dataflow, Cloud Functions) • Proven success implementing automation frameworks and integrating them with pipelines • Familiarity with CI/CD, BDD (Cucumber), and performance testing (JMeter) • Experience working with Agile, JIRA, and test management tools like Zephyr • Excellent communication and stakeholder engagement skills • Experience mentoring QA teams and improving QA maturity