AI Data Engineer

The chance to work with a highly regarded investment management firm that is investing heavily in its cloud data platform and is looking to hire a Data Engineer with strong Databricks, Azure and Python experience. This is a key hire within a small, high-impact team where you'll have genuine ownership over the data platform rather than being one of many engineers in a large function. What you'll be working on • Building and scaling Databricks-based data pipelines • Integrating Azure services and external APIs • Designing data governance, monitoring and validation frameworks • Managing security, permissions and data quality across the lakehouse • Optimising performance and supporting production workloads • Driving automation and modern engineering practices • Acting as a trusted partner to business stakeholders across global teams AI Is Actively Encouraged One aspect that makes this opportunity stand out is the firm's embrace of AI-assisted engineering. They are specifically interested in engineers who are comfortable leveraging tools such as: • GitHub Copilot • Cursor • Claude Code • Other agentic development tools The view is that modern engineers should use AI to accelerate development, improve productivity and remove repetitive tasks, whilst maintaining strong engineering judgement, code reviews and testing standards. What they're looking for • Strong Databricks experience • Azure cloud expertise • Python / PySpark development • Data pipeline design and implementation • Data governance and monitoring experience • API integrations • Git-based development and CI/CD • Someone who can work independently, solve problems, and engage directly with business stakeholders