Data Engineer

Databricks Data Engineer Contract Opportunity | Data & AI Consultancy | Databricks Contract: Outside IR3 5Rate: £450–£550 per da yLocation: Fully Remote – U KStart: ASA PFocus: Databricks / Data Engineerin g The Opportuni tyPrimus Connect is working with a growing Data & AI Consultancy that is delivering modern data platforms and Databricks solutions for a range of enterprise client s.They are expanding their engineering capability and are looking for a Mid-Level Data Engineer with strong commercial Databricks and Spark experience to join an active delivery tea m.This is a hands-on engineering position where you will take ownership of data pipeline development, work with modern Databricks technologies and collaborate closely with senior engineers and wider delivery team s. Key Responsibilit • iesDesign, build and maintain ETL/ELT data pipelines using Databricks, PySpark and Spark • SQLDevelop and optimise Delta Lake tables using Bronze, Silver and Gold medallion architect • ureIngest data from a variety of source systems into Databri • cksWrite clean, maintainable and well-tested Python/data engineering c • odeImplement data quality checks, validation and monitor • ingParticipate in code reviews and collaborative developm • entContribute to CI/CD pipelines for data engineering worklo • adsWork with senior engineers to deliver scalable data platform soluti • onsCollaborate with technical, analytics and business stakehold • ersParticipate in Agile ceremonies and delivery activit ies Essential Experi • enceCommercial experience building data pipelines using Databr • icksStrong PySpark and Spark SQL sk • illsSolid Python experience within data enginee • ringPractical experience with Delta • LakeUnderstanding of medallion architecture and modern data platform princi • plesExperience working with Azure, AWS or • GCPGood understanding of Git and collaborative development pract • icesExperience working within Agile delivery environm • entsStrong communication skills and the ability to work effectively in a remote team Desirable Exper • ienceDatabricks certific • ationUnity Ca • talogDatabricks Asset Bu • ndlesTerraform / Infrastructure as • CodeDatabricks Work • flowsAi • rflowSpark Structured Stre • amingKafka or Azure Event Hubs