Senior Data Engineer

Senior Data Engineer (Databricks / Kafka / Scala) – Remote (USA) We’re hiring a hands-on Senior Data Engineer for a 12-month initial B2B contract, working with modern cloud data technologies including Databricks, Apache Kafka, Scala, and distributed data platforms. 👉 Candidates must already be based in the USA (Remote) Interviews are taking place this week (1-stage process). The Role Our client is a global AI and technology company that helps governments, enterprises, and public sector organizations improve critical services and infrastructure through data-driven solutions. They leverage artificial intelligence, advanced analytics, and software engineering to solve complex challenges across healthcare, energy, telecommunications, water, and infrastructure sectors. Operating internationally, they deliver innovative technology solutions that drive operational efficiency, smarter decision-making, and measurable business outcomes. Their mission is to harness the power of AI and technology to solve real-world challenges and create lasting impact at scale. Key Responsibilities • Design, build, and optimize scalable data platforms using Databricks, Apache Spark, and cloud-native technologies. • Develop high-performance batch and real-time data pipelines using Apache Kafka, Scala, and Spark. • Build and maintain robust ETL/ELT frameworks to ingest and process data from APIs, streaming platforms, databases, and enterprise applications. • Implement data quality, governance, monitoring, and performance optimization across large-scale distributed data platforms. • Collaborate with data scientists, software engineers, and business stakeholders to deliver reliable, production-grade data solutions. • Support CI/CD, infrastructure automation, and DevOps best practices for modern data engineering environments. • Drive technical improvements, platform scalability, and mentor other engineers on data engineering best practices. ✅ Must-Have Skills & Experience • Strong commercial experience as a Data Engineer • Hands-on expertise with Databricks • Strong experience with Apache Kafka • Commercial experience developing in Scala • Strong knowledge of Apache Spark • Experience building large-scale ETL/ELT pipelines • Advanced SQL skills • Experience working with cloud platforms (AWS, Azure, or GCP) • Experience with Git and CI/CD pipelines • Comfortable working independently in a fast-paced contract environment 💼 Nice to Have • Delta Lake • Unity Catalog • Structured Streaming • Terraform or Infrastructure as Code • Airflow • Docker & Kubernetes • Experience with Lakehouse architecture 💼 Contract Details • Type: B2B Contract • Duration: 12 months initial • Location: Remote – USA • Start: ASAP • Interview Process: 1 stage (moving quickly)