Data Engineer

Databricks Data Engineer (Contract) Location: California (Hybrid) Industry: Industrial Services Employment Type: Contract A large enterprise organization is seeking an experienced Databricks Data Engineer to support the design, development, and modernization of a cloud-based data platform built on Databricks and modern data engineering technologies. This contract opportunity will focus on enterprise data ingestion, migration, and platform transformation initiatives that support reporting, analytics, operational intelligence, and future AI-driven capabilities. The successful candidate will play a key role in building scalable data pipelines, integrating data from multiple enterprise and operational systems, and supporting the development of a governed Lakehouse architecture. Working closely with Data Architects, Engineering teams, business stakeholders, and subject matter experts, this individual will help establish best practices for data engineering, ingestion frameworks, and cloud-native data solutions. We are specifically seeking hands-on Databricks professionals with strong experience designing and implementing enterprise-scale data ingestion and migration solutions leveraging Databricks, Delta Lake, Apache Spark, and cloud technologies. Candidates who enjoy working with complex data ecosystems and collaborating directly with technical and business teams are strongly encouraged to apply. Key Responsibilities • Design, develop, and optimize scalable data ingestion and migration pipelines using Databricks and cloud-native technologies • Build and maintain Lakehouse solutions leveraging Databricks, Delta Lake, Apache Spark, and PySpark • Develop robust ETL/ELT frameworks to support reporting, analytics, operational intelligence, and downstream data consumption • Integrate data from a variety of source systems including databases, APIs, flat files, spreadsheets, and enterprise applications • Collaborate with technical teams and business stakeholders to identify data requirements and define scalable ingestion strategies • Support the migration of legacy data integration processes into modern cloud-based architectures • Implement data governance, lineage, security, and access controls utilizing Unity Catalog and related capabilities • Develop automated data validation, reconciliation, monitoring, and data quality processes • Optimize Databricks workloads for performance, scalability, reliability, and cost efficiency • Design and maintain reusable ingestion frameworks and orchestration solutions utilizing Databricks Workflows and related services • Collaborate with architects and engineering teams to establish data engineering standards and best practices • Troubleshoot and resolve data integration, processing, and performance issues across the platform • Create technical documentation, source-to-target mappings, architecture diagrams, and operational runbooks • Support cloud modernization and enterprise data transformation initiatives Required Qualifications • 5+ years of experience in Data Engineering, Data Integration, or Cloud Data Platform development • 3+ years of hands-on experience developing solutions using Databricks • Strong expertise with Databricks, Delta Lake, Apache Spark, and PySpark • Experience designing and implementing enterprise-scale data ingestion and migration frameworks • Strong proficiency in Python and SQL • Experience building and supporting complex ETL/ELT pipelines and integration solutions • Experience working with structured, semi-structured, and streaming data sources • Hands-on experience with Azure, AWS, or similar cloud platforms • Experience implementing data governance, lineage, and security best practices • Strong understanding of modern Lakehouse architectures and data platform concepts • Experience with CI/CD practices, version control, and deployment automation • Excellent problem-solving skills and the ability to work independently in enterprise environments • Strong communication and stakeholder management skills Preferred Qualifications • Databricks certifications preferred • Experience with Unity Catalog, Databricks Workflows, Delta Live Tables (DLT), Lakeflow, and Auto Loader • Experience supporting enterprise reporting, analytics, and data modernization initiatives • Experience integrating operational, transactional, or business-critical systems into cloud data platforms • Familiarity with Azure Data Factory, Kafka, Event Hubs, REST APIs, and file-based integrations • Experience implementing automated data quality, reconciliation, and monitoring frameworks • Knowledge of large-scale enterprise data governance and metadata management practices • Cloud certifications in Azure, AWS, or Google Cloud Platform What We're Looking For We are looking for a highly skilled Databricks Data Engineer who combines strong hands-on technical expertise with a passion for building scalable, cloud-native data solutions. The ideal candidate has experience delivering enterprise data engineering initiatives involving data ingestion, migration, governance, and platform modernization. This individual will work closely with data, analytics, and technology teams to accelerate the organization's data transformation journey while delivering reliable, high-performance data platforms that support reporting, analytics, and future AI initiatives. If you are interested in learning more, please apply directly or contact us for additional details.