Job Title - Data Engineer Duration - 6 months with possible extension Location: San Jose, ( Hybrid: Tues, Wed, Thurs- in Office) Overview: We are seeking a highly skilled Data Engineer with strong expertise in Databricks to lead the design and execution of scalable data pipelines and architectures. This role sits at the intersection of Customer Analytics, Master Data Management (MDM), and Generative AI/LLMs. The ideal candidate also brings experience building custom applications, supporting BI integration, reverse ETL workflows, and applying user experience design principles to internal tools. Key Responsibilities: • Design, develop, and optimize advanced data pipelines using Databricks (SQL, Python, Spark, Delta Lake). • Integrate and structure customer and enterprise data across systems to support analytics, AI, and MDM initiatives. • Build and maintain custom internal applications and services that support data workflows and operational teams. • Develop and refine prompts and workflows for LLM-based and generative AI use cases. • Collaborate with MDM teams to support identity resolution and golden record management. • Enable analytics delivery through Power BI, Tableau, and other BI tools. • Replicate data from sources to targets via FIVETRAN • Use reverse ETL tools like Census to replicate enriched data back into CRM and marketing systems. • Apply user experience design principles to internal data tools, dashboards, and interfaces to improve usability and adoption. • Ensure high data quality, reliability, and performance across the data stack. Required Qualifications: • Extensive hands-on experience with Databricks (Spark, Delta Lake, Lakehouse architecture, notebooks, orchestration). • 3+ years of experience in data engineering, full-stack development, or a related field. • Strong proficiency in SQL and data modeling best practices. • Solid understanding of customer data structures, MDM concepts, and data governance. • Experience working with generative AI and LLMs, including prompt engineering and AI-assisted workflows. • Experience developing and deploying custom applications, APIs, or internal tools. • Proficiency in cloud environments (Azure, AWS, or GCP). Preferred Qualifications: • Familiarity with Power BI, Tableau, and other business intelligence tools. • Experience using Census or similar reverse ETL platforms. • Background supporting marketing, sales, or customer experience analytics initiatives. • Awareness of UX design best practices, especially when building internal tools or data interfaces. • Strong collaboration and communication skills with both technical and business stakeholders. Hiring Mgr is looking for candidate with exp- • Data migration from Hana to AZURE using Databricks • MS Dynamics knowledge/ exp. • Knowledge of Hana (SQL db) , at least basics of new generation data house (data lake) eg Databricks . • Good understanding ETL pipelines (ETL Tools / Reverse ETL tools : SNAPLOGIC, FIVETRAN, Sensus, Hana) • Reporting dashboards. • BI tech, Analytics experience in general. • AI workflows (Most of Gen AI - algorithms based on Gen AI). May not necessarily work on AI tech, but need to know basis AI) • Databricks - exp Administration, Build pipelines, high level expertise • Azure experience