Senior Data Engineer

Position: Lead Data Engineer Location: San Francisco, CA - Hybrid Duration: 9+Months with possible extension Main skills: SQL, Databricks, ADF, DataStage (or other ETL tool), SSAS cubes, Cognos/other, Tableau/other, ThoughtSpot Job Description: We are seeking a Lead Data Engineer to design, implement, and maintain our data infrastructure and business intelligence solutions. This role requires a technical expert who can architect scalable data solutions while collaborating across teams to drive business insights. Required Experience: • 8-10 years of software development and deployment experience • At least 7 years of hands-on experience with: • SQL • Databricks • Azure Data Factory (ADF) • DataStage (or other ETL tools) • SSAS cubes • BI tools (Cognos, Tableau, ThoughtSpot, etc.) • Strong Database knowledge (SQL & No-SQL preferred) • Advanced SQL and Python skills • Experience working with APIs for data collection/ingestion Key Responsibilities: Technical Development: • Write SQL for processing raw data, Kafka ingestions, ADF pipelines, data validation, and QA • Lead, design and implement innovative analytical solutions using Tableau, SQL, and Big Data technologies • Experience with storing, joining, filtering, and analyzing data using SQL, Spark, Hive, etc.