Lead Data Engineer

We are seeking a highly skilled and motivated Architect & Lead Data Engineer to spearhead the design, development, and maintenance of our next-generation data platform. This role will be instrumental in building scalable, reliable, and performant data pipelines and data models to support our growing analytical and operational needs. The ideal candidate will possess deep expertise in Snowflake and Apache Iceberg, with practical exposure to Databricks, and a proven track record of leading data engineering teams and delivering impactful data solutions. You will be responsible for driving technical direction, mentoring junior engineers, and collaborating closely with data scientists, analysts, and other stakeholders. Responsibilities: • Design and implement data pipelines using Snowflake and Iceberg. • Develop ETL/ELT processes for data ingestion and transformation. • Implement data governance, quality, and security. • Optimize Snowflake and Iceberg performance and storage. • Collaborate with data teams; support their data needs. • Gain exposure to Databricks workflows. • Monitor and troubleshoot data platform components. • Stay current with Snowflake, Iceberg, and Databricks advancements. • Lead and mentor junior data engineers. • Document processes and contribute to technology evaluations. • Partner with cross-functional teams. Qualifications: • BS/MS in Computer Science, Engineering, Data Science, or related. • 10+ years data engineering experience with cloud platforms. • Deep Snowflake expertise: architecture, SQL, optimization, features (Snowpipe, Tasks, etc.), security. • Significant Iceberg experience: implementation, management, optimization. • Exposure to Databricks: familiarity with Spark and Delta Lake. • Strong SQL and programming skills (e.g., Python). • Experience with ETL/ELT tools (e.g., Fivetran, Airflow, dbt). • Cloud platform experience (AWS, Azure, GCP). • Strong problem-solving, communication, and leadership skills. • Understanding of data modeling and warehousing. • Experience with data governance and quality. Preferred Qualifications: • Infrastructure-as-code (Terraform, CloudFormation). • CI/CD for data deployments. • Data visualization tools (Tableau, Power BI). • Open-source contributions. • Relevant certifications.