Snowflake Data Engineer (Snowflake Optimization)

Role Summary The Senior Snowflake Optimization Engineer will lead the assessment, re‑architecture, and optimization of PGE’s Snowflake data platform. This role will act as the technical lead and primary onsite interface for Snowflake optimization initiatives, working closely with PGE stakeholders, data engineering teams, and Matillion pipelines. Experience Level • 8–12+ years in data engineering / cloud data platforms • 3–5+ years of focused Snowflake optimization experience • Prior experience in onsite consulting or lead roles preferred Key Responsibilities Snowflake Cost & Performance Optimization • Assess current Snowflake warehouse usage, sizing, auto‑scaling, and auto‑suspend configurations. • Identify cost drivers across Matillion jobs, ad‑hoc analytics, and background workloads. • Optimize warehouse strategies (multi‑cluster usage, workload isolation, resource monitors). • Analyze query history and execution plans to reduce compute inefficiencies. Architecture & Re‑engineering • Review existing Snowflake schemas, tables, tasks, and pipelines for architectural improvements. • Recommend and implement Snowflake‑native optimizations (dynamic tables, tasks, result caching where appropriate). • Evaluate opportunities for hybrid compute (external tables, Iceberg, Spark/EMR) where cost‑effective. • Advise on data lifecycle, retention, and archival strategies to reduce storage footprint. Matillion & Pipeline Optimization • Review Matillion ELT jobs for Snowflake best practices (push‑down transforms, avoiding row‑by‑row logic). • Improve pipeline execution efficiency and runtime SLAs. • Define reusable optimization patterns and templates. Governance & Cost Control • Help establish cost governance, monitoring, and guardrails. • Support chargeback / show‑back models if required by PGE. • Provide recommendations to ensure savings are sustainable post‑engagement. Stakeholder & Delivery Leadership • Act as the onsite technical lead, coordinating with PGE architects, developers, and business users. • Lead technical workshops, optimization reviews, and recommendations walkthroughs. • Provide documentation, implementation guidelines, and knowledge transfer to PGE teams. • Support stabilization and post‑implementation tuning. Required Skills & Experience Technical Skills • Strong hands‑on experience with Snowflake architecture, performance tuning, and cost optimization • Deep understanding of: • Snowflake warehouses, clustering, caching, tasks, dynamic tables • Query profiling and execution plans • Experience with Matillion ELT on Snowflake • Solid knowledge of AWS (S3, security, cost considerations) • SQL performance tuning and data modeling experience Good to Have • Experience with Iceberg / external tables / Spark or EMR • Exposure to Snowflake Cortex or advanced Snowflake features • CI/CD for data platforms (GitHub/GitLab/Jenkins) • Data governance and cost management frameworks.