Senior Data Engineer

“NOTE: If selected for this position, you are required to perform ALL work onsite, based on the client’s specified hybrid work schedule (currently onsite 3 days a week: Tuesday, Wednesday and Thursday).” Title: Sr Data Platform Enginee rLocation: Cupertino, C ADuration: 12 months + possible ext Local candidates highly preferred We are looking for a candidate for the Platform Engineering team to partner with engineers across the team to run and evolve our data platform operations, and work closely with Data Scientists - providing support and establishing processes to keep things running smoothl y. What we're looking f or: Looking for someone with overall 13 or more years of hands on technical expertise with excellent communication skills to also guide other engineers when needed. Our client is looking for someone high mid level or senior. When it comes to Spark, Python, distributed file systems, the knowledge must be extens ive. Qualifications Nee ded :Overall 13+ years of Data Engineering experience along with below sk • ills:Strong CI/CD pipeline expe • rtise4+ years - Spark infrastructure experience (we run a lot of Spark • jobs)4+ years- Python, extensive know • ledgeVery important ! - Distributed systems backg • roundKubernetes resource manag • ementAuthentication & data gover • nanceFamiliarity with file compaction and maintenance on HDFS / object s • toresSolid grasp of data engineering fundamentals — partitioning, schema design, type safety, and table formats like Iceberg / • HiveObservability & on-call experience — Prometheus, Grafana, OpenTelemetry, ale • rtingStrong team player with cross-functional collaboration s kills Tech stack: Python, Airflow, Kubernetes (on-prem), Docker, Trino/P resto.Scala experience a plus.