Senior Data Engineer - Product Performance Data -1573

City: Bristol, CT or NYC Onsite/ Hybrid/ Remote: Hybrid (4 days a week Onsite) Duration: 10 months Rate Range: Up to $96/hr on W2 depending on experience (no C2C or 1099 or sub-contract) Work Authorization: GC, USC, All valid EADs except OPT, CPT, H1B Must Have: • Apache Spark with Scala as the primary production language • Advanced SQL on large datasets (complex joins, window functions, performance tuning) • Hands-on experience with clickstream or user browse event data at scale • Databricks pipeline development with end-to-end ownership • Airflow for orchestration of SLA-driven production pipelines Responsibilities: • Build and maintain large-scale Spark pipelines processing clickstream and telemetry data. • Develop shared Scala and Python libraries to standardize business logic across pipelines. • Own Databricks workloads orchestrated via Airflow with strict uptime SLAs. • Deliver analytics-ready datasets supporting product performance and reporting. • Define and document standards for pipeline design, partitioning, and data quality. Qualifications: • 5+ years of hands-on data engineering experience. • Strong production experience with Spark, Scala, SQL, and Databricks. • Experience supporting high-volume, event-based data platforms. • Bachelor’s degree or equivalent experience. Nice to Have: • Experience with media, streaming, or consumer-facing product analytics data • Familiarity with telemetry or quality-of-service datasets • Experience supporting experimentation or A/B testing data