Senior Engineer (Spark/AWS)

Senior Engineer (Spark/AWS) | Hybrid | Contract/W2 Only! • There are no Corp-to-Corp options or Visa Sponsorship available for this position • Optomi, in partnership with a market leader in the entertainment industry, is seeking a Senior Engineer for a hybrid position out of one of their hub locations. This candidate will join the Discovery, Merchandising, and Experimentation Data team that owns and operates mission-critical data products and services that enable personalized experiences, content campaigns, and A/B testing across a suite of streaming platforms. The ideal candidate will possess a strong technical background in large-scale data engineering and a passion for designing scalable, high-impact data systems. Additionally, this candidate will collaborate with cross-functional partners to solve complex data problems, build new greenfield solutions, and help drive innovation in experimentation and personalization. What the right candidate will enjoy: • Flexible work schedule! • Long-term career opportunity! • Contributing to building data products and services from the ground-up! • Gaining experience with cutting-edge technologies on enterprise-level platforms! Experience of the right candidate: • Bachelor’s degree in Computer Science, Engineering, or a related field, plus 5+ years of relevant industry experience. • Proficiency in Scala or Python, with solid programming fundamentals and experience building production-grade systems. • Strong experience with Apache Spark, Databricks, and Airflow. • Solid understanding of data modeling techniques and best practices. • Familiarity with orchestration frameworks and distributed data processing systems such as Spark, Hadoop, and Databricks. • Working knowledge of data warehouse solutions, including Databricks and Snowflake, and the ability to evaluate trade-offs among technologies. • Excellent analytical, problem-solving, and communication skills with a strong attention to detail. Preferred Qualifications: • Experience preparing data for machine learning pipelines and personalized recommendation systems. • Familiarity with A/B testing frameworks, multi-armed bandits, or other experimentation methodologies. • Hands-on experience with AWS, Java, Kotlin, Typescript, and/or Snowflake in production environments. Responsibilities of the right candidate: • Design and develop scalable data products and services supporting personalization, content discovery, and experimentation at petabyte scale. • Collaborate with stakeholders to understand business needs and translate them into technical solutions in the data and experimentation space. • Build and maintain robust data pipelines and orchestration frameworks using technologies such as Spark, Airflow, and Databricks. • Ensure system reliability and performance to meet SLAs and support critical business operations. • Create and maintain comprehensive documentation to support data quality, data governance, and reproducibility. • Contribute to agile development practices to continuously improve team processes and delivery. Tech Stack: • Languages: Scala, Python, Java, Kotlin, Typescript • Technologies: Databricks, Spark, Airflow, Snowflake, AWS