Data Engineer

About the Company MeeBoss is sharing this active opportunity on behalf of the hiring company. MeeBoss helps job seekers and hiring teams make direct, relevant career connections. About the Role This is a contract Data Engineer role based in Sunnyvale, CA, with a hybrid work arrangement. The position focuses on building and optimizing batch data pipelines using Google Cloud Platform (GCP) technologies, managing terabyte-scale datasets, and collaborating with stakeholders to translate data requirements into scalable solutions. Responsibilities • Manage and manipulate huge datasets in the order of terabytes (TB). • Build batch data pipelines using big data technologies such as Hadoop, Apache Spark (Scala preferred), and Apache Hive on GCP, with a focus on optimization, SLA adherence, and fault tolerance. • Build idempotent workflows using orchestrators like Automic, Airflow, or Luigi. • Write and optimize SQL for data analysis and profiling, preferably in BigQuery or Spark SQL. • Design data schemas that accommodate data source evolution and facilitate seamless data joins. • Work directly with stakeholders to understand data requirements and translate them into pipeline development and data solutions. • Identify and resolve issues during data integration and schema evolution using strong analytical and problem-solving skills. • Collaborate effectively within a team and coordinate efforts between different stakeholders. Qualifications • Proficiency in managing and manipulating large datasets (TB scale). • Expertise in big data technologies and frameworks on the cloud (GCP preferred). • Experience building idempotent workflows using orchestrators (Automic, Airflow, Luigi, etc.). • Strong SQL skills for analysis, optimization, and profiling. • Strong data modeling skills for designing flexible schemas. • Ability to work directly with stakeholders to define and execute data solutions. • Strong analytical and problem-solving skills. • Ability to move at a rapid pace with quality and deliver with minimal ramp-up time. • Effective communication and collaboration skills. Pay range and compensation package $60-70/hour Equal Opportunity Statement This role offers an opportunity to work with large-scale data (terabytes) and modern cloud infrastructure in a collaborative environment requiring direct interaction with stakeholders. It is a fast-paced initiative requiring rapid delivery and minimal ramp-up time. How to apply Apply through the MeeBoss link on this LinkedIn post.