Data Engineer

About the job MeeBoss is sharing this active opportunity on behalf of the hiring company. This is a contract Data Engineer role focused on building and optimizing data pipelines using Google Cloud Platform (GCP) technologies. The position requires expertise in managing large-scale datasets, designing robust data models, and collaborating with stakeholders to deliver high-quality data solutions. Job title Data Engineer Company MeeBoss Location Sunnyvale, CA (Hybrid) Compensation $60-70/hour Why this role • Opportunity to work with a leading international consulting and technology services firm. • Contract duration of 6-12+ months with potential for extension. • Focus on transformative technology solutions and big data analytics. What you will do • Manage and manipulate huge datasets in the order of terabytes (TB). • Build batch data pipelines using big data technologies such as Hadoop, Apache Spark (Scala preferred), and Apache Hive on cloud platforms, with a preference for GCP. • Ensure pipeline optimization, SLA adherence, and fault tolerance. • Build idempotent workflows using orchestrators such as Automic, Airflow, or Luigi. • Write SQL to analyze, optimize, and profile data, preferably in BigQuery or SPARK SQL. • Design data schemas that accommodate the evolution of data sources and facilitate seamless data joins. • Collaborate directly with stakeholders to understand data requirements and translate them into pipeline development and data solutions. • Identify and resolve issues during data integration and schema evolution processes. • Deliver work at a rapid pace with minimal ramp-up time. • Communicate effectively and collaborate within a team environment. What we are looking for • Proficiency in managing and manipulating large-scale datasets. • Expertise in big data technologies and cloud platforms (GCP preferred). • Experience building idempotent workflows with orchestrators. • Strong SQL skills for data analysis and optimization. • Strong data modeling skills for schema design. • Ability to work directly with stakeholders. • Strong analytical and problem-solving skills. • Ability to work at a rapid pace with quality. • Effective communication and collaboration skills. Benefits • Experience working with a multinational team of experts. • Exposure to AI-driven solutions, big data analytics, and cloud applications. About MeeBoss MeeBoss helps job seekers and hiring teams make direct, relevant career connections. How to apply Apply through the MeeBoss link on this LinkedIn post.