Horizontal Talent

Data Engineer

⭐ - Featured Role | Apply direct with Data Freelance Hub
This role is for a Lead Data Engineer with 8+ years of experience, focusing on Google Cloud Platform. It is an onsite position with a contract length of "unknown" and a pay rate of "unknown." Key skills include Dataproc, BigQuery, SQL, and ETL/ELT architecture, with preferred experience in retail or supply chain.
🌎 - Country
United States
💱 - Currency
$ USD
-
💰 - Day rate
Unknown
-
🗓️ - Date
July 29, 2026
🕒 - Duration
Unknown
-
🏝️ - Location
On-site
-
📄 - Contract
Unknown
-
🔒 - Security
Unknown
-
📍 - Location detailed
San Francisco, CA
-
🧠 - Skills detailed
#GCP (Google Cloud Platform) #Metadata #Apache Airflow #Python #Apache Kafka #Agile #GIT #Cloud #Data Quality #Data Processing #"ETL (Extract #Transform #Load)" #Business Analysis #Monitoring #PySpark #Spark (Apache Spark) #AI (Artificial Intelligence) #Leadership #Scala #Data Management #Data Warehouse #Documentation #Airflow #Automation #SQL (Structured Query Language) #dbt (data build tool) #Kafka (Apache Kafka) #Data Governance #Data Engineering #BigQuery #Data Pipeline
Role description
Join a dynamic Supply Chain Data & AI team as a Lead Data Engineer focused on building scalable, cloud-native data solutions that power analytics and decision-making across sourcing, transportation, and warehouse operations. This onsite role offers the opportunity to lead technical design, shape enterprise data products, and collaborate with cross-functional teams to deliver high-quality solutions on Google Cloud Platform. Responsibilities • Design and build scalable data pipelines and data products on Google Cloud Platform. • Develop enterprise solutions using Dataproc, BigQuery, SQL, and dbt. • Create and maintain data models that support both analytical reporting and operational needs. • Build efficient ETL/ELT processes to ingest, transform, and publish data from multiple enterprise systems. • Partner with product managers, business analysts, architects, and stakeholders to translate business needs into technical solutions. • Lead technical design conversations and review code to support engineering quality and consistency. • Improve performance, scalability, reliability, and cost efficiency across cloud data platforms. • Establish monitoring, testing, and operational practices that support production workloads. • Contribute to reusable frameworks, engineering standards, and documentation. • Support production issue resolution and ongoing platform improvements. • Work within Agile teams and participate in sprint planning, estimation, and backlog refinement. • Mentor team members and help strengthen technical capability across the team. Skills • 8+ years of experience in data engineering, including technical leadership on enterprise initiatives. • Hands-on experience with Google Cloud Platform. • Expert knowledge of Dataproc, BigQuery, SQL, and dbt. • Strong understanding of ETL/ELT architecture and large-scale data processing. • Experience with dimensional modeling, normalized data models, and data warehouse design. • Ability to build cloud-native data pipelines that are scalable and maintainable. • Experience with Git, CI/CD pipelines, and engineering best practices. • Strong troubleshooting, analytical thinking, and problem-solving abilities. • Clear communication skills with the ability to work effectively across technical and business teams. Preferred Skills • Experience with Apache Airflow for workflow orchestration. • Knowledge of Apache Kafka or similar streaming technologies. • Working knowledge of PySpark for distributed processing. • Proficiency in Python for data engineering, automation, or utility development. • Familiarity with data quality, metadata management, and data governance practices. • Experience in retail, supply chain, transportation and logistics, warehouse management systems, or distribution center operations. • Self-directed approach with strong ownership and a focus on delivering high-quality solutions. • Ability to balance technical excellence with business priorities in a fast-paced environment. Horizontal is committed to fostering a diverse, equitable, and inclusive workplace where people from all backgrounds feel valued and supported. We welcome candidates who bring different perspectives, experiences, and ideas, and we encourage everyone to apply. By applying for this position, you acknowledge and agree that Horizontal Talent may contact you regarding your application using automated technology, including phone calls, SMS/text messages, or email, which may be delivered by our virtual AI recruiter, Alex.