

LanceSoft, Inc.
Senior Data Engineer
⭐ - Featured Role | Apply direct with Data Freelance Hub
This role is for a Senior Data Engineer in Pleasanton & San Francisco, CA, with a 6+ month contract. Key skills include GCP, Dataproc, BigQuery, SQL, and dbt. Retail industry experience is highly desirable. On-site work is required.
🌎 - Country
United States
💱 - Currency
$ USD
-
💰 - Day rate
Unknown
-
🗓️ - Date
July 30, 2026
🕒 - Duration
More than 6 months
-
🏝️ - Location
On-site
-
📄 - Contract
W2 Contractor
-
🔒 - Security
Unknown
-
📍 - Location detailed
San Francisco Bay Area
-
🧠 - Skills detailed
#Apache Kafka #"ETL (Extract #Transform #Load)" #Data Processing #Data Engineering #Kafka (Apache Kafka) #Automation #Metadata #dbt (data build tool) #Business Analysis #Monitoring #Apache Airflow #Data Architecture #Data Warehouse #GCP (Google Cloud Platform) #Data Modeling #Cloud #Python #GIT #Documentation #Data Management #Data Governance #BigQuery #Spark (Apache Spark) #SQL (Structured Query Language) #Data Quality #Data Pipeline #Scala #Code Reviews #PySpark #Airflow #Agile
Role description
Sr. Data Engineer
Location: Pleasanton & San Francisco, CA
Duration: 6+ months of extendable contract
Key Responsibilities
• Design, develop, and implement scalable data pipelines and data products on Google Cloud Platform (GCP).
• Build and optimize enterprise data solutions using Dataproc, BigQuery, SQL, and dbt.
• Design robust and scalable data models that support analytical and operational reporting requirements.
• Develop efficient ETL/ELT pipelines to ingest, transform, and publish data from multiple enterprise systems.
• Collaborate with Product Managers, Business Analysts, Enterprise Solution Architects, Data Architects, and business stakeholders to translate business requirements into scalable technical solutions.
• Lead technical design discussions and perform code reviews to ensure engineering quality and adherence to standards.
• Optimize data processing performance, reliability, scalability, and cost across cloud-based data platforms.
• Implement monitoring, testing, and operational best practices to support production workloads.
• Contribute to reusable frameworks, engineering standards, and documentation that improve team productivity and solution consistency.
• Support production issue resolution and continuous improvement initiatives.
• Work effectively within Agile delivery teams and participate in sprint planning, estimation, and backlog refinement.
• Mentor team members
Required Technical Skills
o Dataproc
o BigQuery
o SQL
o dbt (Data Build Tool)
• Strong understanding of modern ETL/ELT architecture and large-scale data processing.
• Strong knowledge of data modeling techniques, including dimensional modeling, normalized data models, and analytical data warehouse design.
• Experience building scalable and maintainable cloud-native data pipelines.
• Experience with Git, CI/CD pipelines, and engineering best practices.
• Strong analytical, troubleshooting, and problem-solving skills.
• Excellent verbal and written communication skills with the ability to collaborate effectively across cross-functional teams.
Preferred Technical Skills
• Experience with Apache Airflow for workflow orchestration.
• Experience integrating enterprise data platforms with Apache Kafka or other streaming technologies.
• Working knowledge of PySpark for distributed data processing.
• Proficiency in Python for data engineering, automation, and utility development.
• Familiarity with data quality, metadata management, and data governance best practices.
Domain Experience (Highly Desirable)
• Retail industry (Apparel)
• Supply Chain data platforms
• Transportation and Logistics
• Warehouse Management Systems (WMS)
• Distribution Center operations
Sr. Data Engineer
Location: Pleasanton & San Francisco, CA
Duration: 6+ months of extendable contract
Key Responsibilities
• Design, develop, and implement scalable data pipelines and data products on Google Cloud Platform (GCP).
• Build and optimize enterprise data solutions using Dataproc, BigQuery, SQL, and dbt.
• Design robust and scalable data models that support analytical and operational reporting requirements.
• Develop efficient ETL/ELT pipelines to ingest, transform, and publish data from multiple enterprise systems.
• Collaborate with Product Managers, Business Analysts, Enterprise Solution Architects, Data Architects, and business stakeholders to translate business requirements into scalable technical solutions.
• Lead technical design discussions and perform code reviews to ensure engineering quality and adherence to standards.
• Optimize data processing performance, reliability, scalability, and cost across cloud-based data platforms.
• Implement monitoring, testing, and operational best practices to support production workloads.
• Contribute to reusable frameworks, engineering standards, and documentation that improve team productivity and solution consistency.
• Support production issue resolution and continuous improvement initiatives.
• Work effectively within Agile delivery teams and participate in sprint planning, estimation, and backlog refinement.
• Mentor team members
Required Technical Skills
o Dataproc
o BigQuery
o SQL
o dbt (Data Build Tool)
• Strong understanding of modern ETL/ELT architecture and large-scale data processing.
• Strong knowledge of data modeling techniques, including dimensional modeling, normalized data models, and analytical data warehouse design.
• Experience building scalable and maintainable cloud-native data pipelines.
• Experience with Git, CI/CD pipelines, and engineering best practices.
• Strong analytical, troubleshooting, and problem-solving skills.
• Excellent verbal and written communication skills with the ability to collaborate effectively across cross-functional teams.
Preferred Technical Skills
• Experience with Apache Airflow for workflow orchestration.
• Experience integrating enterprise data platforms with Apache Kafka or other streaming technologies.
• Working knowledge of PySpark for distributed data processing.
• Proficiency in Python for data engineering, automation, and utility development.
• Familiarity with data quality, metadata management, and data governance best practices.
Domain Experience (Highly Desirable)
• Retail industry (Apparel)
• Supply Chain data platforms
• Transportation and Logistics
• Warehouse Management Systems (WMS)
• Distribution Center operations





