

Excelon Solutions
Big Data Engineer
β - Featured Role | Apply direct with Data Freelance Hub
This role is for a Big Data Engineer on a long-term W2 contract, 100% remote. Requires 9+ years of experience with Python, SQL, GCP (BigQuery), Spark, and Airflow. Optional skills include Java. Focus on big data engineering, not machine learning.
π - Country
United States
π± - Currency
$ USD
-
π° - Day rate
Unknown
-
ποΈ - Date
June 10, 2026
π - Duration
Unknown
-
ποΈ - Location
Remote
-
π - Contract
W2 Contractor
-
π - Security
Unknown
-
π - Location detailed
United States
-
π§ - Skills detailed
#Spark SQL #SQL (Structured Query Language) #BigQuery #PySpark #SQL Queries #GCP (Google Cloud Platform) #Apache Kafka #Scala #Spring Boot #Big Data #Java #GitLab #Data Pipeline #Kafka (Apache Kafka) #Python #Spark (Apache Spark) #ML (Machine Learning) #Databases #Batch #Data Engineering #Airflow
Role description
Title: Big data engineer
Duration: Long term contract(W2)
Location: 100% Remote
Weβre looking for:
β’ Python, SQL, GCP(BQ), Spark, Airflow, Java(Optional)
β’ GCP Shop - using Big Query
β’ Does NOT want a machine learning engineer, wants a big data engineer
Required Skills:
9+ years of experience
Python, Airflow, PySpark, Spark SQL, Spark Streaming, Scala, Relational/No SQL databases, Apache Kafka, writing complex sql queries, GCP (Bigquery, Dataproc), working with RESTful APIs in data pipelines, CI/CD (gitlab CI)
Bonus Skills:
Experience with backend stack (Java, Spring boot)
Who the team is and what they do:
The Customer Identity (CI) team is central to the enterprise, focused on ensuring customer data is accurate, consistent, and readily accessible. This critical data is the foundation for essential business processes, including personalized marketing, analytical reporting, and seamless online and in-store checkout and customer service experiences.
The CI team manages a wide array of high-performance, scalable batch and real-time services. These services are utilized at numerous customer interactions, such as in-store purchases, online orders, rewards program enrollments, and activations from various marketing channels (Email, Direct Mail, SMS, Push notifications, etc.). By leveraging modern development practices, tools, and technology platforms, the CI team builds capabilities that empower our customer-facing and checkout teams to deliver personalized, relevant, and frictionless experiences, ensuring customers realize value with every interaction.
Title: Big data engineer
Duration: Long term contract(W2)
Location: 100% Remote
Weβre looking for:
β’ Python, SQL, GCP(BQ), Spark, Airflow, Java(Optional)
β’ GCP Shop - using Big Query
β’ Does NOT want a machine learning engineer, wants a big data engineer
Required Skills:
9+ years of experience
Python, Airflow, PySpark, Spark SQL, Spark Streaming, Scala, Relational/No SQL databases, Apache Kafka, writing complex sql queries, GCP (Bigquery, Dataproc), working with RESTful APIs in data pipelines, CI/CD (gitlab CI)
Bonus Skills:
Experience with backend stack (Java, Spring boot)
Who the team is and what they do:
The Customer Identity (CI) team is central to the enterprise, focused on ensuring customer data is accurate, consistent, and readily accessible. This critical data is the foundation for essential business processes, including personalized marketing, analytical reporting, and seamless online and in-store checkout and customer service experiences.
The CI team manages a wide array of high-performance, scalable batch and real-time services. These services are utilized at numerous customer interactions, such as in-store purchases, online orders, rewards program enrollments, and activations from various marketing channels (Email, Direct Mail, SMS, Push notifications, etc.). By leveraging modern development practices, tools, and technology platforms, the CI team builds capabilities that empower our customer-facing and checkout teams to deliver personalized, relevant, and frictionless experiences, ensuring customers realize value with every interaction.






