Data Engineer
⭐ - Featured Role | Apply direct with Data Freelance Hub
This role is for a Data Engineer with 6+ years of software development experience, including 3+ years in large-scale data platforms. Key skills include Java, Spark, and knowledge of Parquet/Avro/Hive/Iceberg. Contract length and pay rate are unspecified.
🌎 - Country
United States
💱 - Currency
$ USD
-
💰 - Day rate
-
🗓️ - Date discovered
June 13, 2025
🕒 - Project duration
Unknown
-
🏝️ - Location type
Unknown
-
📄 - Contract type
Unknown
-
🔒 - Security clearance
Unknown
-
📍 - Location detailed
Seattle, WA
-
🧠 - Skills detailed
#Version Control #Data Replication #GIT #Kubernetes #Data Engineering #Java #Spark (Apache Spark) #Monitoring #Replication #Migration #Docker #Debugging #Golang
Role description
Heading 1
Heading 2
Heading 3
Heading 4
Heading 5
Heading 6
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam, quis nostrud exercitation ullamco laboris nisi ut aliquip ex ea commodo consequat. Duis aute irure dolor in reprehenderit in voluptate velit esse cillum dolore eu fugiat nulla pariatur.
Block quote
Ordered list
- Item 1
- Item 2
- Item 3
Unordered list
- Item A
- Item B
- Item C
Bold text
Emphasis
Superscript
Subscript
Must Have skills:
Java and Spark
Parquet, Avro, Hive or Iceberg
Detailed Job Description
- 6+ years overall software development experience with at least 3+ years of experience in large scale data platforms.
- Excellent expertise in Spark and Java.
- Knowledge of Golang is highly desirable.
- Good understanding of containerization using Docker and Kubernetes.
- Understanding of version control like Git and CI/CD workflow.
- Understanding of Parquet/Avro/Hive/Iceberg.
- Well experienced in debugging and troubleshooting.
- Good Communication and excellent collaboration skils to interact with internal customers.
Deliverables:
- Help support Data Replication Service (Spark jobs) and develop features/bug fixes.
- Help support SparkCp (a library) in debugging and fixing issues encountered by DRS.
- Help support the CDH Migration Tool in debugging and fixing issues encountered by customers.
- Implement monitoring/alerting improvements to the 3 tools mentioned previously for better supportability.
- Perform onboarding tasks to help move customer data.
- Monitor and address user requests and issues as they arise.
