Kafka Principal Data Engineer, Streaming & Architecture @ Remote Work
⭐ - Featured Role | Apply direct with Data Freelance Hub
This role is for a Kafka Principal Data Engineer, Streaming & Architecture, lasting 12 months+ at a remote location. Key skills include Apache Kafka, CDC tools, data pipeline development, and Agile experience. Familiarity with Informatica MDM is a plus.
🌎 - Country
United States
💱 - Currency
$ USD
-
💰 - Day rate
-
🗓️ - Date discovered
May 31, 2025
🕒 - Project duration
More than 6 months
-
🏝️ - Location type
Remote
-
📄 - Contract type
Unknown
-
🔒 - Security clearance
Unknown
-
📍 - Location detailed
United States
-
🧠 - Skills detailed
#Kafka (Apache Kafka) #Data Pipeline #Batch #Data Architecture #Apache Kafka #MDM (Master Data Management) #"ETL (Extract #Transform #Load)" #Data Engineering #Project Management #Scala #Informatica #Programming #Agile
Role description
Kafka Principal Data Engineer, Streaming & Architecture
Location: remote work
Duration: 12 Months+
We are seeking a highly skilled Data Engineer and Technical Lead to spearhead the transformation of legacy batch data pipelines into a modern, event-driven architecture using Apache Kafka. This role will lead the design and implementation of streaming data pipelines and ensure seamless integration with Informatica MDM.
Key Responsibilities:
- Design and deliver scalable data architecture for streaming ingestion.
- Convert batch file loads from claim systems to Kafka-based streams.
- Implement change data capture (CDC) using Debezium or similar tools.
- Ensure data validation through dual-run testing and retire legacy batch loads.
- Collaborate with client data engineering teams via paired programming and knowledge transfer.
Required Skills:
- Strong experience with Apache Kafka and CDC tools.
- Proficiency in data pipeline development, data engineering, data architecture, and data validation strategies.
- Agile delivery experience and excellent communication skills.
- (Nice to have) Familiarity with Informatica MDM integration.
- (Nice to have) Project management experience
Kafka Principal Data Engineer, Streaming & Architecture
Location: remote work
Duration: 12 Months+
We are seeking a highly skilled Data Engineer and Technical Lead to spearhead the transformation of legacy batch data pipelines into a modern, event-driven architecture using Apache Kafka. This role will lead the design and implementation of streaming data pipelines and ensure seamless integration with Informatica MDM.
Key Responsibilities:
- Design and deliver scalable data architecture for streaming ingestion.
- Convert batch file loads from claim systems to Kafka-based streams.
- Implement change data capture (CDC) using Debezium or similar tools.
- Ensure data validation through dual-run testing and retire legacy batch loads.
- Collaborate with client data engineering teams via paired programming and knowledge transfer.
Required Skills:
- Strong experience with Apache Kafka and CDC tools.
- Proficiency in data pipeline development, data engineering, data architecture, and data validation strategies.
- Agile delivery experience and excellent communication skills.
- (Nice to have) Familiarity with Informatica MDM integration.
- (Nice to have) Project management experience
