Intelliswift Software
Data Engineer - Apache Flink
⭐ - Featured Role | Apply direct with Data Freelance Hub
This role is for a Data Engineer - Apache Flink in London, offering a contract length of "unknown" and a pay rate of "unknown." Key skills include Java, Apache Flink, Kafka, Docker, Kubernetes, and Terraform, with a focus on streaming data pipelines and distributed systems.
🌎 - Country
United Kingdom
💱 - Currency
£ GBP
-
💰 - Day rate
Unknown
-
🗓️ - Date
March 20, 2026
🕒 - Duration
Unknown
-
🏝️ - Location
Unknown
-
📄 - Contract
Unknown
-
🔒 - Security
Unknown
-
📍 - Location detailed
London Area, United Kingdom
-
🧠 - Skills detailed
#Automation #Data Engineering #Terraform #Data Pipeline #API (Application Programming Interface) #Debugging #Kubernetes #Kafka (Apache Kafka) #GIT #Docker #Java #Metadata #Programming #AWS (Amazon Web Services) #Version Control #Deployment
Role description
Data Engineer
London
WORK REQUIREMENTS
• Excellent expertise in Object oriented programming Java and API's.
• Experience in Streaming data pipelines using Apache Flink.
• Experience in distributed systems specially Kafka and its eco systems like Gateways, Publisher, Consumer.
• Good understanding of containerization using Docker, Kubernetes and EKS.
• Good experience of deployment tools like terraform.
• Understanding of version control like Git and CI/CD workflow.
• Understanding of File formats like Parquet and Avro.
• Debugging and trouble shooting.
• Good Communication and excellent collaboration skills to interact with internal customers for collecting requirements
Deliverables:
• Automation of cluster setup in Machinery for PFA customer. Service deployment (Kafka, Schema Registry, - Metadata
• Service, Data Platform Gateway, and Kafka Admin Operator) in new AWS accounts
• Integrate PFA with Kafka Automation, Schema Automation and Journal automation.
• Integrate PFA with Apple Ingest Control Plane.
• Implement the required enhancements to existing streaming pipelines developed using Apache Flink and Java.
• Onboarding topics, flinks jobs for journaling into iceberg format.
• Monitor and address user requests and issues as they arise.
• Support Kafka infrastructure and flink streaming pipelines to meet defined SLA’s and SLO’s
Data Engineer
London
WORK REQUIREMENTS
• Excellent expertise in Object oriented programming Java and API's.
• Experience in Streaming data pipelines using Apache Flink.
• Experience in distributed systems specially Kafka and its eco systems like Gateways, Publisher, Consumer.
• Good understanding of containerization using Docker, Kubernetes and EKS.
• Good experience of deployment tools like terraform.
• Understanding of version control like Git and CI/CD workflow.
• Understanding of File formats like Parquet and Avro.
• Debugging and trouble shooting.
• Good Communication and excellent collaboration skills to interact with internal customers for collecting requirements
Deliverables:
• Automation of cluster setup in Machinery for PFA customer. Service deployment (Kafka, Schema Registry, - Metadata
• Service, Data Platform Gateway, and Kafka Admin Operator) in new AWS accounts
• Integrate PFA with Kafka Automation, Schema Automation and Journal automation.
• Integrate PFA with Apple Ingest Control Plane.
• Implement the required enhancements to existing streaming pipelines developed using Apache Flink and Java.
• Onboarding topics, flinks jobs for journaling into iceberg format.
• Monitor and address user requests and issues as they arise.
• Support Kafka infrastructure and flink streaming pipelines to meet defined SLA’s and SLO’s
