Data Engineer

Who is HelloKindred? HelloKindred are specialists in staffing marketing, creative and technology roles, offering a range of talent solutions that can be delivered on-site, remotely or hybrid. Our vision is to make work accessible and people’s lives better. We do this by disrupting traditional employment barriers – connecting ambitious talent to flexible opportunities with trusted brands. Job Description Anticipated Contract End Date/Length: November 30, 2026 Work set up: Hybrid (3 days per week in office) Our client in the Information Technology and Services industry is looking for a Data Engineer to design, build, and optimize streaming data pipelines focused on OpenShift telemetry, observability, and proactive monitoring capabilities. This role plays a key part in enabling multi-tenant observability, ensuring data quality, lineage, and reliability across streaming platforms, while integrating telemetry into Splunk for advanced dashboards, alerting, and analytics. The position requires strong expertise in Kafka-based pipelines, OpenTelemetry instrumentation, schema governance, and collaboration with platform, SRE, and application teams to achieve Observability Level 4 maturity. What you will do: • Design, implement, and maintain data pipelines to ingest and process OpenShift telemetry including metrics, logs, and traces at scale. • Stream OpenShift telemetry via Kafka and build resilient consumer services for transformation and enrichment. • Engineer data models and routing for multi-tenant observability and ensure lineage, quality, and SLAs across the stream layer. • Integrate processed telemetry into Splunk for dashboards, alerting, analytics, and proactive insights. • Implement schema management using Avro or Protobuf, including governance and versioning for telemetry events. • Build automated validation, replay, and backfill mechanisms to ensure data reliability and recovery. • Instrument services with OpenTelemetry and standardize tracing, metrics, and structured logging across platforms. • Use LLM capabilities to enhance observability through query assistance, anomaly summarization, and runbook generation. • Collaborate with platform, SRE, and application teams to integrate telemetry, alerts, and SLOs. • Ensure security, compliance, and best practices across data pipelines and observability platforms. • Document data flows, schemas, dashboards, and operational runbooks. Qualifications • Hands-on experience building streaming data pipelines with Kafka including producers, consumers, schema registry, and Kafka tooling such as Connect, KSQL, or KStream. • Proficiency with OpenShift and Kubernetes telemetry, including OpenTelemetry, Prometheus, and CLI tooling. • Experience integrating telemetry into Splunk using HEC, UF, sourcetypes, and CIM, and building dashboards and alerting. • Strong data engineering skills using Python or similar languages for ETL, ELT, enrichment, and validation. • Knowledge of event schemas including Avro, Protobuf, and JSON with understanding of backward and forward compatibility. • Familiarity with observability standards and ability to drive proactive monitoring and automated insights. • Understanding of hybrid cloud and multi-cluster telemetry patterns. • Knowledge of security and compliance practices for data pipelines including RBAC, encryption, and secret management. • Strong problem-solving, collaboration, communication, and documentation skills. Additional Information All your information will be kept confidential according to EEO guidelines. Candidates must be legally authorized to live and work in the country where the position is based, without requiring employer sponsorship. HelloKindred is committed to fair, transparent, and inclusive hiring practices. We assess candidates based on skills, experience, and role-related requirements. We appreciate your interest in this opportunity. While we review every application carefully, only candidates selected for an interview will be contacted. HelloKindred is an equal opportunity employer. We welcome applicants of all backgrounds and do not discriminate on the basis of race, colour, religion, sex, gender identity or expression, sexual orientation, age, national origin, disability, veteran status, or any other protected characteristic under applicable law.