Lead Data Engineer

Consulting Opportunity: Data Engineer in Dallas, TX Role: Lead Data Engineer Location: Hybrid in Dallas Duration: 6-12 months Rate: Open (C2C welcome) DO NOT CALL SIMPLY SEND YOUR RESUME THROUGH LINKEDIN Description: This data engineer will lead a team of two data engineers in order to (continue) designing and develop data pipelines (either batch or streaming). Batch side is mainly focused on consuming data from an Azure data lake using Presto (with SQL interface) and pushing data into CosmosDB. Streaming is planned to have Kafka as the message queue and main mission is to properly consume messages to publish the CosmosDB DB. Also we are expecting in this role to have a leadership posture and also to come up with proactive ideas about how to improve current data pipelines, participate in client tech calls about overall architectural discussions and alignments, and also design data models of documental database (CosmosDB). Required skills Years of experience as a data engineer (at least 4+) Familiar with Azure architectures and data pipelines (Blob storage / azure functions / CosmosDB) Data pipeline streaming Kafka SQL Java (must) Data modeling Nice-to-have skills Python Data governance Data catalogs Presto Data Lake Architecture design - in azure Soft skills Agile environment experience Leadership experience Communication / English: Ingles B1. Would you be open to a call to discuss?