Data Engineer

Optomi, in partnership with a leading utilities company, is seeking a Data Engineer with strong experience in Dataiku DSS and Azure data services to design, build, and optimize enterprise data pipelines and curated data layers. Qualifications: • 3–6+ years of experience in data engineering, analytics engineering, or a related field. • Strong hands-on experience with Dataiku DSS, including flows, recipes, scenarios, automation, and governance features. • Proficiency in SQL and Python for data transformation, processing, and workflow automation. • Experience with Azure data services such as ADLS Gen2, Azure SQL, Azure Data Factory, Synapse, or similar. • Solid understanding of ELT/ETL design, data modeling, and data quality principles. • Experience integrating and transforming data from a variety of enterprise source systems. Responsibilities: • Design, build, and maintain scalable, production-grade pipelines using Dataiku DSS. • Develop and optimize data layers within Azure, including ADLS Gen2, Azure SQL, and Synapse. • Ingest, transform, and curate data from enterprise systems, operational sources, APIs, and third party providers. • Implement robust data validation, workflow automation, monitoring, and exception handling in Dataiku. • Collaborate with business units to understand data needs for financial, capital project, and safety analytics use cases. • Develop well-structured datasets and curated layers that support analytical, operational, and reporting workflows. • Establish best practices for pipeline development, ELT architecture, performance optimization, and reusable components. • Ensure alignment with enterprise data governance, metadata standards, and secure access frameworks. • Build and maintain documentation, lineage tracking, and dataset definitions within Dataiku and Azure. • Participate in version control workflows, CI/CD, and environment management as part of the development cycle.