Data Engineer

We are seeking a highly skilled Senior Data Engineer to join our team in building a cutting-edge data platform for the warehouse and manufacturing domains within the Kroger supply chain space. As a Senior Data Engineer, you will be responsible for designing, implementing, and optimizing data pipelines to handle terabytes of data in Azure cloud environments. You will collaborate with cross-functional teams to architect scalable data solutions using Azure Databricks, Cosmos DB, Synapse Analytics, and SQL Hyperscale Experience with Informatica Unix Korn Shell and Power Center SQL experience required. Key Responsibilities • Accountable for developing and delivering technological responses to targeted business outcomes. • Analyze, design and develop enterprise data and information architecture deliverables, focusing on data as an asset for the enterprise. Understand and follow reusable standards, design patterns, guidelines, and configurations to deliver valuable data and information across the enterprise, including direct collaboration with 84.51, where needed • Design and implement robust data pipelines for high-throughput data ingestion, transformation, and storage. • Optimize data processing workflows for performance and scalability in Azure cloud environments. • Collaborate with data scientists and business analysts to understand requirements and deliver data engineering solutions that meet business objectives. • Ensure data consistency, reliability, and security in distributed data processing environments. • Monitor and troubleshoot data pipeline failures, ensuring minimal downtime and maximum reliability. • Refine Requirements • Design and develop Informatica solutions • Perform Unit and Integration Testing • Handle deployments • Draft architectural diagrams, interface specifications and other design documents • Participate in the development and communication of data strategy and roadmaps across the technology organization to support project portfolio and business strategy • Innovate, develop, and drive the development and communication of data strategy and roadmaps across the technology organization to support project portfolio • Drive the development and communication of enterprise standards for data domains and data solutions, focusing on simplified integration and streamlined operational and analytical uses • Drive digital innovation by leveraging innovative new technologies and approaches to renovate, extend, and transform the existing core data assets, including SQL-based, NoSQL-based, and Cloud-based data platforms • Define high-level migration plans to address the gaps between the current and future state, typically in sync with the budgeting or other capital planning processes • Lead the analysis of the technology environment to detect critical deficiencies and recommend solutions for improvement • Mentor team members in data principles, patterns, processes and practices • Promote the reuse of data assets, including the management of the data catalog for reference • Draft and review architectural diagrams, interface specifications and other design documents