Data Engineer

Agility Partners is seeking a qualified Data Engineer to fill an open position with one of our clients. This is an exciting opportunity in the retail industry, where you’ll help build and optimize data infrastructure for impactful business insights. You’ll work with modern big data tools, cloud platforms, and automation frameworks in a collaborative, fast-paced environment. The Data Engineer will design, build, and maintain data pipelines and infrastructure, ensuring high-quality data is available for analytics and reporting. You’ll collaborate with engineering and architecture teams, automate processes, and support data-driven decision-making across the organization. Responsibilities: • Team up with engineering and enterprise architecture to define standards, design patterns, and DevOps automation • Create and maintain data ingestion, quality testing, and audit frameworks • Build and automate data pipelines using Azure Data Factory, Databricks/Spark, Snowflake, Kafka, and scheduler tools • Conduct complex data analysis and respond to business and technology queries Qualifications: • Bachelor’s degree in Computer Science, Information Systems, or related field • 3–5 years of experience in data engineering or related disciplines • Experience with big data frameworks (Spark, Hive), ETL processes, and cloud platforms (Azure, AWS, GCP) • Proficiency in data modeling, pipeline automation, and metadata management • Familiarity with DevOps, CI/CD, and Agile/Scrum environments • Relevant certifications (AWS Big Data, Google Data Engineer, Azure Data Engineer) are a plus • Strong communication and collaboration skills Reasons to Love This Opportunity: • Work with cutting-edge data technologies and cloud solutions • Opportunity to drive innovation and process automation in a dynamic team • Support data literacy and training programs for business and technology users • Be part of a collaborative environment focused on professional growth and impact