Azure Data Factory Engineer

At Tata Technologies we make product development dreams a reality by designing, engineering and validating the products of tomorrow for the world’s leading manufacturers. Due to our continued growth we are now recruiting for an Azure Data Factory Engineer to be based at our site in Warwick. Key Accountabilities • Pipeline Design and Management: Creating, scheduling, and managing data pipelines using Azure Data Factory. • Data Transformation: Converting raw data into structured datasets using data flows. • Use of Azure Data Factory Activities like Stored procedures, IfElse , etc. • Azure data factory, Linked Service like RestAPI , Azure Managed SQL DB. • Ensuring smooth operation of data pipelines and resolving any issues. • Work with APIs, connectors, and integration runtimes for seamless data flow. • Performing checks and validating data transformations for accuracy. • Recording pipeline designs and operations for future reference. • Work closely with development and operations teams to troubleshoot issues, ensuring system reliability and continuous availability. Knowledge / Experience • Experience in using Azure Data Factory connectors, especially SAP-specific ones like SAP S/ 4HANA • Understanding of SAP data structures and integration method. • Proficient with Azure Data Factory's Mapping Data Flow for transforming and processing SAP data • Strong understanding of data integration, ETL processes, and cloud-based data solutions • Ability to troubleshoot and optimize data pipelines for performance and reliability. • Strong understanding of cloud platform Azure, as well as containerization tools like Docker or Kubernetes • Knowledge of Azure Functions and Azure Logic apps. • Experience with monitoring tools like Azure Monitor for tracking pipeline performance and troubleshooting issues. • Proficient in WEB API, C# code, ADO.NET, .NET Core, ASP.NET, SQL • Experience with code and version control systems such as Git. • Familiarity with security best practices for cloud infrastructure and DevOps pipelines. • Strong understanding of CI/CD and available tools. • Experience with Azure DevOps and understanding of Agile methodologies. If you are passionate about bringing innovation to the projects you work on and want to join a global company, then this is the place for you. Tata Technologies: Engineering a better world. Tata Technologies would like to thank all applicants for their interest, each application will be reviewed against the set criteria for the role. We would like to advise that only candidates under consideration will be contacted. If you do not hear from us within 10 working days following the closing date it will mean that unfortunately your application has not been successful. We will however retain your details for any suitable future opportunities.