Data Engineer

Job Overview We are seeking a skilled Data Engineer to join our team. The successful candidate will be responsible for developing, constructing, testing, and maintaining architectures such as databases and large-scale processing systems. Responsibilities Primary skills : Data, Python, pyspark Should have expertise in data engineering experience leveraging technologies such as Snowflake, Azure Data Factory, ADLS, Databricks etc. Should have expertise in writing SQL queries against any RDBMS with query optimization. Experience structuring Data Lake for reliability security and performance. Experience implementing ETL for Data Warehouse and Business intelligence solutions. Ability to write effective modular dynamic and robust code, establish code standards as well. Strong analytical problem-solving and troubleshooting abilities. Good understanding of unit testing software change management and software release management. Knowledge of DevOps processes including CI/CD and Infrastructure as Code fundamentals Experience performing root cause analysis on data & processes and identify opportunities for improvement. Familiar with Agile software development methodologies. Proactive communication and stakeholder management. Job Type: Fixed term contractContract length: 6 months Pay: £400.00-£420.00 per day Experience: Python: 4 years (required) Pyspark: 4 years (required) Snowflake: 2 years (required) Azure Data Factory: 4 years (required) Databricks : 3 years (required) SQL queries : 3 years (required) Data Lake : 3 years (required) ETL for Data Warehouse: 4 years (required) CI/CD and Infrastructure as Code: 3 years (required)