Data Engineer

⭐ - Featured Role | Apply direct with Data Freelance Hub
This role is for a Data Engineer with 6+ years of experience, offering a contract length of "unknown" and a pay rate of "$X/hour." Key skills include Python, SQL, and cloud data solutions, with preferred experience in financial services.
🌎 - Country
United Kingdom
πŸ’± - Currency
Β£ GBP
-
πŸ’° - Day rate
-
πŸ—“οΈ - Date discovered
September 27, 2025
πŸ•’ - Project duration
Unknown
-
🏝️ - Location type
Unknown
-
πŸ“„ - Contract type
Unknown
-
πŸ”’ - Security clearance
Unknown
-
πŸ“ - Location detailed
Glasgow, Scotland, United Kingdom
-
🧠 - Skills detailed
#Deployment #Databricks #Leadership #NumPy #"ETL (Extract #Transform #Load)" #AWS (Amazon Web Services) #R #UAT (User Acceptance Testing) #Spark (Apache Spark) #Snowflake #Data Integration #Agile #Complex Queries #Data Analysis #Libraries #Cloud #Scala #SQL (Structured Query Language) #Data Pipeline #Python #Azure #Databases #Pandas #Security #Data Engineering #Documentation #SQL Queries #Data Lake #PySpark #NoSQL #RDBMS (Relational Database Management System) #Cloudera
Role description
Data Engineer with over 6+ years of experience to join our team to help a strategic banking client in various data transformation activities. Key Responsibilities: β€’ Design and implement tailored data solutions to meet customer needs and use cases, spanning from streaming to data lakes, analytics, and beyond within a dynamically evolving technical stack. β€’ Provide thought leadership by recommending the most appropriate technologies and solutions for a given use case, covering the entire spectrum from the application layer to infrastructure. β€’ Demonstrate proficiency in coding skills, utilizing languages οΏ½ Python & SQL, to efficiently move solutions into production while prioritizing performance, security, scalability, and robust data integrations. β€’ Collaborate seamlessly across diverse technical stacks, including Cloudera, Databricks, Snowflake, Azure, AWS, etc. β€’ Develop various components in Python of our unified data pipeline framework. β€’ Contribute towards the establishment of best practices for the optimal and efficient usage of data across various on-prem and cloud platforms. β€’ Assist with the testing and deployment of our data pipeline framework utilizing standard testing frameworks and CI/CD tooling. β€’ Monitor the performance of queries and data loads and perform tuning as necessary. β€’ Provide assistance and guidance during the QA & UAT phases to quickly confirm the validity of potential issues and to determine the root cause and best resolution of verified issues. β€’ Develop SQL-based data validation, reporting, analysis, etc. as required β€’ Generate comprehensive solution documentation, including sequence diagrams, class hierarchies, logical system views, etc. β€’ Adhere to Agile practices throughout the solution development process. β€’ Design, build, and deploy databases and data stores to support organizational requirements. Skills / Qualifications: β€’ 4+ years of experience supporting Software Engineering, Data Engineering, or Data Analytics projects. β€’ 4+ years of experience in data development and solutions in highly complex data environments with large data volumes. β€’ 3+ years of SQL / PLSQL experience with the ability to write ad-hoc and complex queries to perform data analysis. β€’ 3+ years of experience developing data pipelines and data warehousing solutions using Python and libraries such as Pandas, NumPy, PySpark, etc. β€’ 2+ years of experience developing solutions in a hybrid data environment (on-Prem and Cloud) β€’ Hands on experience with developing data pipelines for structured, semi-structured, and unstructured data and experience integrating with their supporting stores (e.g. RDBMS, NoSQL DBs, Document DBs, Log Files, etc.) β€’ Experience with performance tuning SQL queries, Spark job, and stored procedures. β€’ An understanding of E-R data models (conceptual, logical, and physical). β€’ Strong analytical skills, including a thorough understanding of how to interpret customer business requirements and translate them into technical designs and solutions. β€’ Strong communication skills both verbal and written. Capable of collaborating effectively across a variety of IT and Business groups, across regions, roles and able to interact effectively with all levels. β€’ Self-starter. Proven ability to manage multiple, concurrent projects with minimal supervision. Can manage a complex ever changing priority list and resolve conflicts to competing priorities. β€’ Strong problem-solving skills. Ability to identify where focus is needed and bring clarity to business objectives, requirements, and priorities. Preferred Qualifications οΏ½ Experience in financial services οΏ½ Knowledge