Data Engineer

Title: Data Engineer Type: Contract / Fully Remote Location: Fully Remote / U.S. Only / No Sponsorship Summary: Our client is looking for innovative professionals who are passionate about driving exceptional outcomes for our customers. You'll be empowered to challenge the status quo and encouraged to think differently, leveraging a growth mindset to deliver tangible results. Here, professional growth isn't just a concept. It is a reality, fueled by continuous learning and a supportive, forward-thinking environment. Our client builds bespoke software using modern technologies and is on a mission to help their clients flourish with smart solutions to solve their business needs. As a data engineer, you will be responsible for designing, developing, and managing scalable data pipelines that feed into our data lake using MS Fabric. You will work closely with our Lead Data Engineer, analysts, and other stakeholders to ensure that the data infrastructure supports both current and future needs. Your role will involve integrating various data sources, ensuring data quality, and building a robust, scalable data lake architecture. Key Responsibilities: • Design, implement, and manage data lake solutions using MS Fabric. • Develop and maintain data pipelines to extract, transform, and load (ETL) data from various structured and unstructured sources. • Collaborate with cross-functional teams to understand data requirements and ensure seamless integration of new data sources into the data lake. • Optimize data storage and retrieval processes to improve performance and scalability. • Ensure the integrity, security, and availability of the data lake by implementing best practices in data governance and management. • Perform data profiling, cleansing, and transformation to ensure data quality. • Monitor and troubleshoot data flows to ensure reliable operation of the data pipelines. • Stay up to date with the latest trends and technologies in data engineering, particularly in relation to MS Fabric and data lake architectures. Requirements: • Proven experience as a Data Engineer, with a strong focus on data lake architecture and development. • Hands-on experience with MS Fabric and building data lakes. • Proficiency in data integration techniques for structured and unstructured data from multiple sources (e.g., APIs, databases, cloud services). • Strong programming skills in Python, SQL, or other relevant languages. • Experience with cloud platforms like Azure, AWS, or Google Cloud for data storage and processing. • Solid understanding of data warehousing, ETL processes, and big data technologies. • Strong experience with Power BI and DAX for data visualization • Knowledge of data governance principles and practices. • Strong problem-solving skills with attention to detail. • Excellent communication and collaboration skills. Preferred Skills & Experience: • Experience with additional data tools and platforms, such as Apache Spark, Hadoop, or Databricks. • Familiarity with machine learning workflows and model deployment in data lake • Experience working in Agile or DevOps environments.