Senior Data Engineer

Description: NOTE: Must be a US Citizen or Green Card Holder. No sponsorship or C2C at this time. You must also love within 4 hours of Philadelphia and be willing to travel quarterly to their offices in Pennsylvania for important meetings. No exceptions. Our client, a stable company with offices in Pennsylvania, is hiring a Senior Data Engineer to join their team. This is a full-time salaried, remote position (must be in the EST time zone) with a competitive base salary and a comprehensive benefits package. As a Senior Data Engineer at our client, you will responsible for integrating and analyzing raw data, developing and maintaining data pipelines and datasets and improving data quality and efficiency. This Data Engineer needs to have strong analytical skills and will involve various methods to integrate different data sources, transform data into useful business drivers. You should be intimate with several data stores, integration tools/technologies, data transformation methods, data modelling and analysis. Candidate should be able to work across projects involving multiple stakeholders and have strong technical and programming skills while working with business, architects, partners to resolve complex system issues. Responsibilities: • Develops and maintains scalable data pipelines, integration tools and builds out new API integrations to support continuing increases in data usage, volume, and complexity. • Building analytical tools to utilize the data pipeline, providing actionable insight into key business performance metrics including operational efficiency and customer acquisition. • Designs data integrations, data quality framework and integrate it with monitoring services. Strong hands-on capabilities across integration toolsets including but not limited to ADF, Replication, CDC etc. • Performs data analysis required to troubleshoot data related issues and assist in the resolution of data issues. • Identifying, designing, and implementing internal process improvements including re-designing infrastructure for greater scalability, DB, SQL, and data pipelines performance tuning, optimizing data delivery, and automating manual processes • Build solution prototypes as needed and write algorithms against data. • Implements processes and systems to monitor data quality, ensuring production data is always accurate and available for key stakeholders and business processes that depend on it. • Strong Programming, SQL skills across structured and unstructured data. Intimate with most Azure services including ADF, Azure Functions, ASB, API, Synapse, SQL • Collaborates with analytics and business teams to improve data models that feed business intelligence tools, increasing data accessibility, and fostering data-driven decision making across the organization. • Works closely with a team of frontend and backend engineers, product managers, and analysts • Data Management, Modelling, Architecture, and Integration • ETL, ELT with Data Lake and Data Warehouse data platforms • Should be self-starter with strong execution and delivery mindset. • Monitor and manage database performance • Excellent knowledge of data backup, recovery, security, integrity and SQL • Hands-on experience with database standards and end user applications • Develop and maintain database documentation, including data standards, procedures and definitions for data elements and tables in the company. Experience and Competencies: • At least 7 years of experience in technology, specifically in the data field • Hands-on 7+ years' experience with SQL, Data integration, Data analysis, Data Modelling, and design • 4+ years of Python or Nodejs • 4+ years of experience with schema design and dimensional data modeling • Experience in technology platforms across Microsoft Azure, Cloud Computing, Software as a Services (SaaS), Integration Platform as a Service (IPaaS), Infrastructure as a Service (IaaS) • Previous experience as a data engineer or in a similar role • Technical expertise with data models, data mining, and segmentation techniques • Experience working and implementing solutions with Microservices Architecture • Experience working with Data warehousing and Data Lake solutions. • Demonstrated ability to instrument Data Quality & Management standards and processes. • 4+ years working with data integration and ETL tools, such as Azure Data Factory, CDC, Replication, Talend, Informatica etc. • Strong problem-solving and analytical skills • Excellent communication and collaboration abilities • Adaptability and a willingness to learn new technologies and techniques. • Ability to work with CI/CD pipelines and Automation. • Ability to apply multiple technical solutions to enable future-state business capabilities that, in turn, drive targeted business outcomes. • Ability to quickly comprehend the functions and capabilities of existing, new, and emerging technologies that enable and drive new business designs and models. • Bachelor’s degree in computer science or related field is a plus.