Data Engineer

W2 only - no C2C or subcompany referrals ECCO Select is a talent acquisition and consulting company specializing in people, process and technology solutions. We provide the talent behind the technology enabling our clients to achieve their goals. For more information about ECCO Select, visit us at www.eccoselect.com. Position Title: Data Engineer SUMMARY The purpose of this position is to perform Data Development functions including design new or enhance existing enterprise database systems, maintain or develop critical databases processes, perform unit and system testing, perform support and help desk tasks. It also requires defining and adopting best practices for each of the data development functions as well as visualization and ETL processes. The position is responsible for architecting report solutions using SSRS reports by collaborating with management team. This position is also responsible for architecting ETL functions between a multitude of relational databases and external data files. ESSENTIAL DUTIES AND RESPONSIBILITIES • Work with a highly dynamic team focused towards Digital Transformation • Understand the domain and business processes to implement successful data pipelines • Provide work status, and coordinate with Data Engineers • Manage customer deliverables and regularly report the status via Weekly/Monthly reviews • Ability to work in a dynamic environment with changing requirements • Good communication and presentation skills • Working experience with a wide range of data technologies, data modeling, and metadata management • Working experience with T-SQL and relational databases including currently supported versions of Microsoft SQL Server in Azure • Design, develop and maintain Stored Procedures, Functions and Views • Working experience with development and maintenance of Data Factory data pipelines • Working experience with development and maintenance of data pipelines on the Databricks platform in Azure • Working experience using DevOps CI/CD in Azure • Program in T-SQL with relational databases including currently supported versions of Microsoft SQL Server • Working experience using SQL and Python (PySpark) for data processing and transformation • Strong experience working across the full Microsoft tech stack, including Azure Data Factory, Azure SQL, Azure Data Lakehouse, Azure Data Bricks, and Azure DevOps • Write high performance SQL queries using Joins, Cross Apply, Aggregate Queries, Merge, Pivot • Design normalized database tables with proper indexing and constraints • Perform SQL query tuning and performance optimization on complex inefficient queries • Provide guidance in the use of table variable, temporary table, CTE appropriately to deal with large datasets • Collaborate with DBA on database design and performance enhancements • Leading in all phases of the software development life cycle in a team environment • Debug existing code and troubleshoot for issues • Design and provide a framework for maintaining existing data warehouse for reporting and data analytics • Following best practices, design, develop, test and document ETL processes • Develop data cleansing routines utilizing typical data quality functions involving standardization, transformation, rationalization, linking and matching • Keep up-to-date with the latest database features, techniques, and technologies • Support current business applications including the implementation of bug fixes as needed • Able to multi-task and adapt to shifting priorities • Able to meet deadlines set in project planning • Effectively communicate progress through the project execution phase • Follow industry and company standard coding practices • Produce technical and application documentation • Produce quality deliverables upon deployment • Other duties as assigned QUALIFICATIONS AND REQUIREMENTS To perform this job successfully, an individual must be able to perform each essential duty satisfactorily. The requirements listed below are representative of the knowledge, skill, and/or abilities. • Minimum 10 years of work-related experience in T-SQL, SSRS, and ETL. If candidate has relevant education in computer science, computer information systems, or related field, lack of experience can be supplemented by education as follows: • Minimum 7 years of experience with development and maintenance of Azure Data Factory data pipelines • Minimum 5 years of experience with development and maintenance of data pipelines on the DataBricks platform in Azure • Minimum of 3 years of experience using DevOps CI/CD in Azure • Minimum of 3 years of supervising data infrastructure and data flows • Strong proficiency in the Microsoft Tech Stack, including: • Microsoft Azure ecosystem (Azure Data Factory, Azure Data Lakehouse, Azure SQL Database) • Databricks • SQL Server • SSRS, SSIS, SSAS • T-SQL • Python (PySpark) – required • Understanding of data lakehouse architecture in Azure • Experience developing, maintaining, and supporting database processes using Microsoft SQL Server with emphasis on .NET technologies • Proficient at a senior level with T-SQL, SSRS, SSIS, SSAS, ETL, Data Warehousing, and Python • Demonstrated ability to perform above listed essential job functions ECCO Select is committed to hiring and retaining a diverse workforce. Our policy is to provide equal opportunity to all people without regard to race, color, religion, national origin, ancestry, marital status, veteran status, age, disability, pregnancy, genetic information, citizenship status, sex, sexual orientation, gender identity or any other legally protected category. Veterans of our United States Uniformed Services are specifically encouraged to apply for ECCO Select opportunities. Equal Employment Opportunity is The Law This Organization Participates in E-Verify