Data Engineer

• 6 month contract • • hybrid in egg harbor, nj • Required Skills & Experience • Bachelor’s degree in computer science, Information Technology, or a related field. • 3-5 years of hands-on experience with Data Engineering, BI, or Data Warehousing. • Strong experience on Azure Databricks, Azure Data Factory, Azure Key Vault, ADLS • Proficiency in Python and SQL. • Experience with Data integration, ingestion, transformation and modelling • Basic understanding of agile project delivery framework and DevOps processes. • Familiarity with visualization platforms like PowerBI • Basic knowledge of modeling techniques (star schema, OLAP) and workflow orchestration (Apache Airflow) • Knowledge on using AI tools like Co-pilot, ChatGPT, Databricks Assistant, Github Co-pilot • Excellent written and verbal communication skills. • Self-starter who welcomes responsibility and is eager to learn and grow and should be able to work with the team Nice to Have Skills & Experience • Basic knowledge on AI/ML concept will be plus Job Description One of Insight Global's retail clients is searching for a Data Engineer who will support the data engineering function by assisting in the development and maintenance of robust data pipelines and collaborating with various teams. Key responsibilities include: • Development and management of data pipelines for various data sources such as e-commerce, stores, suppliers & vendors, and internal ERP systems • Supporting senior data engineers and data architects in building and maintaining data infrastructure and architecture and ensuring data integrity and security. • Collaborating with cross-function teams including Data engineers, Data architects, Business Analyst, IT leaders and business users to understand data requirements • Assisting in maintaining the code repository and assist in maintaining and promoting the pipelines through CI/CD • Responsible for performing root cause analysis on internal and external data processing related issues • Maintain documentation and create high level data flow and low-level data flow for the pipelines • Following best practices in coding and maintaining data pipelines to ensure efficiency, reliability, and scalability Pay Rate: Up to $60/hour. Exact compensation may vary based on several factors, including skills, experience, and education. Benefit packages for this role will start on the 31st day of employment and include medical, dental, and vision insurance, as well as HSA, FSA, and DCFSA account options, and 401k retirement account access with employer matching. Employees in this role are also entitled to paid sick leave and/or other paid time off as provided by applicable law.