Senior Data Engineer

For more details, please connect with Pawans at 510-983-4629 or email at pawans@vgroupinc.com Must Have State Client experience in the past End Client: State of North Carolina Department: North Carolina Department of Public Instruction (NCDPI) Job Title: Data Engineer - Senior Duration: 12+ Months With possibility of further extension Location: 301 N. Wilmington St, Raleigh, NC 27601- Hybrid Position Type: Contract Hours Per Week: 40 Interview Type: Either Webcam or In-Person Interview Summary: We are seeking a skilled mid-level+ Data Engineer to join our team and focus on quality assurance, quality checking, and ETL processes. The successful candidate will be responsible for ensuring the integrity and accuracy of data transferred from a shared file transfer service to an S3 bucket and subsequently into and through our Snowflake data platform. This data will be utilized by downstream applications and reporting systems. These applications and the corresponding consumed data are critical to business process execution Skills: • Demonstrated mid-level+ experience in data engineering, with a emphasis on data quality assurance and ETL processes • Expertise in Python, PyPI, and SQL • Expert analytical and problem-solving skills • Demonstrate a strong understanding of cybersecurity principles related to code development, DevOps, data access, and fundamental cybersecurity • Understanding of fundamental public-cloud capabilities Responsibilities: • Quality Assurance & Quality Checking: Implement and maintain data quality to ensure the accuracy and reliability of data throughout the ETL process. • ETL Processes: Design, develop, and optimize ETL workflows to efficiently transfer data from file transfer services to S3 buckets and Snowflake. • Data Integration: Ensure seamless data integration into data platform, enabling efficient consumption by downstream applications and reporting tools. • Data Quality Management: Address data quality challenges, including inconsistencies in source data that do not meet ingestion requirements, which can lead to load failures or data backouts. • Collaboration: Work closely with business owners, data analysts, business intelligence teams, and other stakeholders to understand data requirements and deliver high-quality data solutions. • Monitoring & Troubleshooting: To preserve data flow and integrity, monitor pipelines, identify issues, and implement solutions. \_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_ V Group Inc. is an IT Services company which supplies IT staffing, project management, and delivery services in software, network, help desk and all IT areas. Our primary focus is the public sector including state and federal contracts. We have multiple awards/contracts with the following states: CA, FL, GA, MD, MI, NC, NY, OH, OR, PA,TX, VA, and WA. If you are considering applying for a position with V Group, or in partnering with us on a position, please feel free to contact me for any questions you may have regarding our services and the advantages we can offer you as a consultant. Website: www.vgroupinc.com LinkedIn: www.linkedin.com/company/v-group/ Facebook: www.facebook.com/VGroupIT Twitter: www.twitter.com/vgroupinc