Data Engineer

Job Title: Senior Data Engineer (Python & Snowflake, SQL) Location: New Providence, NJ Employment Type: Contract Sr. Data Engineer (Python, Snowflake, SQL) • The developer should have strong Python, Snowflake, SQL coding skills. • The developer should be able to articulate few real time experience scenarios and should have a good aptitude to show case solutions for real life problems in Snowflake and Python. • The developer should be able to write code in Python for some intermediate level problems given during the L1 assessment. • Lead qualities to be able to guide a team and to own the end to end support of the project. Around 8 years’ experience as Snowflake Developer on design and development of data solutions within the Snowflake Data Cloud, leveraging its cloud-based data warehousing capabilities. Responsible for designing and implementing data pipelines, data models, and ETL processes, ensuring efficient and effective data storage, processing, and analysis. Able to write Complex SQL Queries, Write Python Stored Procedure code in Snowflake Job Description Summary: Data Modelling and Schema Design: • Create and maintain well-structured data models and schemas within Snowflake, ensuring data integrity and efficient query performance. ETL/ELT Development: • Design and implement ETL (Extract, Transform, Load) or ELT (Extract, Load, Transform) processes to load data into Snowflake from various sources. Data Pipeline Management: • Build and optimize data pipelines to ingest data into Snowflake, ensuring accurate and timely data flow. SQL Optimization: • Write and optimize SQL queries to enhance performance and efficiency within Snowflake. Performance Tuning: • Identify and address performance bottlenecks within Snowflake, optimizing query execution and resource allocation. Security and Governance: • Implement data security and governance best practices within Snowflake environments, including access control and encryption. Documentation and Maintenance: • Maintain documentation for data models, data pipelines, and other Snowflake solutions. Troubleshooting and Support: • Troubleshoot and resolve issues within Snowflake, providing technical support to users. • Collaboration: • Collaborate with data architects, data engineers, and business users to understand requirements and deliver solutions Other Skills: • Experience with data warehousing concepts and data modelling. • Hands-on experience in creating stored procedures, functions, tables, cursors. • Experience in database testing, data comparison, and data transformation scripting. • Capable of troubleshooting common database issues • Hands on experience in Gitlab with understanding of CI/CD Pipeline, DevOps tools • Knowledge on AWS Lambda and Azure Functions