Lead OR Sr. Data Engineer

Lead Data Engineer Responsibilities: • Lead data engineering efforts focused on streaming pipelines from MongoDB through Kafka into Snowflake. • Perform data modeling and transformation of complex JSON structures into standardized Snowflake tables. • Conduct discovery and analysis for new data sets; identify caveats and align with standard patterns. • Mentor mid-level data engineers, provide guidance on ticket scope, development practices, and troubleshooting. • Ensure adherence to agile practices (sprint planning, Jira ticket management, story refinement). • Validate and test data flows before handoff to downstream teams. Requirements: • Strong Snowflake experience, especially stored procedure development. • Deep knowledge of Kafka and JSON streaming. • Proficiency with Git (branching, merging, troubleshooting). • AWS ecosystem familiarity. • Proven leadership/mentorship ability. • QA mindset with strong validation/testing skills (Tosca is a plus). • Experience in enterprise-scale migrations to Snowflake. • SQL/Python • Nice-to-have: • Familiarity with boutique tools like UpSolver (internal onboarding provided). • Tosca • Soft skills: • Strong problem-solving and independence • Collaborative, team-oriented, effective communicator. • 6 years of experience is required , though more is preferred. Mid-Level Data Engineer Responsibilities: • Build and maintain streaming data pipelines with Kafka, MongoDB, and Snowflake. • Transform nested JSON into flattened Snowflake tables. • Participate in agile sprints: analyzing requirements, scoping tickets, developing and testing pipelines. • Perform self-validation and testing before promoting code. Requirements: • Database experience with Snowflake exposure. • Familiarity with Kafka, JSON, and AWS-based pipelines. • Hands-on experience with Git for version control. • Agile team experience (ticket-based work, sprint cycles). • QA/testing practices with data pipelines. • SQL/Python • 4-6 years of experience • Nice-to-have: • Prior exposure to Uspolver or similar boutique ETL tools. • Healthcare background not required but a plus. • Tosca for testing • Soft skills: • Willingness to learn proprietary tools through onboarding. • Team-oriented, open to feedback, detail-oriented.