Data Engineer

Data Engineer Brooksource Contract Fortune 50 Health Insurance Client Remote Our client is a leading provider of in-home care services, dedicated to delivering personalized, high-quality health solutions that help patients stay in the comfort of their homes. As part of their commitment to innovation, they're harnessing advanced data and AI technologies to improve operational efficiency and compliance across the care continuum. Role Overview We are seeking an experienced Data Engineer to join our growing AI & Analytics team. In this role, you will help solve critical operational challenges by enabling large-scale data extraction and transformation to support machine learning workflows. A key challenge we’re tackling is claims review and medical necessity validation: visit documentation is often flagged by CMS, putting claims on hold unnecessarily. Your work will ensure clinical visit notes are efficiently ingested and processed by our AI models to streamline claim validation. Key Responsibilities • Extract daily visit note data (13,000–30,000 records/day) from Snowflake. • Transform and stage data in Databricks for downstream use by the AI/ML team. • Automate pipelines to extract data from Databricks and deliver it to the AI team for processing via ChatGPT-based models. • Integrate with external systems and APIs as needed to move or retrieve data. • Ensure data reliability, traceability, and scalability throughout the ETL/ELT pipeline. • Collaborate cross-functionally with AI engineers, clinical ops, and product managers to understand data needs. • Contribute to evolving best practices for data engineering in a regulated healthcare environment. Qualifications Required: • Expert-level experience with Databricks (development, orchestration, and optimization). • Hands-on experience with Snowflake and data extraction at scale. • Strong Python or SQL programming skills. • Experience with MongoDB and making API calls (RESTful services). • Demonstrated ability to bring data into and out of Databricks environments. • Familiarity with data validation, quality control, and logging in production pipelines. Preferred: • Prior experience in the healthcare industry or familiarity with medical claims workflows. • Knowledge of CMS documentation standards and medical necessity criteria. • Exposure to AI/ML systems and model input requirements. About Eight Eleven: At Eight Eleven, our business is people. Relationships are at the center of what we do. A successful partnership is only as strong as the relationship built. We’re your trusted partner for IT hiring, recruiting, and staffing needs. For over 16 years, Eight Eleven has established and maintained relationships that are designed to meet your IT staffing needs. Whether it’s contract, contract-to-hire, or permanent placement work, we customize our search based upon your company's unique initiatives, culture, and technologies. With our national team of recruiters placed at 21 major hubs around the nation, Eight Eleven finds the people best-suited for your business. When you work with us, we work with you. That’s the Eight Eleven promise. Eight Eleven Group provides equal employment opportunities (EEO) to all employees and applicants for employment without regard to race, color, religion, national origin, age, sex, citizenship, disability, genetic information, gender, sexual orientation, gender identity, marital status, amnesty, or status as a covered veteran in accordance with applicable federal, state, and local laws.