

Sr. Data Engineer (Healthcare, Spark, Scala) - Remote
β - Featured Role | Apply direct with Data Freelance Hub
This role is for a Sr. Data Engineer specializing in healthcare, requiring 5+ years of experience with Spark, Scala, and cloud technologies. Contract length is unspecified, with pay rate DOE. Candidates must have healthcare domain expertise and strong SQL skills.
π - Country
United States
π± - Currency
$ USD
-
π° - Day rate
-
ποΈ - Date discovered
June 21, 2025
π - Project duration
Unknown
-
ποΈ - Location type
Remote
-
π - Contract type
Unknown
-
π - Security clearance
Unknown
-
π - Location detailed
United States
-
π§ - Skills detailed
#Big Data #Migration #SQL (Structured Query Language) #Datasets #Data Integration #Data Engineering #Data Pipeline #Jira #S3 (Amazon Simple Storage Service) #Data Integrity #Kafka (Apache Kafka) #Langchain #Oracle #Snowflake #MS SQL (Microsoft SQL Server) #Spark SQL #Databricks #AWS (Amazon Web Services) #Computer Science #Hadoop #Apache Spark #RDBMS (Relational Database Management System) #Scala #Compliance #Code Reviews #Lambda (AWS Lambda) #Data Science #Data Ingestion #Spark (Apache Spark) #GCP (Google Cloud Platform) #Base #Azure #Cloud #"ETL (Extract #Transform #Load)" #ML (Machine Learning)
Role description
Heading 1
Heading 2
Heading 3
Heading 4
Heading 5
Heading 6
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam, quis nostrud exercitation ullamco laboris nisi ut aliquip ex ea commodo consequat. Duis aute irure dolor in reprehenderit in voluptate velit esse cillum dolore eu fugiat nulla pariatur.
Block quote
Ordered list
- Item 1
- Item 2
- Item 3
Unordered list
- Item A
- Item B
- Item C
Bold text
Emphasis
Superscript
Subscript
Dice is the leading career destination for tech experts at every stage of their careers. Our client, ConsultNet, LLC, is seeking the following. Apply via Dice today!
Title: Sr. Data Engineer, Healthcare
Location : 100% Remote
Target Start Date : ASAP
Type: contract or contract to hire
Pay Rate: DOE
Are you driven by working to improve our healthcare system through advanced technology? We need your expertise and integrity!
This role is 100% remote and we are looking for candidates who have healthcare domain expertise.
Responsibilities
β’ Design, maintain, and execute intermediate-to-advanced Apache Spark jobs (using RDDs, DataFrames, Datasets, and Structured Streaming) for data ingestion, transformation, validation, integration, and machine learning pipelines
β’ Develop, optimize, and refactor Scala-based Spark applications, including writing unit tests and conducting peer code reviews with a focus on performance and production-readiness
β’ Create, maintain, and enhance basic-to-intermediate SQL scripts for orchestration, data validation, and ETL operations. Tune SQL for efficient daily execution.
β’ Integrate LangChain into data workflows to support retrieval-augmented generation (RAG), prompt templates, and conversational or embedding-based data queries
β’ Use LangChain indexes and chains to interface with data stores like RDBMS, DataFrames, or CSV-enabling automated document analysis, summarization, and structured prompt pipelines
β’ Collaborate closely with engineering, DBAs, cloud ops, and data science teams to troubleshoot Spark cluster (e.g., Databricks / EMR), environmental, or network issues; support may include after-hours or weekend duty.
β’ Construct and sustain scalable data pipelines in cloud ecosystems (AWS, Azure, Google Cloud Platform, OCI), encompassing S3, Glue/EMR, Databricks, Kafka/Spark Streaming.
β’ Validate pipeline outputs to meet business and compliance requirements, ensuring data integrity and auditability.
β’ Follow all industry and organizational compliance guidelines.
β’ Track productivity, complete tasks via JIRA or similar ticketing systems, and deliver against performance goals.
β’ Support special projects (e.g., migration to Databricks, Snowflake integration, RAG workflows), and adapt responsibly to organizational change.
Qualifications
β’ Bachelor's degree in Computer Science, Information Technology, or equivalent experience.
β’ 5+ years experience with big data technologies (Spark, Scala, Hadoop, Kafka, Ray, etc.).
β’ Deep experience with Scala in Spark-writing idiomatic functional pipelines, optimizing Spark apps, leveraging DataFrame / Dataset APIs
β’ Intermediate to advanced Spark SQL, including query optimization and streaming design.
β’ LangChain proficiency: implementation of chains, prompt templates, retrieval workflows, and integration with LLMs/data systems .
β’ Cloud expertise (AWS/Azure/Google Cloud Platform/OCI), including Databricks, EMR, S3, Glue, Lambdas, Snowflake.
β’ Solid RDBMS skills (Oracle, MS SQL, Vertica), with strong SQL/PL-SQL or ETL experience for data integration.
β’ Prior experience in healthcare data (enrollment, medical/pharmacy claims) is preferred.
β’ Proficiency in Microsoft Office and project tools like JIRA.
β’ Familiarity with Databricks and/or Snowflake ecosystems.
Additional Requirements
β’ Highly analytical with a strong attention to detail.
β’ Exceptional verbal, written, and listening communication skills.
β’ Capable of independently managing multiple concurrent tasks and prioritizing under pressure.
β’ Comfortable working in both independent and team-based environments.
Welcome to ConsultNet and the family of companies, Tekne, SaltClick, TechBridge, and OmniMedia. As a premier national provider of technology talent and solutions, our expertise spans across project services, contract-to-hire, direct placement, and managed services both onshore and nearshore.
Celebrating more than 25 years of partnership with a diverse client base, we've crafted rewarding opportunities for our consultants, fostering high-performing teams that deliver impactful results.
Over the last few years thousands of consultants have found their calling with us in roles that have made a meaningful impact on their lives, enhanced their career, challenged them, and propelled them towards achieving their personal and professional goals. At the ConsultNet family of companies, we believe effective communication is crucial in aligning the right job with your unique skills and professional aspirations. To us, it's all about the personal approach we take and the values we uphold.
Our comprehensive service offerings cover a wide range of technology positions across key markets nationwide. Client more at .
We champion equality and inclusivity, proudly supporting an Equal Opportunity Employer policy. We welcome applicants regardless of Race, Color, Religion, Sex, Sexual Orientation, Gender Identity, National Origin, Age, Genetic Information, Disability, Protected Veteran Status, or any other status protected by law.