Sparkflow Framework - NC

Job#: 3025215 Job Description: Client: Financial Services Team: TBA Job Title: Sparkflow Framework - NC Location: Zone 2 Contract Length: 12mo Pay Rate: $69 - $74 Top Requirements: • 5+ years of Software Engineering experience, or equivalent via work, consulting, training, or military service. • Deep Apache Spark expertise (Scala and/or Java; Python a plus). • Proven experience building reusable frameworks/libraries, not just applications. • Strong capability in API design, abstraction design, modularity, extensibility. • Experience designing or implementing AI/ML/LLM-enabled developer tooling or framework enhancements. • Experience working in large-scale enterprise data environments. Plusses: • Experience integrating frameworks into control planes or internal developer platforms. • Familiarity with Spark SQL, metadata/lineage, audit/control governance. • Experience modernizing or replacing legacy ETL frameworks. • Strong working knowledge of enterprise data ecosystems (Hadoop/Hive, Kafka, S3, Iceberg, etc.). • Shell scripting, SQL performance optimization, data modeling. Job Summary: This contingent Software Engineer 4 role is a lead-level engineering position responsible for driving the evolution of SparkFlow, a large-scale enterprise data processing framework built on Apache Spark. The engineer will design modular abstractions, deliver new functional capabilities, improve developer experience, and lead AI‑enabled feature development to enhance framework usability and developer productivity. This role also leads the work to integrate SparkFlow into the Unity control plane, enabling consistent orchestration across environments. The engineer will collaborate extensively with data, platform, and infrastructure partners, providing technical leadership through architecture guidance, design reviews, and code review oversight. Day-to-Day Responsibilities: • Lead the architectural evolution of SparkFlow, focusing on clean, modular design and extensible abstractions. • Design and implement new framework features, supporting expanded use cases and advanced data-processing patterns. • Ensure framework quality through performance optimization, backward compatibility, governance, and reliability improvements. • Improve developer experience: • Simplify and modernize APIs, config patterns, extension points • Streamline onboarding and usability • Enhance diagnostics and observability • Build AI-driven capabilities that support config generation, validation, troubleshooting, and developer workflow acceleration. • Lead the Unity control plane integration: adapters, operators, orchestration workflows, automation, integration testing. • Provide senior technical leadership via design reviews, architecture sessions, engineering guidance, and code reviews. • Collaborate with enterprise data ecosystem partners (Kafka, Hive, S3, Iceberg, governance systems). • Support operational needs and promote adoption of SparkFlow across engineering groups. EEO Employer Apex Systems is an equal opportunity employer. We do not discriminate or allow discrimination on the basis of race, color, religion, creed, sex (including pregnancy, childbirth, breastfeeding, or related medical conditions), age, sexual orientation, gender identity, national origin, ancestry, citizenship, genetic information, registered domestic partner status, marital status, disability, status as a crime victim, protected veteran status, political affiliation, union membership, or any other characteristic protected by law. Apex will consider qualified applicants with criminal histories in a manner consistent with the requirements of applicable law. If you have visited our website in search of information on employment opportunities or to apply for a position, and you require an accommodation in using our website for a search or application, please contact our Employee Services Department at [email protected] or 844-463-6178. Apex Systems is a world-class IT services company that serves thousands of clients across the globe. When you join Apex, you become part of a team that values innovation, collaboration, and continuous learning. We offer quality career resources, training, certifications, development opportunities, and a comprehensive benefits package. Our commitment to excellence is reflected in many awards, including ClearlyRated's Best of Staffing® in Talent Satisfaction in the United States and Great Place to Work® in the United Kingdom and Mexico. Apex uses a virtual recruiter as part of the application process. Click here for more details. Apex Benefits Overview: Apex offers a range of supplemental benefits, including medical, dental, vision, life, disability, and other insurance plans that offer an optional layer of financial protection. We offer an ESPP (employee stock purchase program) and a 401K program which allows you to contribute typically within 30 days of starting, with a company match after 12 months of tenure. Apex also offers a HSA (Health Savings Account on the HDHP plan), a SupportLinc Employee Assistance Program (EAP) with up to 8 free counseling sessions, a corporate discount savings program and other discounts. In terms of professional development, Apex hosts an on-demand training program, provides access to certification prep and a library of technical and leadership courses/books/seminars once you have 6+ months of tenure, and certification discounts and other perks to associations that include CompTIA and IIBA. Apex has a dedicated customer service team for our Consultants that can address questions around benefits and other resources, as well as a certified Career Coach. You can access a full list of our benefits, programs, support teams and resources within our ‘Welcome Packet’ as well, which an Apex team member can provide. Apex Systems is a world-class IT services company that serves thousands of clients across the globe. When you join Apex, you become part of a team that values innovation, collaboration, and continuous learning. We offer quality career resources, training, certifications, development opportunities, and a comprehensive benefits package. Our commitment to excellence is reflected in many awards, including ClearlyRated's Best of Staffing® in Talent Satisfaction in the United States and Great Place to Work® in the United Kingdom and Mexico. Apex uses a virtual recruiter as part of the application process. Click here for more details. Apex Benefits Overview: Apex offers a range of supplemental benefits, including medical, dental, vision, life, disability, and other insurance plans that offer an optional layer of financial protection. We offer an ESPP (employee stock purchase program) and a 401K program which allows you to contribute typically within 30 days of starting, with a company match after 12 months of tenure. Apex also offers a HSA (Health Savings Account on the HDHP plan), a SupportLinc Employee Assistance Program (EAP) with up to 8 free counseling sessions, a corporate discount savings program and other discounts. In terms of professional development, Apex hosts an on-demand training program, provides access to certification prep and a library of technical and leadership courses/books/seminars once you have 6+ months of tenure, and certification discounts and other perks to associations that include CompTIA and IIBA. Apex has a dedicated customer service team for our Consultants that can address questions around benefits and other resources, as well as a certified Career Coach. You can access a full list of our benefits, programs, support teams and resources within our ‘Welcome Packet’ as well, which an Apex team member can provide. Apex Systems is part of the Commercial Segment of ASGN Incorporated. NYSE: ASGN 4400 Cox Road Suite 200 Glen Allen, Virginia 23060 Apex Systems is an equal opportunity employer. We do not discriminate or allow discrimination on the basis of race, color, religion, creed, sex (including pregnancy, childbirth, breastfeeding, or related medical conditions), age, sexual orientation, gender identity, national origin, ancestry, citizenship, genetic information, registered domestic partner status, marital status, disability, status as a crime victim, protected veteran status, political affiliation, union membership, or any other characteristic protected by law. Apex will consider qualified applicants with criminal histories in a manner consistent with the requirements of applicable law. If you have visited our website in search of information on employment opportunities or to apply for a position, and you require an accommodation in using our website for a search or application, please contact our Benefits Department at [email protected] or 804-523-8228. (Do not submit resumes or solicit consultants to this email address). UnitedHealthcare creates and publishes the Transparency in Coverage Machine-Readable Files on behalf of Apex Systems.