Machine Learning Engineer

• • • At this time, we are unable to consider candidates requiring visa sponsorship or third-party recruitment agencies for this role. We thank you for your understanding. • • • Position Overview: We are seeking a skilled Machine Learning Engineer (Contractor) to support and maintain critical batch workflows that generate large-scale forecasts. These workflows are orchestrated through a custom in-house scheduling tool and leverage R, Python, Bash, and Spark on a YARN-managed on-premise cluster. Responsibilities • The engineer will be responsible for ensuring smooth daily operations, including monitoring, restarting, and troubleshooting jobs to minimize downtime and maintain system reliability. • Strong problem-solving skills and the ability to quickly diagnose issues across multiple technologies will be key in this role. • In addition to operations, the engineer will contribute development expertise by enhancing the functionality, stability, and performance of existing jobs. This will include submitting code changes in Python (PySpark), Bash, or Terraform to improve orchestration and infrastructure configurations. • The role also involves implementing observability metrics and monitoring solutions, using tools such as OTEL, Kibana, REST APIs, and custom instrumentation. • The ideal candidate will be comfortable collaborating via GitHub (PRs), proactive in identifying improvement opportunities, and effective at balancing operational support with development contributions. Technical Skills: • Proficiency with Python (PySpark), Bash, and working knowledge of R • Experience with Apache Spark on YARN-managed clusters (large-scale, on-premise environments preferred) • Familiarity with workflow orchestration tools (Airflow, Luigi, or custom equivalents) • Experience with Terraform (infrastructure-as-code) • Strong background in job monitoring and troubleshooting in distributed environments • Knowledge of observability/monitoring practices using OTEL, Kibana, REST APIs, and custom metrics instrumentation • Hands-on experience with GitHub workflows (pull requests, branching strategies, code reviews) Soft Skills: • Strong analytical and troubleshooting skills with attention to detail • Clear and effective communication, especially in cross-functional environments • Ability to prioritize operational stability while driving code improvements • Proactive mindset with a focus on reliability and continuous improvement • Collaborative attitude, able to work effectively with developers, data scientists, and operations staff Benefits: York Solutions Offers a generous benefits package for eligible full-time employees: • BCBS Medical with 3 Plans to choose from (PPO and High deductible PPO plans with Health Savings Program) • Delta Dental plan with 2 free cleanings and insurance discounts • Eye Med Vision with annual check-ups and discounts on lens • Life and Accidental Death Insurance paid by company • John Hancock 401(k) Retirement Plan with discretionary company match • Voluntary Insurance programs such as: Hospital Indemnity, Identity Protection, Legal Insurance, Long Term Care, and Pet Insurance. • Flexible work environment with some remote working opportunities • Strong fun and teamwork environment • Learning, development, and career growth