Reinforcement Learning Engineer (6-month Contract)

About us • Our mission is to build the world’s first labor agency that deploys dexterous robots as its primary workforce. • You’ll be joining a team of extremely hardcore and self-motivated engineers, scientists, and operators who focus on winning 24/7. • You will develop and own entire systems from design to deployment, playing a foundational role in deploying 5000+ robots by 2031. What you'll do • Design and develop robot autonomy software stack and algorithms to enable capabilities including grasping and more dexterous behaviors in unstructured environments • Setup a simulation environment to train/test various reinforcement learning policies • Research and implement state-of-the-art reinforcement learning policies • Optimize robot policies for distributed training at scale and real-time edge deployment • Ship production quality, safety-critical software Responsibilities • Design overall architecture from data engineering, model architecture to shipping production ready automony software stack • Train reinforcement learning policy to do manipulation tasks. • Close the sim2real gap between policies trained in simulation and real. • Work with autonomy, system teams to ship RL policies to the production fleet. • 3+ years of Python programming experience. • Strong abilities to identify root cause of the performance bottlenecks in RL training. • Experience with tuning reward models, hyperparameters and exploration strategies to solve complex tasks in deep RL. Required Qualifications • Master's degree in Computer Science, Machine Learning, Robotics, or equivalent technical discipline • Have trained real-world robotics arms with RL • Deep expertise in machine learning fundamentals, reinforcement learning, and associated frameworks (PyTorch, TensorFlow, Ray, etc.) • Proven track record developing and deploying ML systems from research through production implementation • Hands-on experience with model lifecycle management including training, deployment, and maintenance in production settings Nice to have • Published RL research in top ML conferences (NeurIPS, CoRL, RSS, ICML, etc.) • Robotics and control theory knowledge Benefits • Medical, dental & vision plans • Daily meals stipend Expected Compensation • $120,000 - $180,000 per year + benefits • This is a 6-month contract role with the opportunity for conversion to a full-time position upon successful completion of the contract and business needs. Hiring process • phone screen + 3-4 technical interviews + onsite