Machine Learning Engineer

Position: Machine Learning Engineer Location: Mountain View, CA Duration: 12+ Months Lab Summary The Developer Quality Innovation Lab builds the automation and tooling that powers data acquisition, safety, and evaluation for AI platform products. Our systems collect, curate, and augment data while developing intelligent solutions to protect foundation models and AI features deployed across mobile, cloud, and XR/AR platforms. We also operate evaluation pipelines that measure model quality before and after deployment. We work closely with modeling, platform, device, and product teams to close the loop from production signals and user feedback back into training data, enabling faster iteration and higher-quality AI systems. Position Summary We are looking for an experienced Machine Learning Engineer to lead the development of prompt injection and prompt safety models that protect downstream agentic AI systems across mobile, cloud, and XR/AR platforms. You will design, train, and deploy classifier and guardrail models (both cloud-based and hybrid on-device) that screen agent inputs and outputs for injection attacks, unsafe content, and policy violations. A core part of the role is post-training these models with RLHF, DPO, and related optimization techniques to push detection accuracy and false-positive rates beyond what off-the-shelf solutions provide. Role and Responsibilities • Design and train prompt injection detection models and prompt safety classifiers that operate on both inputs to and outputs from agentic AI systems. • Build hybrid deployment pipelines that split safety inference between on-device (mobile, XR/AR) and cloud, optimizing for latency, privacy, and detection coverage. • Apply post-training techniques (e.g., RLHF, reward modeling, policy optimization) to optimize guardrail model performance, calibration, and robustness against adaptive adversaries. • Curate and generate adversarial training data: direct and indirect prompt injections, jailbreaks, tool-use exploits, and unsafe-output cases drawn from red-teaming and production signals. • Build evaluation harnesses that measure attack success rate, false-positive rate, latency, and on-device footprint across model iterations and threat categories. • Partner with agent, device, and platform teams to integrate safety models into mobile-use agents, XR/AR assistants, and cloud agentic workflows, and to close the loop from production incidents back into training data. • Work cross-functionally with security researchers, modeling teams, and product engineers; document methods and, where appropriate, contribute to patents and publications. Required Qualifications • M.S. or Ph.D. in Computer Science, Machine Learning, Electrical Engineering, or a related field; or B.S. with equivalent industry experience. • 3+ years of industry experience in ML engineering or applied AI research, with demonstrated ownership of production ML systems post master's degree graduation. • 2+ years of industry experience in software engineering post master's degree graduation. • Strong proficiency in Python and PyTorch (or JAX/TensorFlow), with solid software engineering fundamentals (version control, testing, and reproducible experimentation). • Hands-on experience post-training LLMs with RLHF, DPO, RLAIF, or reward modeling, including reward design, preference data curation, and training stability. • Hands-on experience training and deploying classifier or guardrail models for safety, content moderation, abuse detection, or adversarial robustness. • Familiarity with prompt injection, jailbreak, and agentic AI threat models, and with distributed training frameworks (DeepSpeed, FSDP, Accelerate). Preferred Qualifications • Experience building safety or moderation systems for agentic AI: tool-use guardrails, indirect prompt injection defenses, or output filtering for autonomous agents. • Experience with red-teaming, adversarial data generation, or automated attack pipelines (e.g., GCG, PAIR, generator–critic frameworks). • Experience with on-device or edge ML deployment (ExecuTorch, Core ML, TFLite, MLC-LLM, vendor NPU toolchains) and model compression (quantization, distillation, pruning) for safety models. • Experience with telemetry, logging, or user-facing data systems on mobile, XR/AR, or consumer platforms, including privacy-preserving handling of user data (e.g., anonymization, on-device processing, federated approaches). • Publications at top-tier ML/NLP/Security venues (NeurIPS, ICML, ICLR, ACL, EMNLP, USENIX Security, IEEE S&P), patents, or open-source contributions in the safety, alignment, or AI security space. Education • M.S. in Computer Science, Machine Learning, Electrical Engineering, or a related field with 3 years of experience post-graduation. OR • Ph.D. in Computer Science, Machine Learning, Electrical Engineering, or a related field with publications in the AI/ML domain and 1 year of experience post-graduation. Equal Employment Opportunity Trilyon is an Equal Opportunity Employer, committed to fairness and respect for all individuals. We value diversity in age, disability, ethnicity, gender, gender identity, religion, and sexual orientation, believing it drives innovation and better service. Employment decisions are made impartially, without regard to any protected characteristic under federal, state, or local law. Our diverse team drives innovation, competitiveness, and creativity, enhancing our ability to effectively serve our clients and communities. This commitment to diversity makes us stronger and more adaptable.