AI Technical Lead/Sr SW Engineer (Data + LLM)

AI Technical Lead/Sr SW Engineer (Data + LLM) Location: San Jose, CA (Hybrid) Employment Type: W2 Contract to Hire We're looking for an experienced Senior Software Engineer to join a high-impact engineering team building a scalable Infrastructure Telemetry & Capacity Planning Platform. You'll help design and develop end-to-end telemetry pipelines that collect, process, and analyze server and GPU utilization data, enabling intelligent capacity planning across large-scale cloud infrastructure. Key Responsibilities • Design and develop scalable telemetry ingestion and processing pipelines. • Build real-time streaming solutions using Kafka and/or Flink. • Develop distributed data processing applications using Apache Spark on AWS EMR. • Design scalable data storage solutions using DynamoDB, MongoDB, Trino, Parquet, and Lakehouse technologies. • Build cloud-native applications on AWS using Docker and Kubernetes. • Implement monitoring and observability using Prometheus and Grafana. • Participate in architecture discussions, code reviews, and CI/CD best practices. • Utilize AI-assisted development tools such as Cursor, Windsurf, or similar to improve engineering productivity. Required Qualifications • 10+ years of software development experience. • Strong programming experience in Java and/or Python. • Hands-on experience with Apache Spark and AWS EMR. • Experience building streaming data pipelines using Kafka and/or Flink. • Experience with DynamoDB, MongoDB, Trino, or Lakehouse technologies. • Strong knowledge of AWS, Docker, Kubernetes, and CI/CD pipelines. • Experience with telemetry, monitoring, and observability tools such as Prometheus and Grafana. • Strong analytical, debugging, and problem-solving skills. Preferred Qualifications • Experience with Infrastructure Telemetry or Capacity Planning platforms. • Knowledge of GPU utilization, server metrics, or large-scale infrastructure monitoring. • Experience building operational dashboards and visualization solutions. • Familiarity with Agile development and DevOps practices.