BayOne Solutions
AI Technical Lead/Sr SW Engineer (Data + LLM)
β - Featured Role | Apply direct with Data Freelance Hub
This role is for an AI Technical Lead/Sr SW Engineer (Data + LLM) in San Jose, CA (Hybrid) on a W2 Contract to Hire basis, offering competitive pay. Requires 10+ years in software development, strong Java/Python skills, and experience with Apache Spark, AWS, Kafka, and telemetry tools.
π - Country
United States
π± - Currency
$ USD
-
π° - Day rate
640
-
ποΈ - Date
July 18, 2026
π - Duration
Unknown
-
ποΈ - Location
Hybrid
-
π - Contract
W2 Contractor
-
π - Security
Unknown
-
π - Location detailed
San Jose, CA
-
π§ - Skills detailed
#Visualization #DynamoDB #Docker #Data Storage #MongoDB #Trino #AWS EMR (Amazon Elastic MapReduce) #Agile #Data Pipeline #AI (Artificial Intelligence) #Storage #Scala #AWS (Amazon Web Services) #Monitoring #Data Processing #Python #Grafana #Apache Spark #Debugging #Code Reviews #Kubernetes #Kafka (Apache Kafka) #Java #Cloud #Observability #DevOps #Programming #Prometheus #Spark (Apache Spark)
Role description
AI Technical Lead/Sr SW Engineer (Data + LLM)
Location: San Jose, CA (Hybrid)
Employment Type: W2 Contract to Hire
We're looking for an experienced Senior Software Engineer to join a high-impact engineering team building a scalable Infrastructure Telemetry & Capacity Planning Platform. You'll help design and develop end-to-end telemetry pipelines that collect, process, and analyze server and GPU utilization data, enabling intelligent capacity planning across large-scale cloud infrastructure.
Key Responsibilities
β’ Design and develop scalable telemetry ingestion and processing pipelines.
β’ Build real-time streaming solutions using Kafka and/or Flink.
β’ Develop distributed data processing applications using Apache Spark on AWS EMR.
β’ Design scalable data storage solutions using DynamoDB, MongoDB, Trino, Parquet, and Lakehouse technologies.
β’ Build cloud-native applications on AWS using Docker and Kubernetes.
β’ Implement monitoring and observability using Prometheus and Grafana.
β’ Participate in architecture discussions, code reviews, and CI/CD best practices.
β’ Utilize AI-assisted development tools such as Cursor, Windsurf, or similar to improve engineering productivity.
Required Qualifications
β’ 10+ years of software development experience.
β’ Strong programming experience in Java and/or Python.
β’ Hands-on experience with Apache Spark and AWS EMR.
β’ Experience building streaming data pipelines using Kafka and/or Flink.
β’ Experience with DynamoDB, MongoDB, Trino, or Lakehouse technologies.
β’ Strong knowledge of AWS, Docker, Kubernetes, and CI/CD pipelines.
β’ Experience with telemetry, monitoring, and observability tools such as Prometheus and Grafana.
β’ Strong analytical, debugging, and problem-solving skills.
Preferred Qualifications
β’ Experience with Infrastructure Telemetry or Capacity Planning platforms.
β’ Knowledge of GPU utilization, server metrics, or large-scale infrastructure monitoring.
β’ Experience building operational dashboards and visualization solutions.
β’ Familiarity with Agile development and DevOps practices.
AI Technical Lead/Sr SW Engineer (Data + LLM)
Location: San Jose, CA (Hybrid)
Employment Type: W2 Contract to Hire
We're looking for an experienced Senior Software Engineer to join a high-impact engineering team building a scalable Infrastructure Telemetry & Capacity Planning Platform. You'll help design and develop end-to-end telemetry pipelines that collect, process, and analyze server and GPU utilization data, enabling intelligent capacity planning across large-scale cloud infrastructure.
Key Responsibilities
β’ Design and develop scalable telemetry ingestion and processing pipelines.
β’ Build real-time streaming solutions using Kafka and/or Flink.
β’ Develop distributed data processing applications using Apache Spark on AWS EMR.
β’ Design scalable data storage solutions using DynamoDB, MongoDB, Trino, Parquet, and Lakehouse technologies.
β’ Build cloud-native applications on AWS using Docker and Kubernetes.
β’ Implement monitoring and observability using Prometheus and Grafana.
β’ Participate in architecture discussions, code reviews, and CI/CD best practices.
β’ Utilize AI-assisted development tools such as Cursor, Windsurf, or similar to improve engineering productivity.
Required Qualifications
β’ 10+ years of software development experience.
β’ Strong programming experience in Java and/or Python.
β’ Hands-on experience with Apache Spark and AWS EMR.
β’ Experience building streaming data pipelines using Kafka and/or Flink.
β’ Experience with DynamoDB, MongoDB, Trino, or Lakehouse technologies.
β’ Strong knowledge of AWS, Docker, Kubernetes, and CI/CD pipelines.
β’ Experience with telemetry, monitoring, and observability tools such as Prometheus and Grafana.
β’ Strong analytical, debugging, and problem-solving skills.
Preferred Qualifications
β’ Experience with Infrastructure Telemetry or Capacity Planning platforms.
β’ Knowledge of GPU utilization, server metrics, or large-scale infrastructure monitoring.
β’ Experience building operational dashboards and visualization solutions.
β’ Familiarity with Agile development and DevOps practices.
