Data Engineer

Data Engineer 12 Months Contract Mountain View, CA ONLY LOCAL CONSULTANTS- NEED DL COPY About the Role We're hiring an exceptional Senior Data Engineer with deep data engineering expertise and strong, hands-on AI skills. You'll build scalable data infrastructure across ingestion, transformation, orchestration, and delivery — collaborating with backend, BI, and ML teams — while actively using AI tooling (Claude, Cursor, and beyond) as a core part of how you engineer and ship. Strong ownership mindset, data quality focus, on-call reliability, and a genuine drive to adopt modern AI tooling are a must. Responsibilities • Design, build, and maintain scalable data ingestion and processing pipelines using SQL , Spark, Hadoop, Airflow, SnapLogic, or similar tools • Optimize existing ETL/ELT workflows and resolve bottlenecks in production jobs • Integrate multiple structured and unstructured data sources from internal and external systems • Design and implement event-driven data pipelines using event bus architectures (Kafka, AWS EventBridge, SNS/SQS, or similar) • Build and maintain event producers, consumers, and stream processors for real-time and near-real-time data flows • Manage event schema design, schema registry, and versioning to ensure backward compatibility across consumers • Monitor event bus health, lag, throughput, and reliability; respond to failures before SLA breach • Implement and manage CI/CD pipelines for data workflows using Git, Jenkins, or GitHub Actions • Ensure robust job scheduling, monitoring, logging, and end-to-end testing of data pipelines • Debug and resolve production issues before SLA breach; participate in on-call rotation • Collaborate with backend and BI teams for API and data integration • Design and develop schema definitions; support data warehouse/mart to integrate disparate data sources and make them available for analysis • Support large data volumes and flexible provisioning of new data sources • Contribute to data architecture design across the data landscape • Write clean, reusable, well-tested Python and Shell code across the full software development lifecycle • Gather functional requirements, develop technical specifications, and own project and test planning • Work in Agile/Scrum environments; help align team priorities across the organization • Leverage AI-assisted dev tools (Claude, Cursor .. etc) to accelerate delivery and code quality Required Skills • Strong Python, Advanced SQL, PySpark or Scala, Unix scripting If interested, Kindly reply to Email- jnehru@nam-it.com with the following details • Visa Status • Current Location • Expected hourly rate • Resume