Senior Data Engineer

We are excited to announce multiple openings for the position of Senior Data Engineer in NYC, NY\_Onsite Role . Please read further about the job profile: Role: Senior Data Engineer Locations: NYC, NY- Onsite Type: Contract- C2C/W2 Responsibilities: • Design, build, and optimize high-performance data pipelines for large-scale time series data • Implement scalable data infrastructure using tools such as KDB+, TimeSet (Google’s large time series database), or Kronos • Develop efficient data ingestion and transformation workflows that handle real-time and historical time series data • Connect time series data systems with Python-based model pipelines to support machine learning training and inference • Collaborate with data scientists and ML engineers to ensure data availability, quality, and accessibility for experimentation and production • Design data models and schemas optimized for time series use cases, including downsampling, aggregation, and indexing strategies • Ensure system reliability, scalability, and performance through monitoring, testing, and tuning • Establish data governance, lineage, and observability best practices in large-scale environments • Mentor junior engineers on large-scale data design, distributed processing, and real-time system architecture • Partner with product, engineering, and infrastructure teams to align data systems with business goals Requirements: • 10+ years of experience in data engineering, with a focus on large-scale and high-throughput systems • Deep experience working with time series data and purpose-built storage systems (e.g., KDB+, TimeSet, Kronos) • Strong experience building streaming and batch data pipelines using tools like Kafka, Flink, or Spark • Proficiency in Python and integrating data pipelines with machine learning workflows and libraries (e.g., pandas, NumPy, scikit-learn, PyTorch) • Experience designing efficient, scalable data models and partitioning strategies for time series data • Knowledge of distributed systems, columnar databases, and parallel processing • Familiarity with cloud-native data architectures (AWS, GCP, or Azure) and containerized data infrastructure • Strong understanding of data quality, lineage, monitoring, and observability tools • Excellent communication skills and a proactive, consultative mindset in client-facing environments • Bonus: Experience with multiple time series systems (e.g., KDB+ and Kronos) or contributing to open-source data infrastructure projects If you are interested, email your resume to vigneshr@tridentconsultinginc.com Trident Consulting is a premier IT staffing firm providing high-impact workforce solutions to Fortune 500 and mid-market clients. Since 2005, we've specialized in sourcing elite technology and engineering talent for contract, direct hire, and managed services roles. Our expertise spans cloud, AI/ML, cybersecurity, and data analytics, supported by a 3M+ candidate database and a 78% fill ratio. With a highly engaged leadership team and a reputation for delivering hard-to-fill, niche talent, we help organizations build agile, high-performing teams that drive innovation and business success. Learn more: tridentconsultinginc.com . Some of our recent awards include: Ranked as the #1 Women Owned Business Enterprise in the large category by ITServe. Received the TechServe Excellence award. Consistently ranked in the Inc. 5000 list of fastest-growing private companies in America Recognized in the SF Business Times as one of the Largest Bay Area BIPOC/Minority-Owned Businesses in 2022.