Data Engineer - Human Behavior and Carbon Neutrality

Expected compensation: 79.95 USD Per Hour HireArt is helping TRI hire a Data Engineer - Human Behavior and Carbon Neutrality who is interested in the overlap between technology and the behavioral sciences to architect and optimize cloud-based infrastructure to support research objectives in the Carbon Neutrality Department of the Human-Centered AI Division. In this role, you will design, develop, and maintain end-to-end data pipelines in Databricks for processing/analyzing large-scale datasets, as well as build and optimize cloud-based infrastructure to support generative AI methods, ensuring scalability, reliability, and performance. We're looking for someone with a Bachelor's degree or higher in Computer Science, Engineering, or a related field, and 4+ years of experience designing, building, and maintaining data pipelines in a cloud environment, preferably using Databricks. As a Data Engineer - Human Behavior and Carbon Neutrality, you will: • Design, develop, and maintain end-to-end data pipelines in Databricks for processing/analyzing large-scale datasets. • Build and optimize cloud-based infrastructure to support generative AI methods, ensuring scalability, reliability, and performance. • Collaborate closely with research scientists, software developers, machine learning engineers, and domain experts to understand data requirements and design effective solutions. • Implement best practices for data quality, data integrity, and data security throughout the pipeline. • Incorporate multi-model data (e.g., vision, language, and time series) techniques into data pipelines to enable AI model development. • Monitor and troubleshoot data pipelines, identifying/resolving performance bottlenecks, and optimizing resource utilization. • Stay up-to-date with the latest advancements in cloud technologies, generative AI frameworks, and data engineering techniques. Requirements • Bachelor's or Master's degree in Computer Science, Engineering, or a related field • 4+ years of experience designing, building, and maintaining data pipelines in a cloud environment, preferably using Databricks • Strong proficiency in cloud technologies, especially AWS • A track record of working with human behavior data and the ability to derive actionable insights from such data is a plus • Expertise in SQL and Python • Experience building and maintaining live dashboards to monitor user behavior, product stability, and model performance • Strong problem-solving skills, attention to detail, and the ability to work effectively in a collaborative, cross-functional team environment • Excellent communication skills to convey complex technical concepts to both technical and non-technical stakeholders Bonus Qualifications • Expertise in AI/ML frameworks like TensorFlow or PyTorch, with hands-on experience in deploying/optimizing deep learning models • Familiarity with AI model training and fine tuning techniques, including an understanding of the challenges associated with multi-modal data • Proficiency in additional languages such as R, Scala, or Java • Experience with containerization and orchestration tools like Docker and Kubernetes • Experience with NoSQL, Change Data Capture Techniques, and BI Tools Benefits • PTO and paid holidays! • Pre-tax commuter benefits • Employer (HireArt) Subsidized healthcare benefits • Flexible Spending Account for healthcare-related costs • HireArt covers all costs for short- and long-term disability and life insurance • 401k package Commitment: This is a full-time, 9-month contract position staffed via HireArt. This position will be remote with preference given to candidates based in the Bay Area who are open to working onsite in Los Altos, CA. HireArt values diversity and is an Equal Opportunity Employer. We are interested in every qualified candidate who is eligible to work in the United States. Unfortunately, we are not able to sponsor visas or employ corp-to-corp.