W2 only (No C2C or 3rd Parties) Looking for a Data Engineer - Human Behavior and Carbon Neutrality who is interested in the overlap between technology and the behavioral sciences to architect and optimize cloud-based infrastructure to support research objectives in the Carbon Neutrality Department of the Human-Centered AI Division. In this role, you will design, develop, and maintain end-to-end data pipelines in Databricks for processing/analyzing large-scale datasets, as well as build and optimize cloud-based infrastructure to support generative AI methods, ensuring scalability, reliability, and performance. We're looking for someone with a Bachelor's degree or higher in Computer Science, Engineering, or a related field, and 4+ years of experience designing, building, and maintaining data pipelines in a cloud environment, preferably using Databricks. As a Data Engineer - Human Behavior and Carbon Neutrality, you will: • Design, develop, and maintain end-to-end data pipelines in Databricks for processing/analyzing large-scale datasets. • Build and optimize cloud-based infrastructure to support generative AI methods, ensuring scalability, reliability, and performance. • Collaborate closely with research scientists, software developers, machine learning engineers, and domain experts to understand data requirements and design effective solutions. • Implement best practices for data quality, data integrity, and data security throughout the pipeline. • Incorporate multi-model data (e.g., vision, language, and time series) techniques into data pipelines to enable AI model development. • Monitor and troubleshoot data pipelines, identifying/resolving performance bottlenecks, and optimizing resource utilization. • Stay up-to-date with the latest advancements in cloud technologies, generative AI frameworks, and data engineering techniques. Requirements • Bachelor's or Master's degree in Computer Science, Engineering, or a related field • 4+ years of experience designing, building, and maintaining data pipelines in a cloud environment, preferably using Databricks • Strong proficiency in cloud technologies, especially AWS • A track record of working with human behavior data and the ability to derive actionable insights from such data is a plus • Expertise in SQL and Python • Experience building and maintaining live dashboards to monitor user behavior, product stability, and model performance • Strong problem-solving skills, attention to detail, and the ability to work effectively in a collaborative, cross-functional team environment • Excellent communication skills to convey complex technical concepts to both technical and non-technical stakeholders Bonus Qualifications: • Expertise in AI/ML frameworks like TensorFlow or PyTorch, with hands-on experience in deploying/optimizing deep learning models • Familiarity with AI model training and fine tuning techniques, including an understanding of the challenges associated with multi-modal data • Proficiency in additional languages such as R, Scala, or Java • Experience with containerization and orchestration tools like Docker and Kubernetes • Experience with NoSQL, Change Data Capture Techniques, and BI Tools Benefits: • PTO and paid holidays! • Pre-tax commuter benefits • Employer Subsidized healthcare benefits • Flexible Spending Account for healthcare-related costs • Employer covers all costs for short- and long-term disability and life insurance • 401k package