Data Engineer

Job Description: (NO C2C OR C2H) Job Title: AI Data Engineer Contract on w2 Location: 100% remote, PST preferred Duration: 12 - 18 months Typical Day in the Role • Purpose of the Team: This team is part of the Devices Operations group within E+D (Engineering and Devices). This is the Digital Transformation and Services (DTS) team responsible for all engineering work related to device data. This includes managing the data platform, data engineering, and extending to AI and Copilot integration with data interfaces. They handle the entire lifecycle of MS-manufactured devices and provide insights to end users. • Key projects: outlined in the job description • Typical task breakdown and operating rhythm: The role will consist of 70% execution on tasks, 30% meetings, and ad hoc calls Compelling Story & Candidate Value Proposition • What makes this role interesting? - This role provides the opportunity to be part of the development of the Vnext platform for data engineering and integration with new Copilot agents. • Unique Selling Points: They will be working with the latest and greatest MS Copilot data engineering technology. • Degrees or certifications required: Nice to have Bachelor’s degree in computer science, Engineering, or a related field, OR Master's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field, OR equivalent experience. • Disqualifiers: N/A • Best vs. Average: The ideal resume would contain familiarity with big data technologies (e.g., Hadoop, Spark), experience in programming languages like Scala and Java • Performance Indicators: Performance will be assessed based on biweekly sprint execution, monitoring the deliverables and timelines agreed upon for each sprint. Top 3 Hard Skills Required + Years of Experience 1. Minimum 5+ years experience with building data pipelines and data stores. 1. Minimum 5+ years experience with proficiency in MS Fabric technology 1. Minimum 5+ years experience with proficiency in programming languages such as Python 1. Minimum 5+ years experience with strong experience in SQL and database technologies Summary: The main function of an AI Data Engineer is to construct and maintain data pipelines, ETL processes, and data storage systems to facilitate efficient data collection, processing, and analysis. They ensure data quality and accessibility for data-driven decision-making, collaborating closely with data scientists and analysts. Job Responsibilities: • As a Data Engineer in MDO, you will drive critical initiatives to help our data platform scale to the needs of business priorities and technology advancements • Build scalable data models and data pipelines to extract, load, and transform data, ensure secure data storage, with a focus on data quality and compliance on Azure using services (ADF, HDI, Databricks, Synapse/Fabric, etc.) • You will play a critical role in developing and building datasets and integrating with AI/ML and Co-Pilot applications • Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions • Implement and manage CI/CD(YAML + Classic) pipelines for data engineering projects, leveraging tools like Azure DevOps • You will anticipate data governance needs, designing data modeling and handling procedures to ensure compliance with all applicable laws and policies. You’ll also govern data accessibility within your assigned pipelines. • Acts as a Designated Responsible Individual (DRI) and guides other engineers by developing and following the playbook, working on call to monitor system/product/service for degradation, downtime, or interruptions, alerting stakeholders about status and initiates actions to restore system/product/service for simple and complex problems when appropriate. Qualifications: • Bachelor’s degree in computer science, Engineering, or a related field • OR master's degree in computer science, Math, Software Engineering, Computer Engineering, or related field • OR equivalent experience • Experience with building data pipelines and data stores. • 5+ years of experience in data engineering or a similar role. • Proficiency in programming languages such as Python, Scala, or Java. • Strong experience with SQL and database technologies • Familiarity with big data technologies (e.g., Hadoop, Spark). Please let me know if this is something you would love to do and help me with your updated resume. Feel free to reach me out at harshiv@ifgpr.com if you have any questions. Thanks