Data Engineer

Top Requirements: 1. Masters Degree in Relevant field 2. 5+ years of experience in the automotive industry, particularly in auto remarketing and sales3. Familiarity with machine learning libraries such as Tensorflow, Pytorch or Scikit learn4. Experience required with GCP CLoud RUn, Kubernetes, Spark, Sonarqube, GCP, Tekton, Python, API, JIRA. Hacker Assessment is NOT REQUIRED for this Position Position Description:Employees in this job function are responsible for designing, building, and maintaining data solutions including analytics and data infrastructure, pipelines, etc. for collecting, storing, processing and analyzing large volumes of data efficiently and accuratelyKey Responsibilities:1) Collaborate with business and technology stakeholders to understand current and future data requirements2) Design, build and maintain reliable, efficient and scalable data infrastructure for analytics models, data collection, storage, transformation, and monitoring3) Plan, design, build and maintain scalable data solutions including data pipelines, data models, and applications for efficient and reliable workflow4) Design, implement and maintain existing and future data platforms like data warehouses, data lakes, data lakehouse etc. for structured and unstructured data5) Design and develop analytical tools, algorithms, and programs to support data engineering activities like writing scripts and automating tasks6) Ensure optimum performance and identify improvement opportunitiesWe are seeking an experienced Data Engineer to design, implement, and maintain robust analytics pipeline solutions. These solutions will support the analysis, modeling, and prediction of upstream and downstream auction prices, directly benefiting the Business and Sales Planning Analytics (BSPA) Used Vehicle Analytics team and its customers. The ideal candidate will excel at developing solutions, maintaining DevSecOps, and collaborating with cross-functional teams to improve processes and drive business performance.Responsibilities: Develop, build and maintain infrastructure required for analytics, including data pipelines, model deployment platforms, and model monitoring. Develop and maintain tools and libraries to support the development and deployment of models. Automate machine learning workflows using DevSecOps principles and practices. Collaborate with development and operations teams to implement software solutions that improve system integration and automation of analytic pipelines. Design, develop, and manage data flows and APIs between upstream systems and applications. Troubleshoot and resolve issues related to system communication, data flow, and data quality. Collaborate with technical and non-technical teams to gather integration requirements and ensure successful deployment of data solutions. Create and maintain comprehensive technical documentation of software components. Work with IT to ensure systems meet evolving business needs and comply with data governance policies and security requirements. Implement and enforce the highest standards of data quality and integrity across all data processes. Manage deliverables through project management tools. Skills Required:GCP Cloud Run, Kubernetes, Spark, SonarQube, GCP, Google Cloud Platform, Tekton, Python, API, Jira Manage deliverables through project management tools. Experience Required:Engineer 2 Exp: 4+ years Data Engineering work experience AWSExperience Preferred:Education Required:Bachelor's DegreeEducation Preferred:Master's Degree 5+ years of experience in the automotive industry, particularly in auto remarketing and sales. Master's degree in a relevant field (e.g., Computer Science, Data Science, Engineering). Proven ability to thrive in dynamic environments, managing multiple priorities and delivering high-impact results even with limited information. Exceptional problem-solving skills, a proactive and strategic mindset, and a passion for technical excellence and innovation in data engineering. Demonstrated commitment to continuous learning and professional development. Familiarity with machine learning libraries, such as TensorFlow, PyTorch, or Scikit-learn Experience with MLOps tools and platforms. Job Type: Contract Pay: $50.00 - $70.00 per hour Work Location: On the road