Data Engineer

Job Summary We are looking for a Data Engineer with 4+ years of experience and strong exposure to AI/ML systems. The ideal candidate will be responsible for building scalable data pipelines, enabling machine learning workflows, and supporting AI-driven applications. You will work closely with data scientists, ML engineers, and product teams to ensure reliable and efficient data infrastructure. Key Responsibilities • Design, build, and maintain scalable data pipelines for structured and unstructured data. • Develop and optimize ETL/ELT processes for data ingestion, transformation, and loading. • Support AI/ML use cases by preparing high-quality datasets for training and inference. • Work with ML engineers to deploy and monitor machine learning models in production. • Build and manage data lakes, warehouses, and real-time data streaming systems. • Ensure data quality, governance, and security best practices. • Optimize data processing performance using distributed computing frameworks. • Collaborate with cross-functional teams to deliver data-driven solutions. Required Skills & Qualifications • 4+ years of experience in Data Engineering or related roles. • Strong programming skills in Python, Scala, or Java. • Hands-on experience with SQL and database systems (PostgreSQL, MySQL, etc.). • Experience with big data technologies such as Apache Spark, Hadoop, or Kafka. • Familiarity with cloud platforms such as AWS, Azure, or GCP. • Understanding of data modeling, data warehousing, and ETL concepts. • Exposure to AI/ML workflows, including feature engineering and model data pipelines. • Experience working with APIs and microservices. AI/ML-Specific Requirements • Experience supporting machine learning pipelines and workflows. • Understanding of feature stores, model training data preparation, and inference pipelines. • Familiarity with tools such as MLflow, Airflow, or Kubeflow. • Knowledge of vector databases and Retrieval-Augmented Generation (RAG) is a plus. Good to Have • Experience with Generative AI and LLM-based applications. • Knowledge of containerization tools like Docker and orchestration tools like Kubernetes. • Experience with real-time streaming pipelines. • Familiarity with data governance and compliance standards (e.g., GDPR, HIPAA). Soft Skills • Strong problem-solving and analytical skills. • Excellent communication and collaboration abilities. • Ability to work in a fast-paced and agile environment. • Ownership mindset with attention to detail. Apply Here :- https://freelancer.expertshub.ai/auth/sign-up?marketingCode=EXPMRJEN002