AWS Data Engineer Job Description Are you a passionate and skilled AWS Data Engineer with a focus on integrating industrial systems with cutting-edge cloud technologies? We are seeking a talented professional to join our team to help design, build, and maintain scalable data pipelines and cloud infrastructure. If you have experience with Databricks, Terraform, Kubernetes, and IoT, this opportunity is tailor-made for you! Join us in driving innovation and creating impactful solutions. Key Responsibilities: Pipeline Development & Integration: • Design, develop, and deploy data pipelines between cloud and industrial systems. • Use Kubernetes and Terraform to build scalable and fault-tolerant data workflows. • Integrate industrial systems using modern cloud technologies, ensuring efficient data exchange. Cloud Infrastructure Management: • Utilize AWS services like Lambda functions, S3 buckets, and Databricks to build, manage, and optimize data solutions. • Maintain and enhance Databricks deployments, ensuring scalability and performance. • Manage and automate infrastructure-as-code deployments with Terraform. IoT & Industrial Solutions: • Incorporate IoT data collection and processing into pipelines to enable industrial insights. • Collaborate with industrial engineers to streamline and secure integration with physical systems. Database Operations: • Design and maintain relational and non-relational databases as part of integrated solutions. • Perform database monitoring, optimization, and troubleshooting to ensure uptime and performance. Collaboration & Best Practices: • Work closely with software engineering, DevOps, and data science teams to deliver high-impact solutions. • Follow best practices in version control, CI/CD pipelines, and security compliance. Desired Skills & Requirements: Core Specializations: • Solid hands-on experience with AWS (Lambda, S3, Databricks, etc.). • Proficiency with Kubernetes for container orchestration and Terraform for infrastructure automation. • Strong understanding of creating, managing, and optimizing data pipelines in industrial environments. Programming Expertise: • Proficiency in Python, especially in using it for building Lambda functions and pipeline scripts. • Experience with API integration for data exchange between systems. Data Skills: • Knowledge of managing and querying databases (SQL and NoSQL technologies). • Exposure to big data environments and analytics tools. IoT (Preferred): • Experience integrating and managing IoT-enabled devices. • Processing IoT telemetry data and implementing monitoring mechanisms. Soft Skills: • Strong problem-solving skills and ability to work in cross-functional teams. • Excellent communication skills and ability to adapt to evolving business needs.