Dice is the leading career destination for tech experts at every stage of their careers. Our client, Smart Caliber Technology, is seeking the following. Apply via Dice today! Job Title: Senior Python Engineer - Data Ingestion & Databricks Location: Remote / Hybrid Duration: Contract to Hire Looking for a candidate currently in MN Hybrid Would consider someone from South Dakota, North Dakota, Iowa and WI for remote work. About The Role • We are seeking a strong Python engineer with a passion for clean, scalable code and a mindset rooted in metadata-driven architecture. This role is ideal for someone who thrives in a collaborative environment, enjoys setting engineering standards, and has hands-on experience with Databricks and Delta Lake, preferably in an Azure ecosystem. • You'll work closely with technical leads to shape the development culture, contribute to architectural decisions, and help build robust, reusable Python libraries that power our data platform. Key Responsibilities • Design, develop, and maintain Python libraries with a focus on packaging, distribution, and reusability. • Champion metadata-driven development practices to build flexible and scalable systems. • Collaborate with team leads to define and enforce coding standards, including code reviews and documentation. • Implement and maintain CI/CD pipelines with tools like linters, type checkers (e.g., mypy), and automated testing frameworks (e.g., pytest). • Develop and optimize data workflows on Databricks, leveraging Data Lake and best practices for performance and scalability. • Communicate technical decisions clearly and confidently to both technical and non-technical stakeholders. • Mentor junior engineers and contribute to a culture of continuous improvement. Required Qualifications • Proven experience in packaging and distributing Python libraries (e.g., setuptools, poetry, pip, uv). • Strong understanding of metadata-driven architecture and its application in software or data systems. • Familiarity with CI/CD practices in Python projects, including automated testing, linting, and type checking. • Experience with Github and Github Actions for CI/CD. • Hands-on experience with Databricks and Delta Lake, ideally within an Azure environment. • Excellent communication skills with the ability to explain and justify technical decisions. • A collaborative, opinionated mindset with a drive to lead by example. • Understanding of Scrum and Agile methodologies. Nice to Have • Experience with data ingestion frameworks or data pipeline orchestration tools (e.g. Airflow). • Familiarity with containers (Docker, Kubernetes, Helm) • CI/CD build and deploy architecture (Tekton/Argo) • Familiarity with infrastructure-as-code (e.g. Terraform). • Experience with managing Databricks infrastructure-as-code (clusters, policies, etc.) • Contributions to open-source Python projects or internal tooling libraries. Best Regards, Chetna • D • Fax Truth Lies in Heart