Technical Lead

Role : Tech Lead (Python + Databricks + Streamlit) Location : Iselin, NJ (Hybrid) Contract / Fulltime Position Summary We are looking for a Tech Lead with strong hands-on expertise in Python and Databricks, along with exposure to Streamlit (optional) for data-driven application development. The ideal candidate will lead technical design, architecture, and delivery of scalable data and application platforms while mentoring development teams and driving engineering best practices. Key Responsibilities • Lead and mentor a team of developers and data engineers across the full software development lifecycle. • Design and develop scalable backend solutions, APIs, and data processing frameworks using Python. • Proficient in creating HLD, LLD, and detailed design documentation using visual artifacts. • Build and optimize enterprise-grade data pipelines using Databricks, PySpark, and Spark SQL. • Good understanding of Medallion Architecture, Data Quality rules, exception handling/correction processes, and reprocessing of correction DAGs. • Collaborate with Business analysts, technical and business stakeholders to translate requirements into technical solutions. • Drive code quality through design reviews, best practices, testing, and CI/CD implementation. • Ensure application reliability, scalability, security, and performance in cloud environments. • Support DevOps processes, deployment automation, monitoring, and production support. Required Skills & Experience • 10–12+ years of experience in software development and data engineering. • Strong hands-on experience in Python • Extensive experience with Databricks, PySpark, • Good to have understanding of Streamlit or other modern UI frameworks for data applications à Optional • Experience building scalable ETL/ELT pipelines and distributed systems. • Strong knowledge of Azure (preferred) or AWS cloud platforms. • Experience with Git, CI/CD pipelines, Docker, and containerized deployments. • Proficiency in SQL and database technologies (PostgreSQL, MySQL, MongoDB, CosmosDB, etc.). • Strong problem-solving, leadership, and stakeholder management skills. Preferred Qualifications • Experience in Data Quality, Exception Handling, Metadata Management, Data Governance solutions. • Exposure to Agile/Scrum delivery models. • Experience leading teams in enterprise-scale data platform implementations.