Senior Data Engineer (PySpark, Python, Databricks) ($60/hr)

We are seeking a talented Senior Data Engineer to join our data engineering team and help design, build, and optimize scalable data solutions. The ideal candidate will have strong expertise in Azure cloud services, Databricks, PySpark, and SQL, along with experience in data modeling and modern data architectures. This role will play a key part in building config-driven data pipelines, enabling analytics, and supporting enterprise-wide data initiatives. Key Responsibilities • Design, develop, and maintain data pipelines using Azure Data Factory, Databricks Workflows, PySpark, and Python. • Build and optimize SQL-based transformations to support enterprise data solutions. • Implement config-driven pipelines to improve scalability, reusability, and maintainability. • Develop and maintain data models, including Star Schema and Snowflake Schema. • Work with open table formats such as Delta Lake and Apache Iceberg. • Partner with stakeholders to understand requirements and translate them into scalable technical solutions. • Leverage Azure cloud technologies (preferred) to build modern, cloud-native data architectures. • Collaborate with cross-functional teams to ensure data quality, consistency, and performance. Must-Have Skills • Hands-on experience with Azure Data Factory, Databricks, PySpark, and Python. • Strong SQL expertise in building queries, transformations, and optimizations. • Solid understanding of data modeling (Star Schema, Snowflake Schema). • Knowledge of Delta Lake and/or Apache Iceberg for data lakehouse solutions. • Familiarity with cloud data platforms (Azure preferred). Nice-to-Have Skills • Experience with Snowflake or other modern cloud data warehouses. • Exposure to CI/CD, version control, and DevOps practices. Qualifications • 5+ years of professional experience in data engineering (will consider 3+ years with a Computer Science degree). • Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field. • Strong problem-solving skills and attention to detail. • Excellent communication skills and ability to work in collaborative teams.