Data Engineer

Cloud Data Engineer Charlotte, NC (3 days/week) Financial Client 12 Months Job Description: Seeking a Cloud Data Engineer skilled in Python, PySpark, SQL, and enterprise-level data warehousing. Must collaborate effectively with business users and possess business analyst expertise. Major Responsibilities: • Build and optimize data pipelines ensuring quality and integrity. • Design, develop, and deploy Spark programs in Databricks for large-scale data processing. • Work with Delta Lake, DWH, data integration, cloud platforms, and data modeling. • Develop programs in Python and SQL; write complex queries and stored procedures. • Implement dimensional data modeling and work with event-based/streaming data ingestion. • Handle structured, semi-structured, and unstructured data. • Optimize and troubleshoot Databricks jobs for performance and scalability. • Apply best practices for data management, security, and governance in Databricks. • Design and develop enterprise data warehouse solutions. • Conduct code reviews to ensure standards and efficiency. Skills: • 5+ years Python coding and SQL Server development with large datasets. • 5+ years experience building and deploying ETL pipelines with Databricks PySpark. • Experience with cloud data warehouses (Synapse, BigQuery, Redshift, Snowflake). • Strong background in OLTP, OLAP, dimensional modeling, and data warehousing. • Led enterprise-wide Cloud Data Platform migrations; strong architecture/design skills. • Familiarity with cloud data architectures, messaging, and analytics. • Cloud certification(s) required. • Airflow experience a plus. Education: Minimum BA in engineering/computer science; Master’s preferred.