Senior Data Engineer

• Job Title: Senior Data Engineer • Location: Houston, TX (On Site) • Employment Type: Contract • Experience: 12+ years Job Summary We are looking for an experienced Senior Data Engineer with 12+ years of experience to design, develop, and optimize large-scale data pipelines and solutions. The ideal candidate will have extensive experience in building robust data systems, expertise in Databricks Unity Catalog and data modeling, mentoring junior engineers, and collaborating with cross-functional teams to enable data-driven decision-making. Key Responsibilities • Design, build, and maintain scalable, efficient, and secure data pipelines and ETL processes. • Architect, implement, and optimize data lake and data warehouse solutions. • Implement and manage data governance, security, and access control using Databricks Unity Catalog. • Collaborate with data scientists, analysts, and business stakeholders to deliver high-quality datasets and reporting solutions. • Ensure data quality, reliability, and security across systems. • Evaluate and implement new tools, technologies, and best practices for data engineering. • Troubleshoot and resolve issues related to data workflows, performance, and availability. • Mentor and guide junior data engineers, promoting a culture of excellence and continuous improvement. • Document data flows, system architectures, and operational procedures. Required Qualifications • Bachelor’s or Master’s degree in Computer Science, Information Technology, or related field. • 12+ years of experience in data engineering or related roles. • Strong proficiency in SQL and programming languages such as Python, Java, or Scala. • Hands-on experience with big data technologies (e.g., Hadoop, Spark, Hive, Kafka). • Expertise with cloud platforms (AWS, Azure, GCP) and their data services (e.g., Redshift, BigQuery, Snowflake, Databricks). • Proven experience with Databricks Unity Catalog for data governance, cataloging, and security. • Strong expertise in data modeling, including conceptual, logical, and physical modeling. • Strong understanding of ETL/ELT frameworks and data warehousing concepts. • Knowledge of workflow orchestration tools (e.g., Airflow, Luigi). • Familiarity with DevOps practices, CI/CD pipelines, and version control (Git). • Excellent problem-solving, analytical, and communication skills.