Data Engineer

Senior Programmer / Senior Data Engineering Lead Role Overview We are seeking a Senior Programmer / Senior Data Engineering Lead to design, develop, and lead complex enterprise applications and data platforms. This role requires deep hands-on expertise across application development, database engineering, ETL/ELT pipelines, and data warehouse architecture, along with the ability to lead technical initiatives and mentor team members. The ideal candidate will work closely with business stakeholders, architects, and analytics teams to translate requirements into scalable, high-performance solutions that support enterprise reporting, analytics, and operational systems. Key Responsibilities Application & Systems Development • Lead the design, development, enhancement, and support of complex enterprise applications and data platforms. • Analyze business and technical requirements and translate them into scalable system and application architectures. • Design, develop, test, deploy, and maintain high-quality, secure, and performant application code. • Create and maintain technical documentation, data models, and system design artifacts. • Evaluate and recommend new tools, frameworks, and technologies to improve platform efficiency and scalability. Data Engineering & ETL/ELT • Design, build, and optimize scalable ETL/ELT pipelines using modern cloud and on-prem technologies. • Develop advanced SQL, PL/SQL, and T-SQL solutions including stored procedures, functions, and performance-tuned queries. • Build and maintain enterprise data warehouses and analytics-ready datasets. • Implement data ingestion and transformation workflows for structured and semi-structured data (CSV, JSON, XML, Parquet). • Integrate data from APIs, legacy platforms, and enterprise systems into centralized data platforms. Architecture & Performance Optimization • Design dimensional data models (star schema, snowflake, and hybrid models) optimized for analytics and reporting. • Optimize database and ETL performance using indexing, partitioning, caching, and pipeline tuning strategies. • Ensure high availability, scalability, reliability, and maintainability of data and application platforms. Leadership & Collaboration • Provide technical leadership and guidance to developers and data engineers. • Collaborate with business users, analysts, and product owners to define KPIs, datasets, and reporting requirements. • Support CI/CD pipelines and release processes across development, QA, and production environments. • Troubleshoot production issues, perform root cause analysis, and ensure operational SLAs are met. Security & Governance • Apply data security, governance, and compliance best practices, including access controls, encryption, and credential management. • Ensure solutions align with enterprise security standards and regulatory requirements. Required Skills & Expertise • Advanced expertise in SQL, PL/SQL, and T-SQL across Oracle, SQL Server, PostgreSQL, and MySQL • Strong experience with ETL/ELT platforms such as Azure Data Factory, Azure Synapse Analytics, and SSIS • Hands-on experience designing and managing enterprise data warehouses and data lakes • Proficiency in Python and PySpark for data processing and automation • Experience with big data technologies such as Apache Spark and distributed data processing frameworks • Strong knowledge of data modeling, data integration, data quality, and validation processes • Experience with CI/CD pipelines using Git, GitHub Actions, or Azure DevOps • Familiarity with BI and analytics platforms such as Power BI or Cognos • Strong communication skills with the ability to translate technical concepts to business stakeholders Experience Requirements • 7+ years of experience in application development, data engineering, or enterprise systems development • 4+ years in a technical lead or senior contributor role • Proven experience delivering and supporting large-scale, production-grade data and application solutions Education • Bachelor’s degree in Computer Science, Information Technology, Engineering, or a related field • Equivalent professional experience may be considered in lieu of formal education