Senior Data Engineer

Title: Senior Data Engineer Location: New York, NY 10281 (Hybrid) Duration: Long-Term Contract (Possible Full-Time) Interview Process: 1–2 Rounds Overview: We are seeking a highly skilled Data Engineer with strong expertise in building data pipelines and integrating data from multiple sources. This role supports FP&A initiatives and IT spend tracking, leveraging tools like IBM Apptio. The ideal candidate is a self-starter who can work independently and deliver high-quality solutions in a fast-paced environment. Key Responsibilities: • Design and build ETL pipelines from scratch using Python. • Develop efficient, reusable, and maintainable code following OOP principles. • Perform advanced data modeling (schemas, entity relationships). • Write and optimize complex SQL queries across multiple dialects (SQL Server, DB2, Oracle). • Create and manage Airflow DAGs for workflow orchestration. • Ingest, cleanse, govern, and report data from data warehouses such as BigQuery and Databricks Delta Lakehouse. • Collaborate with stakeholders to integrate data from diverse sources. • Learn and adapt to new cloud-based business applications and tools. Must-Have Skills: • Python (ETL development, OOP concepts). • SQL (expert-level across multiple dialects). • Data Modeling (schemas, entity relationships). • Airflow (DAG development). • Data Warehousing (BigQuery, Databricks Delta Lakehouse). Nice-to-Have Skills: • Familiarity with Spark. • Prior experience with IBM Apptio. • Exposure to FP&A or IT financial tracking tools. Why This Role? • High-impact position in a fast-moving environment. • Opportunity to work on cutting-edge tools and technologies. • Potential for long-term engagement and full-time conversion.