Senior Data Engineer (Security & Controls) - W2 Only

Job Title: Senior Data Engineer (Security & Controls) Position Type: Contract Location: Remote (EST time zone) Work Authorization: W2 Independent or H1B transfer only (No C2C, No Visa Sponsorship) Note: Candidates must be authorized to work in the U.S. without sponsorship. C2C applicants will not be considered. You will join the Platform Innovation Team at a Fortune 100 company, focused on enabling internal engineering teams with robust, secure, and scalable data platforms. Your key responsibilities will include: • Designing and developing reusable frameworks, templates, and standardized notebooks in Databricks for enterprise-wide adoption • Implementing Unity Catalog best practices for data governance, access control, auditing, and metadata management • Enforcing security controls and SOX compliance across data platforms using fine-grained permissions and monitoring • Collaborating with DevOps and platform teams to integrate Databricks workflows into CI/CD pipelines • Building and maintaining Lakeflow Connect integrations for automated data ingestion • Creating documentation, playbooks, and training materials to onboard engineers • Driving consistency in data engineering practices across multiple business units Must-have qualifications: • 10+ years of professional experience as a Data Engineer – Proven track record designing, building, and maintaining scalable data platforms. • 5+ years of hands-on experience with Databricks – Deep expertise in Databricks workspace, clusters, job automation, Delta Lake, and Spark optimization. • 2+ years of direct experience with Unity Catalog – Implemented data governance policies, managed metastores, and configured data lineage and audit logging. • 2+ years working with Python notebooks in Databricks – Developed reusable, production-grade notebooks for ETL/ELT, data validation, and automation. • Strong understanding of security and compliance frameworks – Specifically role-based access control (RBAC), SOX compliance, data classification, and secure data sharing practices. • Hands-on experience with Lakeflow Connect – Configured and managed data ingestion pipelines from cloud sources into Databricks. • DevOps integration experience – Worked with Git-based repositories (e.g., GitHub, GitLab, Azure DevOps) using branching strategies (feature branches, PRs, CI/CD) to manage Databricks code deployments. Preferred Skills: • Experience in Fortune 100 or large enterprise environments • Familiarity with data mesh architecture or domain-driven data design • Exposure to infrastructure-as-code (IaC) tools (Terraform, ARM, etc.) for Databricks deployment • Knowledge of monitoring and alerting frameworks for data pipelines • Experience mentoring or enabling engineering teams through enablement frameworks