Job Title: Data Engineer Primary Skills: AWS Services, Data Lakehouse, Lake Formation, SQL Server, IAM Secondary Skills: EKS, HashiCorp Vault, Terraform, Keycloak Location: Remote (USA) Job Description: We are seeking a highly skilled Data Engineer to support the automation and transformation of data workflows in a cloud-based Data Lakehouse environment. This role focuses on designing, implementing, and maintaining secure, scalable, and efficient data infrastructure using modern AWS services and tools. Key Responsibilities: • Automate the creation, transformation, and integration of raw and enriched data models in the Data Lakehouse. • Implement automated ETL pipelines for seamless data ingestion, transformation, and consumption. • Design and implement LakeFormation integration across AWS Data Platform accounts. • Integrate LakeFormation with Keycloak for authentication and access control. • Build an integrated IAM solution, including EKS service accounts for secure identity and access management. • Design and integrate HashiCorp Vault with AWS services (e.g., Secrets Manager, Certificate Manager, Keycloak). • Develop secure integrations between HashiCorp Vault and AWS Data Services such as RDS Aurora PostgreSQL, RDS MSSQL, and other RDS solutions. • Provision MSSQL servers on AWS using Terraform and deploy read replicas. • Implement monitoring and logging solutions for MSSQL servers on AWS. • Transition existing pipelines to the new MSSQL server infrastructure. • Collaborate with business application owners to review existing data architecture, pipelines, and consumption patterns. • Design and document target architecture for pipelines, processing, and analytics. • Identify opportunities for optimization, consolidation, and improved performance. • Work closely with the data team to decompose business logic and support data transformation initiatives.