AWS Data Engineer

Data Engineer Location: Charlotte, NC (Hybrid/Remote) Work Setting: Preference for Hybrid but open to fully remote but they will be required to work 9 AM-5PM EST with the team. Limiting to candidates in CST and EST time zones. Role Summary & Description: The team is building modern, enterprise data platforms that make data easy to discover, understand, trust, and consume at scale. The Data Marketplace is a core capability in this vision, serving as the enterprise gateway for discovering data assets within the data enterprise. We are seeking a Senior Software Engineer with a strong background related to our tech stack to build and operate the software, data, and metadata foundations of the Data Marketplace. This is a hands-on individual contributor role focused on platform needs for scalable services, search and catalog capabilities, and enabling other experiences that improve how employees find and use data. Responsibilities: • Design, develop, and maintain Python-based services, Lambda functions, and data pipelines. • Provision and manage AWS infrastructure using Terraform, following best practices for modularity, security, and maintainability. • Build and operate AI/ML and search capabilities on Amazon OpenSearch, including vector search, semantic retrieval, and integration with LLM-driven workflows. • Collaborate with data, platform, and security teams to deliver end-to-end solutions across AWS services (Lambda, API Gateway, Glue, S3, DynamoDB, IAM, VPC, etc.). • Modernize Dynatrace alarming using Terraform and Python • Champion code quality through reviews, automated testing, CI/CD pipelines, and observability. • Mentor junior engineers, share best practices, and contribute to architectural decisions and technical standards. • Be able to think unconventionally to find the best way to solve for a defined use case with fuzzy requirements. • Self-starter mentality. Willing to do their own research to solve problems and can clearly present findings and engage in conversation on what makes one solution better than another. Must-Have Tech Stack: • 5+ years of professional software development experience and must be able to code. • Python: strong proficiency, including type hints, testing (unittest/pytest), and packaging • Terraform specifically for Infrastructure as Code related to AWS • GitHub • Confluence • Amazon OpenSearch: index design, query DSL, and vector/k-NN search • AI/ML: embeddings, RAG patterns, foundation models, and ML model integration • AWS services: • DynamoDB • Glue • IAM • S3 • API Gateway • Lambda Nice to Have: • Collibra or experience integrating with enterprise data catalog or governance platforms • Kafka or other event-driven architecture • AWS services: Lake Formation