Big Data Engineer (Java)

We are looking for experienced java big data developers in our enterprise Transparency Services group. Big data developer will work on ingesting, storing, validating and disseminating after transforming data in a consumable format for business intelligence teams and data analysts to get deeper business insight from the data. Job Responsibilities • Analyze and translate complex business requirements into scalable technical solutions using Core Java (JDK 17+) • Design, develop, and maintain robust ETL pipelines leveraging AWS services and serverless technologies in compliance with business specifications • Implement comprehensive automated testing strategies including unit tests (JUnit, Mockito), functional tests (Playwright or similar frameworks), and performance tests (Gatling or equivalent tools) • Architect and optimize data pipeline infrastructure ensuring high performance • Lead and participate in peer code reviews and design review sessions, ensuring adherence to best practices and architectural standards • Collaborate in CI/CD processes using build tools to ensure seamless deployment and integration • Provide technical expertise and support to production operations teams for troubleshooting, incident resolution, and system maintenance Experience & Qualifications • 5+ years of experience in programming (Java) • 3+ years of experience in big data projects in AWS • 3+ years of experience with API development (REST API’s) and testing Required Technical Skills & Knowledge • Deep knowledge in Core Java (JDK 17+), multithreading, concurrency, memory management and data structures • Strong experience with AWS services and serverless technologies • Skilled in relational PostgreSQL databases and performance tuning • Experience in build tools (Maven, Gradle) and CI/CD process • Experience using Mockito(Or Similar)/JUnit, Playwright(Or Similar testing framework) , Gatling (Or similar performance testing The Following Skills a Plus • Python scripting • Foundational knowledge of application security testing • Hands-on DevOps skills