Location: Remote (must be able to work East Coast hours) Duration: 12-month contract with strong potential for extension or full-time conversion W-2 only (no Corp-to-Corp or 1099) Brooksource is search for a Subject Matter Expert Data Engineer to join our Fortune 500 Energy & Utilities client. The successful candidate will assist in developing the company’s Data Fabric as an interconnected network of data capabilities and data products designed to deliver data efficiently and at scale. Candidates should have expertise in developing and building data platforms, demonstrating experience with overcoming obstacles and avoiding pitfalls. They should also possess skills in optimizing and automating deliverables to production using the required tech stack. Additionally, candidates should be experienced and adaptable to changing demands and priorities in an Agile development environment. We are specifically looking for individuals with at least 5+ years of experience in Data Engineering and/or Software Engineering roles who can provide knowledge and support to our existing engineers. REQUIRED QUALIFICATIONS: Must have experience with similar platform engineering/management solutions: • Building/optimizing Data LakeHouse with Open Table formats • Kubernetes deployments/cluster administration • Transitioning on-premise big data platforms to scalable cloud-based platforms like AWS • Distributed Systems, Microservice architecture, and containers • Cloud Streaming use cases in Big Data Ecosystems (e.g., EMR, EKS, Hadoop, Spark, Hudi, Kafka/Kinesis) Must have experience with below tech stack: • Git Hib and Git Hub Actions • AWS (IAM, API Gateway, Lambda, Step Functions, Lake formation, EKS & Kubernetes, Glue: Catalog/ETL/Crawler, Athena, Lambda, S3 (Strong foundational concepts like object data store vs block data store, encryption/decryption, storage tiers etc) • Apache Hudi • Apache Flink • PostgreSQL and SQL • RDS (Relational Database Services). • Python • Java • Terraform Enterprise (Must be able to explain what TF is used for, must understand and explain basic principles (e.g. modules, providers, functions), must be able to write and debug TF) DESIRED QUALIFICATIONS: • Helm • Kafka and Kafka Schema Registry • AWS Services: CloudTrail, SNS, SQS, CloudWatch, Step Functions, Aurora, EMR, Redshift, Iceberg • Secrets Management Platform: Vault, AWS Secrets manager • Core Responsibilities and Soft Skills • Provides technical direction, engage team in discussion on how to best guide/build features on key technical aspects and responsible for product tech delivery • Works closely with the Product Owner and team to align on delivery goals and timing • Collaborates with architects on key technical decisions for data and overall solution • Lead design and implementation of data quality check methods • Ensure data security and permissions solutions, including data encryption, user access controls and logging • Be able to think unconventionally to find the best way to solve for a defined use case with fuzzy requirements. • Self-starter mentality (willing to do their own research to solve problems and can clearly present findings and engage in conversation on what makes one solution better than another) • Thrive in a fail-fast environment, involving mini PoCs, and participate in an inspect and adapt process. • Questioning and Improvement mindset (must be ready to ask questions about why something is currently done the way it is and suggest alternative solutions) • Customer facing skills (interfacing with stakeholders and other product teams via pairing, troubleshooting support, and debugging issues they encounter with our products) Eight Eleven Group provides equal employment opportunities (EEO) to all employees and applicants for employment without regard to race, color, religion, national origin, age, sex, citizenship, disability, genetic information, gender, sexual orientation, gender identity, marital status, amnesty, or status as a covered veteran in accordance with applicable federal, state, and local laws.