Data Engineer

We are seeking an highly skilled data engineering professional who thrives in fast-paced environments, adapts quickly to new technologies, and demonstrates strong analytical and problem-solving skills. You should possess a deep understanding of data structures, algorithms, and modern engineering practices, along with the ability to lead, influence, and communicate effectively across technical and business teams. Required Experience • Bachelor’s degree in Computer Science, Data Science, Software Engineering, or related field (or equivalent combination of education and experience) • 6+ years of experience designing and implementing end-to-end data engineering solutions • Advanced skills in data modeling, data warehousing, and ETL development • Hands-on experience with ETL tools — Matillion and/or PySpark preferred • Expertise in building and operating distributed, highly available data systems for large-scale ingestion and processing • Strong experience with cloud-based scalable data lake solutions (Databricks, Snowflake, AWS) • Proficiency with big data technologies: Hadoop, Hive, Spark, EMR, and orchestration tools like Airflow • Strong SQL skills and proficiency in Python and Shell scripting • Experience with CI/CD tools: GitHub, Jenkins, Terraform, Databricks Asset Bundles Key Responsibilities • Define technical requirements, project scope, and estimates; translate backlog items into engineering tasks • Lead development of technical solutions aligned with architectural standards • Collaborate with architecture and platform teams; review and validate POCs • Design and build data products and features within Agile/Scrum frameworks • Develop distributed data pipelines using modern big data tools • Conduct data profiling and analysis for scalable solution design • Drive technical strategies for new initiatives and optimize existing systems • Troubleshoot complex data issues and perform root cause analysis • Build utilities, UDFs, and libraries to support scalable data flows • Implement advanced automation through workflow orchestration tools • Conduct collaborative design, code, and dataset reviews • Mentor and guide junior engineers • Proactively address data quality issues and build automated testing frameworks • Drive best practices in version control, code review, CI/CD, and cloud development workflows Characteristics We Value • Strong collaboration and team-first mindset • Ability to manage multiple projects in a fast-paced Agile environment • Excellent communication and problem-solving skills • Commitment to continuous learning and improvement • Passion for mentoring and supporting team growth About Brickred Systems: Brickred Systems is a global leader in next-generation technology, consulting, and business process service companies. We enable clients to navigate their digital transformation. Brickred Systems delivers a range of consulting services to our clients across multiple industries around the world. Our practices employ highly skilled and experienced individuals with a client-centric passion for innovation and delivery excellence. With ISO 27001 and ISO 9001 certification and over a decade of experience in managing the systems and workings of global enterprises, we harness the power of cognitive computing hyper-automation, robotics, cloud, analytics, and emerging technologies to help our clients adapt to the digital world and make them successful. Our always-on learning agenda drives their continuous improvement through building and transferring digital skills, expertise, and ideas from our innovation ecosystem.