Data Engineer

About the job: Data Engineer Career Level : Mid-level Location : Hybrid / Onsite Who We Are: This is Spearhead Technology — where every challenge is an opportunity, and every solution is a masterpiece in the making. As a full-lifecycle IT company, we transcend mere delivery; we engineer success. From inception to implementation, our seasoned expertise shepherds every phase of the journey. Be it planning, analysis, design, development, testing, or the seamless transition to production, we stand as steadfast partners in our clients’ progress. At Spearhead Technology, quality isn't a mere aspiration—it's our ethos. Rooted in Tech Advisory, our methodology is guided by insights that spark transformative outcomes. We recognize the paramount importance of talent retention. Through a steadfast commitment to work-life balance, competitive remuneration packages, and an optimized operational model, we ensure our team remains as exceptional as our services. Step into Spearhead Technology, where innovation meets precision, and together, let's sculpt the future of technology with finesse and distinction. Requirements We are seeking individuals who demonstrate exceptional skills and are passionate about making a difference. Responsibilities: • Work with a team of data and software engineers to deliver big data streaming platform and data management capabilities. • Develop cutting edge software solutions by writing maintainable, extensible, tested code, while complying with coding standards • Be hands-on and lead from the front in following best practices in development, microservices design and CI/CD methodologies • Facilitate end to end user testing with customers. • Troubleshoot, debug and upgrade existing systems. • Help bridge gaps between Toyota Connected, other Toyota Entities, and 3rd party suppliers. • Work closely with product owners to shape and deliver features to customers. • Embrace emerging technology opportunities and contribute to our best practices, driving overall architecture, security, design. • Write full-stack software and tooling, ensuring code is well-tested and performant. • Develop tools and libraries that will enable rapid and scalable development in the future. • Contribute to all aspects of the software development life cycle across multiple, interconnected software products. • Support responsibilities will include investigating issues our customers have with retrieving data via our data products. • debugging APIs, cloud services, and data lake technologies Required Qualifications: • 3+ years of data engineering experience • Solid experience writing clean, concise, tested, maintainable code in python. • Experience building and deploying applications in AWS • API development experience • Experience utilizing Spark and SQL • Experience with Databricks or EMR • Experience with CI/CD and updating build pipelines and pipeline tasks • Hands-on production experience working with Big Data platforms, building and optimizing data pipelines that involve data processing and streaming platforms • Experience in test automation frameworks, optimizing performance and security enabling delivery of robust and maintainable architecture. • Ability to learn and apply new technologies, programming practices, patterns, and methods • Demonstrates advanced problem-solving, troubleshooting, decision making skills • Organized and detail-oriented • Ability to develop healthy working relationships and collaborate with peers and leaders • Exhibits integrity and high standards in work quality • Excellent verbal and written communication skills • Values diversity and differences amongst individuals in interactions Benefits What’s in it for you: At Spearhead Technology, we prioritize your well-being and professional growth. Here's what you can expect: • Achieve a healthy work-life balance. • Competitive compensation and abundant growth opportunities. • Enjoy a standard 5-day workweek with 2 fixed weekly offs. • Experience an employee-centric environment with supportive policies. • Benefit from family-friendly and flexible work arrangements. • Access our Performance Advancement and Career Enhancement (PACE) initiative and discover opportunities for both personal and professional growth. From tailored career development plans to expert counseling services, PACE empowers you to chart your course to success with confidence and clarity. Elevate your career trajectory with our Learning & Development (L&D) program. Join our team and embark on a transformative journey of upskilling and self-discovery. With continuous learning as your compass, you'll not only enhance your expertise but also open doors to new opportunities, paving the way for career growth and fulfillment. Please note : At Spearhead Technology, we value the importance of collaboration, learning, and fostering connections with clients, peers, leaders, and communities. While some in-person engagement may be required for certain roles, we are committed to providing flexibility to accommodate your individual work-life balance needs. As an equal opportunities’ employer, Spearhead Technology welcomes and encourages applications from all members of society. We are dedicated to creating an inclusive environment where diversity is celebrated, and individuals are valued for their unique perspectives and contributions. We do not discriminate on the basis of race, religion or belief, ethnicity, disability, age, citizenship, marital or civil partnership status, sexual orientation, or gender identity.