Data Engineer

Job Title: Senior Data Engineer We’re on the hunt for a talented Senior Data Engineer who is passionate about working with data at scale and is ready to drive the development of high-performance data pipelines. In this role, you will be responsible for creating and maintaining efficient data workflows that bring in and manage data from diverse sources into our platform. This is a fantastic opportunity for someone who thrives in a fast-evolving environment and loves working with cutting-edge technologies to support large-scale data operations. Core Responsibilities: • Data Pipeline Development: Design and implement ingestion pipelines for both batch and real-time streaming data from a variety of sources. • Data Quality & Consistency: Establish monitoring systems that ensure data integrity and quality across our platform. • Architecture & Design: Collaborate on building data models and architectural solutions that empower reporting and analytics at scale. • Scalability: Enhance our data lake and processing frameworks to support massive data growth (hundreds of times its current scale). • Collaboration with Teams: Work closely with data science, analytics, and other engineering teams to create robust data solutions that feed into machine learning models and other analytical systems. What We’re Looking For: • Educational Background: A degree in Computer Science, Engineering, Mathematics, or a related field, combined with significant hands-on experience in data engineering. • Experience: • 7+ years of experience in software development with deep expertise in SQL, Scala, Spark, Flink, Beam, and Python. • 5+ years of hands-on experience in data management, including working with both structured and unstructured data. • Proven expertise in building and scaling data pipelines that support advanced analytics, machine learning, or LLMs. • Strong background in working with cloud platforms Azure or others. • Skills: • Deep understanding of modern data architectures, with a focus on scalability and efficiency. • Expertise in batch and real-time data processing systems. • Experience in designing and optimizing large-scale data lakes and ensuring seamless integration of various data sources. Additional Expectations: • Team Collaboration: Ability to work well in a collaborative environment and contribute to problem-solving in the face of uncertainty or ambiguity. • Travel: Willingness to travel up to 50%, including customer meetings and onsite collaboration when required. • Mindset: A positive attitude, a collaborative spirit, and the ability to stay focused and deliver results under pressure. Preferred Experience: • Previous exposure to multi-cloud environments, especially with Azure, would be a significant plus. Lenora Systems upholds the policy of equal employment opportunity. We commit to consider all eligible candidates for employment without discrimination on the grounds of age, lineage, nationality, hue, family or medical leave, gender identity or expression, genetic data, immigration status, marital circumstance, medical status, national origin, physical or psychological disability, political alignment, veteran or military status, race, ethnicity, faith, sex (including maternity), sexual preference, or any other attribute safeguarded by relevant local statutes, directives, and ordinances