We are seeking a talented and motivated Senior Data Engineer to join our dynamic team. This remote position offers the opportunity to work on innovative projects that enhance the experience of real estate professionals and home buyers alike. Responsibilities • Design, develop, and test robust, scalable data platform components to meet the needs of millions of users. • Collaborate with product engineers to understand data pipeline requirements and deliver innovative solutions. • Build high-performance, scalable data solutions that support business objectives. • Work closely with cross-functional teams to define new data products and features. • Utilize your expertise in big data technologies to tackle challenging projects involving large data sets. Skills • 7+ years of core experience in Scala/Java, focusing on building business logic layers and high-volume data pipelines. • 5+ years of experience in real-time stream processing using Apache Flink or Apache Spark, with messaging infrastructure like Kafka or Pulsar. • 7+ years of experience in data pipeline development, ETL, and processing structured and unstructured data. • Proficiency in NoSQL systems such as MongoDB and relational databases like PostgreSQL. • Strong analytical skills and a commitment to quality in all deliverables. Preferred Skills • Experience with AWS services, including Lambda, API Gateway, and CloudWatch. • Familiarity with data visualization tools and techniques. • Excellent written and verbal communication skills. • A collaborative work ethic and a passion for technology and innovation. We believe in fostering a diverse and inclusive workplace where all individuals are valued and empowered to contribute their unique perspectives. We encourage applicants from all backgrounds to apply and join us in creating an equitable environment. Once you apply for this position, you may receive a phone call, SMS or email at the time of application from our Virtual AI Recruiter, Alex, to conduct an initial interview. Horizontal facilitates valuable and productive conversations between you and potential employers. We can assist you in growing your career by partnering you with employers that offer challenging assignments. For those that join the team, we offer competitive compensation and benefits including medical, dental, vision, and retirement. Check out all we have to offer and how you can become part of the Horizontal Talent Team. The pay range for this role is $40 - $76 per hour. This is not a guarantee of compensation, as final offer amount may vary based on factors including but not limited to experience and geographic location.