Data Engineer

Join our dynamic team as a Data Engineer, where you'll be instrumental in transforming unstructured data and building forward-thinking solutions. This role offers a unique chance to innovate with cutting-edge technologies and make a significant impact. Responsibilities • Design and construct pipelines to ingest, parse, and convert diverse unstructured data. • Develop scalable workflows using advanced tools and frameworks for document processing. • Collaborate with AI engineers to optimize data corpora for AI-driven applications. • Implement systems for querying financial data using natural language. • Create and maintain APIs ensuring seamless data and model integration. Skills • Five or more years of experience in data engineering, with specialized skills in Databricks technologies. • Expertise in handling unstructured data and creating effective embedding pipelines. • Proficient in PySpark, Python, and SQL, particularly within Databricks environments. • Solid knowledge of REST API development and microservices architecture. • Understanding of data modeling principles and governance practices. Preferred Skills • Experience with Azure integrations enhancing Databricks capabilities. • Exposure to orchestration frameworks and vector databases. • Background or familiarity with data in financial or investment banking sectors. • Certification in data engineering or related fields could be a plus. At Horizontal, diversity, equity, and inclusion are fundamental to our hiring strategy and workplace culture. We welcome candidates from all backgrounds to enhance our innovative team. By applying for this position, you acknowledge and agree that Horizontal Talent may contact you regarding your application using automated technology, including phone calls, SMS/text messages, or email, which may be delivered by our virtual AI recruiter, Alex.