Palantir Foundry Data Engineer

We are looking for a highly skilled data engineer/senior consultant with strong expertise in Palantir Foundry and experience in executing projects and tasks from conception to final product including both technical and customer needs. Along with the typical Foundry projects this role will also need to create and build reports for visual data management harnessing existing and new data sources. Typical consultants’ skillset providing analysis, planning, design, research, budget monitoring, coordination, facilitation, and communication with customers is expected. Working in Palantir Foundry projects in large enterprises with team sizes of 25 or more is a must. Your future duties and responsibilities • Creating and managing Object Types, defining Link Types to establish object relationships, and developing Property Types to describe objects and link attributes. Creating Interface Types for object polymorphism. • Ontology creation and maintenance using Foundry's Ontology Manager and leverage ontologies for data integration, analysis, and visualization. • Map business concepts and processes to ontological structures while optimizing these ontologies for performance and scalability. • Data Integration: Integrating data from multiple sources into Palantir Foundry, including ETL processes and data transformation. • Code Workbooks: Use Foundry's Code Workbooks to write and execute Python, PySpark, or SQL scripts for data processing. • Pipeline Management: Build, manage, and optimize data pipelines, including Batch, Incremental, and Streaming pipelines in Foundry for efficient data flow and processing. Design complex data transformation logic within these pipelines, performance optimization of existing pipelines, data quality checks, error handling and setup pipeline schedules and triggers. • Semantic Object Linking: Develop back-end code logic leveraging semantic object linking (ontologies) within Foundry Pipeline Builder, Code Workbook, and Ontology Manager. Facilitate data transformation and enrichment processes. • Data Connection Maintenance: Ensure health of data connections and pipelines (utilizing filesystem, JDBC, SFTP, and webhook). Required qualifications to be successful in this role • Strong proficiency with Palantir Foundry, including experience with tools like Pipeline Builder, Code Workbooks, Ontology Manager, and Quiver. • Advanced skills in data engineering, particularly with PySpark, Python and SQL. • Experience designing and implementing complex ontologies within Palantir Foundry, including creating Object Types, Link Types, and Property Types. • Expertise in developing and managing data pipelines, including batch, incremental, and streaming pipelines. • Proficiency in semantic object linking and leveraging Foundry's semantic model for data transformation and enrichment. • Knowledge of data quality processes and the ability to implement testing and codification methods. • Understanding of program management principles and the ability to work in Agile/Scrum development teams. • Strong communication skills and the ability to collaborate with various stakeholders, including product owners and end-users. • BS/MS degree in Computer Science, Engineering, or a related field, or equivalent experience. Desired Skills: • Certification in Palantir Foundry is strongly desired • Experience in .Net, C# • Experience in or exposure to designing data models that effectively utilize object linking to enable advanced analytics and AI/ML capabilities. • Develop front-end website architecture based on Palantir Foundry. • Design user interactions on web pages within Palantir Foundry Workshop. • Ensure responsiveness of web applications developed on low code/no code solutions. • Provide incident management, direct technical consulting and support for current applications/solutions. • Collaborate with various internal and external stakeholders/IT to timely report the status, updates and impediments. • Provides technical guidance for small to large enhancements in areas of solution alternatives, design, testing and documentation Ref: #404-IT Pittsburgh