Palantir Foundry Data Engineer

Position: Palantir Foundry Data Engineer Location: Remote Duration: Long Term Contract About VLink: Started in 2006 and headquartered in Connecticut, VLink is one of the fastest growing digital technology services and consulting companies. Since its inception, our innovative team members have been solving the most complex business, and IT challenges of our global clients. Position Description: Client is seeking a Data Engineer with at least 2 years’ experience in Palantir Foundry, to design, build and maintain data pipelines, implement workflows, and ingest and process data. Your future duties and responsibilities: • Creating and managing Object Types, defining Link Types to establish object relationships, and developing Property Types to describe objects and link attributes. Creating Interface Types for object polymorphism. • Ontology creation and maintenance using Foundry's Ontology Manager and leverage ontologies for data integration, analysis, and visualization. • Map business concepts and processes to ontological structures while optimizing these ontologies for performance and scalability. • Data Integration: Integrating data from multiple sources into Palantir Foundry, including ETL processes and data transformation. • Code Workbooks: Use Foundry's Code Workbooks to write and execute Python, PySpark, or SQL scripts for data processing. • Pipeline Management: Build, manage, and optimize data pipelines, including Batch, Incremental, and Streaming pipelines in Foundry for efficient data flow and processing. Design complex data transformation logic within these pipelines, performance optimization of existing pipelines, data quality checks, error handling and setup pipeline schedules and triggers. • Semantic Object Linking: Develop back-end code logic leveraging semantic object linking (ontologies) within Foundry Pipeline Builder, Code Workbook, and Ontology Manager. Facilitate data transformation and enrichment processes. • Data Connection Maintenance: Ensure health of data connections and pipelines (utilizing filesystem, JDBC, SFTP, and webhook). Required qualifications to be successful in this role: • Strong proficiency with Palantir Foundry, including experience with tools like Pipeline Builder, Code Workbooks, Ontology Manager, and Quiver. • Advanced skills in data engineering, particularly with PySpark, Python and SQL. • Experience designing and implementing complex ontologies within Palantir Foundry, including creating Object Types, Link Types, and Property Types. • Expertise in developing and managing data pipelines, including batch, incremental, and streaming pipelines. • Proficiency in semantic object linking and leveraging Foundry's semantic model for data transformation and enrichment. • Knowledge of data quality processes and the ability to implement testing and codification methods. • Understanding of program management principles and the ability to work in Agile/Scrum development teams. • Strong communication skills and the ability to collaborate with various stakeholders, including product owners and end-users. • BS/MS degree in Computer Science, Engineering, or a related field, or equivalent experience. Desired Skills: • Certification in Palantir Foundry is strongly desired • Experience in .Net, C# • Experience in or exposure to designing data models that effectively utilize object linking to enable advanced analytics and AI/ML capabilities. • Develop front-end website architecture based on Palantir Foundry. • Design user interactions on web pages within Palantir Foundry Workshop. • Ensure responsiveness of web applications developed on low code/no code solutions. • Provide incident management, direct technical consulting and support for current applications/solutions. • Collaborate with various internal and external stakeholders/IT to timely report the status, updates and impediments. Employment Practices: EEO, ADA, FMLA Compliant VLink is an equal opportunity employer. At VLink, we are committed to embracing diversity, multiculturalism, and inclusion. VLink does not discriminate on the basis of race, color, religion, sex, national origin, disability status, protected veteran status, or any other characteristic protected by law. All aspects of employment including the decision to hire, promote, or discharge, will be decided on the basis of qualifications, merit, performance, and business needs.