Databricks Data & AI Engineer

Actively Interviewing! Provident IT Partners is an IT Staffing firm dedicated to serving clients with their essential technology resource needs. We have a client seeking a Databricks Data & AI Engineer (contract or full-time). This person is an embedded technology specialist working directly within Trading & Supply teams to accelerate delivery of digital, automation, and AI solutions. The role focuses on the following: • Identifying and delivering high impact digital and AI opportunities close to the business • Translating business problems into scalable, production ready solutions • Raising decision making speed, reducing manual effort, and improving quality and control • Bridging business demand with IT delivery, architecture, and governance Details: Start Date: June 9, 2026 Location: Houston, TX Work type: Onsite – 3 days/week Status: Contract (long-term) or Full-time Rate: W2 and TBD (No C2C) Job Responsibilities: A. Digital & AI Solution Delivery (Mandatory) • Design, build, and deliver digital, automation, and AI solutions from idea to production • Develop POCs, prototypes, and production grade solutions aligned to target architecture • Apply the right level of engineering (low code, scripting, data engineering, AI) based on problem complexity • Ensure solutions are secure, supportable, and compliant with risk and governance requirements \_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_ B. Opportunity Identification & Business Engagement • Work side by side with traders, contract advisors, and operations teams to identify digital opportunities • Observe day to day workflows to spot inefficiencies, risks, and automation potential • Translate business problems into clearly defined digital or AI use cases with measurable value • Act as a trusted partner embedded with the business, not a remote delivery role \_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_ C. Stakeholder & Governance Engagement • Act as a bridge between business teams, engineers, architects, security, and governance functions • Support risk assessment, compliance, and approval processes for digital and AI solutions • Communicate progress, value, and risks clearly to business and IT stakeholders • Ensure solutions follow company policies on data, security, AI, and regulatory compliance \_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_ D. Tools & Ways of Working • Experience working in Agile, iterative delivery environments • Hands on experience with some of the following (depth in a subset expected): o Data & analytics (e.g. SQL, Python, Databricks, cloud platforms-Azure) o Automation & low code tools (e.g. Power Automate, Power Apps) o AI / GenAI workflows (assistive AI, document automation, agents) o AI Foundry, Databricks Mosaic, MS Copilot Studio, Langchain, Langgraph Qualifications: • Bachelor’s or Master’s degree in Computer Science, Engineering, Data, Information Systems, or related field • Relevant certifications (desirable, not mandatory): • o Cloud, data, automation, or AI certifications • o Agile delivery certifications (Scrum, SAFe, Kanban) • Experience level aligned to 8+ years with strong hands-on delivery exposure • Proven experience working close to business teams in fast paced environments • Experience working in Commodities (or any) Trading domain Good to have skills: • Experience delivering automation or AI in operational, trading, or contract heavy environments • Strong problem framing and value articulation skills • Upskilling business users on digital tools and ways of working • Exposure to Trading & Supply, Commercial Operations, or similar complex domains • Experience working in embedded, federated, or hub and spoke capability models • Comfortable balancing speed of delivery with safety, risk, and architectural discipline