Agile Resources, Inc.

BI Data Engineer

⭐ - Featured Role | Apply direct with Data Freelance Hub
This role is for a BI Data Engineer on a 12-month contract, fully remote, with a pay rate of $60-$70/hr. Requires 7+ years of data engineering experience, expertise in Spark, Python, SQL, and familiarity with cloud infrastructure and ML lifecycle management.
🌎 - Country
United States
πŸ’± - Currency
$ USD
-
πŸ’° - Day rate
480
-
πŸ—“οΈ - Date
July 2, 2026
πŸ•’ - Duration
More than 6 months
-
🏝️ - Location
Remote
-
πŸ“„ - Contract
Unknown
-
πŸ”’ - Security
Unknown
-
πŸ“ - Location detailed
Orlando, FL
-
🧠 - Skills detailed
#Distributed Computing #Data Architecture #Deployment #Databricks #Kafka (Apache Kafka) #Storage #Python #Data Governance #Scala #BI (Business Intelligence) #Leadership #AI (Artificial Intelligence) #SQL (Structured Query Language) #Batch #ML (Machine Learning) #Data Pipeline #Spark (Apache Spark) #Cloud #"ACID (Atomicity #Consistency #Isolation #Durability)" #Delta Lake #"ETL (Extract #Transform #Load)" #Apache Spark #MLflow #Datasets #Data Quality #Continuous Deployment #Data Engineering
Role description
Sr. Data Engineer Location: Fully Remote Type: 12-month Contract with Potential to Extend or Convert Compensation: $60/hr - $70/hr We are partnering with an industry leader in the construction supplies and equipment space to find a Sr. Data Engineer to spearhead the evolution of their global, next-generation data ecosystem. If you thrive on solving intricate, massive-scale data puzzles, optimizing bleeding-edge distributed computing environments, and laying the groundwork for sophisticated machine learning and LLM operations, this is your next definitive career move. In this role, you will act as the architect behind a mission-critical platform, transforming raw datasets into powerful, secure, and production-ready intelligence that fuels executive-level decisions. You will enjoy a high degree of technical ownership, bridging the gap between advanced cloud engineering and real-world AI applications. Here’s What You’ll Be Doing β€’ Architectand optimize high-throughput, distributed computing frameworks and modern Lakehouse structures to handle massive data velocity and volume. β€’ Construct robust, production-grade features and pipelines that seamlessly operationalize large language models (LLMs) and predictive machine learning models. β€’ Build automated ingestion frameworks across multi-cloud environments, utilizing both real-time streaming and scheduled batch processing. β€’ Establish solid data quality, unified cataloging, and access controls while aggressively optimizing cluster performance and cloud infrastructure costs. β€’ Collaboratewith cross-functional leadership, finance, and operations teams to convert complex strategic goals into highly scalable technical solutions. Here’s What Our Ideal Candidate Has β€’ 7+ years of sophisticated data engineering experience, highlighted by mastery-level knowledge of Spark tuning, partitioning, and cloud infrastructure. β€’ Extensive hands-on experience designing secure, ACID-compliant storage layers, ideally utilizing modern unified cataloging tools. β€’ Expertise in Python and SQL, coupled with practical experience supporting ML lifecycle management (such as tracking, feature stores, or LLM integrations). β€’ A proven track record of integrating disparate, complex data sources and maintaining high-availability production environments at enterprise-scale. β€’ Familiarity with event-driven architectures (like Kafka), continuous integration/continuous deployment (CI/CD) pipelines, and infrastructure-as-code will be a plus. Benefits: Medical, Dental, Vision Keywords: Lead Data Engineer, Senior Data Engineer, Databricks, Apache Spark, Delta Lake, Lakehouse Architecture, Python, SQL, Cloud Data Architect, MLOps, Data Pipelines, Spark Tuning, Unity Catalog, Kafka, Event Hubs, MLflow, LLM Infrastructure, Data Governance