Sr. Data Engineer

MBO Partners is a deep jobs platform that connects and enables independent professionals and microbusiness owners to do business safely and effectively with enterprise organizations. Its unmatched experience and industry leadership enable it to operate on the forefront of the independent economy and consistently advance the next way of working. Sr. Data Engineer Location: Remote Anticipated Hours: 40 per week Duration: As soon as cleared through September 2026 Security Clearance: Must be able to obtain and maintain a Public Trust Job Description: We’re looking for an experienced data engineer who thrives on solving applied problems with code, modern tooling, and scalable infrastructure. You’ll work with large, complex datasets, build robust ETL/ELT pipelines, and optimize data flows using technologies like Databricks, Spark, and Kafka. In this role, you’ll grow your technical expertise, apply best practices and use tools like Spark, Kafka, EKS, and others. With your drive to establish processes and lead technological innovation, you’ll make a lasting impact on the civil market. Join us. The world can’t wait. You Have: • 5+ years of experience designing, building, and maintaining data pipelines in production environments • 3+ years of experience developing with Spark (Databricks preferred), PySpark, or similar distributed systems • 3+ years of experience with data lakehouse or warehouse platforms, schema design, and query optimization • 3+ years of experience processing data using streaming (Kafka, Kinesis, etc.) and batch methods • Proficiency in Python and SQL (Scala or Java a plus) • Experience implementing best practices for data quality, testing, and observability • Strong understanding of structured/unstructured data formats (Parquet, Avro, JSON, Delta) • Knowledge of data, information, and message exchange structures and standards • Ability to obtain and maintain a Public Trust or Suitability/Fitness determination based on client requirements • Bachelor's degree Nice If You Have: • 3+ years of experience in data analytics • Experience designing data flows that leverage a medallion architecture • Experience with containerization and orchestration (Docker, Kubernetes, EKS) • Experience with Kafka • Experience with Nifi • Experience using AWS • Knowledge of microservices and integrating with data services • Knowledge of database schema design • Master's degree Eligibility Requirements: • Legal authorization to work in the U.S. is required. • As a contractor, including remote contractors, you may be required to complete a background check. As a contractor, you will be paid for the time you work; this does not include paid time off (PTO) or holidays. If you participate in our Payroll Services (W2) engagement, you may be eligible for Paid Sick Leave (PSL), depending on your work location and state-specific regulations.