Brooksource
Data Engineer
⭐ - Featured Role | Apply direct with Data Freelance Hub
This role is for a Data Engineer with a contract length of "unknown," offering a pay rate of "unknown," and located "remote." Key skills include PySpark, Terraform, DevOps, and leadership. Experience in data engineering and collaboration with cross-functional teams is required.
🌎 - Country
United States
💱 - Currency
$ USD
-
💰 - Day rate
Unknown
-
🗓️ - Date
October 25, 2025
🕒 - Duration
Unknown
-
🏝️ - Location
Unknown
-
📄 - Contract
Unknown
-
🔒 - Security
Unknown
-
📍 - Location detailed
United States
-
🧠 - Skills detailed
#Terraform #Security #"ETL (Extract #Transform #Load)" #JSON (JavaScript Object Notation) #Leadership #Cloud #Unit Testing #Documentation #PySpark #Code Reviews #Scripting #Spark (Apache Spark) #Data Engineering #Network Security #DevOps
Role description
• Development: - Working with varied data file formats (Avro, json, csv) using PySpark for ingesting and transformation, Terraform scripting, and DevOps process.
• Lead Development Initiatives: Develop code with FTR and of quality. Also, to take ownership of different development initiatives, ensuring timely delivery while meeting or exceeding quality standards.
• Code Quality and Maintenance: Oversee the maintenance of code quality and enforce best practices, including code reviews, unit testing, CICD, and adherence to coding standards.
• Reduce Technical Debt: Identify, prioritize, and implement strategies to reduce technical debt and address vulnerabilities in the codebase.
• Team Leadership: Provide mentorship and guidance to team members, fostering a collaborative, innovative, and high-performance environment.
• Collaboration: Work closely with cross-functional teams, including product management, Cloud Security, LOB, Network security, and DevOps, to integrate different features into broader solutions.
• Problem Solving: Address and troubleshoot complex technical issues, providing solutions that enhance system performance and user experience.
• Documentation: Ensure comprehensive documentation of systems, processes, and code to facilitate knowledge sharing and maintenance.
• Stakeholder Communication: Communicate progress, challenges, and solutions to stakeholders, ensuring transparency and alignment with business objectives.
• Development: - Working with varied data file formats (Avro, json, csv) using PySpark for ingesting and transformation, Terraform scripting, and DevOps process.
• Lead Development Initiatives: Develop code with FTR and of quality. Also, to take ownership of different development initiatives, ensuring timely delivery while meeting or exceeding quality standards.
• Code Quality and Maintenance: Oversee the maintenance of code quality and enforce best practices, including code reviews, unit testing, CICD, and adherence to coding standards.
• Reduce Technical Debt: Identify, prioritize, and implement strategies to reduce technical debt and address vulnerabilities in the codebase.
• Team Leadership: Provide mentorship and guidance to team members, fostering a collaborative, innovative, and high-performance environment.
• Collaboration: Work closely with cross-functional teams, including product management, Cloud Security, LOB, Network security, and DevOps, to integrate different features into broader solutions.
• Problem Solving: Address and troubleshoot complex technical issues, providing solutions that enhance system performance and user experience.
• Documentation: Ensure comprehensive documentation of systems, processes, and code to facilitate knowledge sharing and maintenance.
• Stakeholder Communication: Communicate progress, challenges, and solutions to stakeholders, ensuring transparency and alignment with business objectives.
