Data Engineer

Responsibilities Kforce has a client in San Francisco, CA that is seeking a Data Engineer to build and optimize data systems that power batch processing, real-time streaming, pipeline orchestration, data lake management, and data cataloging. Summary: The Data Engineer will have the opportunity to use their expertise in solving big data problems, design thinking, coding and analytical skills to develop core libraries, frameworks, and data pipelines that support data products and enable us to confidently leverage our petabyte-scale data. We're looking for talented Data Engineers passionate about building new data driven solutions with the latest Big Data technology. Requirements • 4+ years of experience and a bachelor's degree in computer science or a related field; or equivalent work experience • 2+ years of production coding experience in data pipeline implementation in Python • Working experience of distributed systems Hadoop, Spark, Hive, Kafka, DBT and Airflow/Dagster • Experience working with public cloud platforms, preferably AWS • Experience working with Databricks and/or Snowflake • Experience in Git, JIRA, Jenkins, shell scripting • Familiarity with Agile methodology, test-driven development, source control management and test automation • Experience supporting and working with cross-functional teams in a dynamic environment • Excellent collaborative problem solving and communication skills and are empathetic to others • You believe in simple and elegant solutions and give paramount importance to quality • You have a track record of building fast, reliable, and high-quality data pipelines The pay range is the lowest to highest compensation we reasonably in good faith believe we would pay at posting for this role. We may ultimately pay more or less than this range. Employee pay is based on factors like relevant education, qualifications, certifications, experience, skills, seniority, location, performance, union contract and business needs. This range may be modified in the future. We offer comprehensive benefits including medical/dental/vision insurance, HSA, FSA, 401(k), and life, disability & ADD insurance to eligible employees. Salaried personnel receive paid time off. Hourly employees are not eligible for paid time off unless required by law. Hourly employees on a Service Contract Act project are eligible for paid sick leave. Note: Pay is not considered compensation until it is earned, vested and determinable. The amount and availability of any compensation remains in Kforce's sole discretion unless and until paid and may be modified in its discretion consistent with the law. This job is not eligible for bonuses, incentives or commissions. Kforce is an Equal Opportunity/Affirmative Action Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, pregnancy, sexual orientation, gender identity, national origin, age, protected veteran status, or disability status. By clicking “Apply Today” you agree to receive calls, AI-generated calls, text messages or emails from Kforce and its affiliates, and service providers. Note that if you choose to communicate with Kforce via text messaging the frequency may vary, and message and data rates may apply. Carriers are not liable for delayed or undelivered messages. You will always have the right to cease communicating via text by using key words such as STOP.