Senior Data Engineer
⭐ - Featured Role | Apply direct with Data Freelance Hub
This role is for a Senior Data Engineer in NYC, NY, with a contract length of "unknown" and a pay rate of "$$$". Key skills include Python, Spark, AWS data lake services, and experience with NoSQL databases. Agile methodology experience is required.
🌎 - Country
United States
💱 - Currency
$ USD
-
💰 - Day rate
-
🗓️ - Date discovered
June 3, 2025
🕒 - Project duration
Unknown
-
🏝️ - Location type
Unknown
-
📄 - Contract type
Unknown
-
🔒 - Security clearance
Unknown
-
📍 - Location detailed
New York, NY
-
🧠 - Skills detailed
#Spark (Apache Spark) #Oracle #Airflow #Java #Batch #AWS (Amazon Web Services) #Data Storage #Documentation #Programming #Cloud #JSON (JavaScript Object Notation) #Storage #Vault #Data Lakehouse #Data Lake #Infrastructure as Code (IaC) #AI (Artificial Intelligence) #Agile #GIT #Python #Terraform #Jenkins #Scala #Data Engineering #Data Vault #Databricks #MongoDB #NoSQL #Hadoop
Role description
itle: Sr Data Engineer
Location: NYC, NY
Job Description :-
Required Skills:
• Proficiency in data engineering programming languages (preferably Python, alternatively Scala or Java)
• Proficiency in atleast one cluster computing frameworks (preferably Spark, alternatively Flink or Storm)
• Proficiency in atleast one cloud data lakehouse platforms (preferably AWS data lake services or Databricks, alternatively Hadoop), atleast one relational data stores (Postgres, Oracle or similar) and atleast one NOSQL data stores (Cassandra, Dynamo, MongoDB or similar)
• Proficiency in atleast one scheduling/orchestration tools (preferably Airflow, alternatively AWS Step Functions or similar)
• Proficiency with data structures, data serialization formats (JSON, AVRO, Protobuf, or similar), big-data storage formats (Parquet, Iceberg, or similar), data
• processing methodologies (batch, micro-batching, and stream), one or more data modelling techniques (Dimensional, Data Vault, Kimball, Inmon, etc.), Agile methodology (develop PI plans and roadmaps), TDD (or BDD) and CI/CD tools (Jenkins, Git,)
• Strong organizational, problem-solving and critical thinking skills; Strong documentation skills
Preferred skills:
• Experience using AWS Bedrock APIs
• Knowledge of Generative AI concepts (such as RAG, Vector embeddings, Model fine tuning, Agentic AI)
• Experience in IaC (preferably Terraform, alternatively AWS cloud formation)
itle: Sr Data Engineer
Location: NYC, NY
Job Description :-
Required Skills:
• Proficiency in data engineering programming languages (preferably Python, alternatively Scala or Java)
• Proficiency in atleast one cluster computing frameworks (preferably Spark, alternatively Flink or Storm)
• Proficiency in atleast one cloud data lakehouse platforms (preferably AWS data lake services or Databricks, alternatively Hadoop), atleast one relational data stores (Postgres, Oracle or similar) and atleast one NOSQL data stores (Cassandra, Dynamo, MongoDB or similar)
• Proficiency in atleast one scheduling/orchestration tools (preferably Airflow, alternatively AWS Step Functions or similar)
• Proficiency with data structures, data serialization formats (JSON, AVRO, Protobuf, or similar), big-data storage formats (Parquet, Iceberg, or similar), data
• processing methodologies (batch, micro-batching, and stream), one or more data modelling techniques (Dimensional, Data Vault, Kimball, Inmon, etc.), Agile methodology (develop PI plans and roadmaps), TDD (or BDD) and CI/CD tools (Jenkins, Git,)
• Strong organizational, problem-solving and critical thinking skills; Strong documentation skills
Preferred skills:
• Experience using AWS Bedrock APIs
• Knowledge of Generative AI concepts (such as RAG, Vector embeddings, Model fine tuning, Agentic AI)
• Experience in IaC (preferably Terraform, alternatively AWS cloud formation)
