Cloud Engineer
⭐ - Featured Role | Apply direct with Data Freelance Hub
This role is for a Cloud Engineer with a contract length of "unknown" and a pay rate of "unknown." Key skills include Spark, PySpark, Python, and AWS experience. Requires at least 5 years in AWS Data Pipelines and Dremio application management.
🌎 - Country
United States
💱 - Currency
$ USD
-
💰 - Day rate
-
🗓️ - Date discovered
June 24, 2025
🕒 - Project duration
Unknown
-
🏝️ - Location type
Unknown
-
📄 - Contract type
Unknown
-
🔒 - Security clearance
Unknown
-
📍 - Location detailed
McLean, VA
-
🧠 - Skills detailed
#VPC (Virtual Private Cloud) #REST API #Snowflake #Jira #Lambda (AWS Lambda) #Java #Logstash #AWS (Amazon Web Services) #REST (Representational State Transfer) #SQS (Simple Queue Service) #IAM (Identity and Access Management) #Data Pipeline #Golang #Spark (Apache Spark) #S3 (Amazon Simple Storage Service) #SNS (Simple Notification Service) #Python #Cloud #Apache Spark #Dremio #Agile #Programming #"ETL (Extract #Transform #Load)" #EC2 #JSON (JavaScript Object Notation) #Databricks #API (Application Programming Interface) #DynamoDB #PySpark #Deployment #Presto #RDS (Amazon Relational Database Service) #Elasticsearch #Scala
Role description
Heading 1
Heading 2
Heading 3
Heading 4
Heading 5
Heading 6
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam, quis nostrud exercitation ullamco laboris nisi ut aliquip ex ea commodo consequat. Duis aute irure dolor in reprehenderit in voluptate velit esse cillum dolore eu fugiat nulla pariatur.
Block quote
Ordered list
- Item 1
- Item 2
- Item 3
Unordered list
- Item A
- Item B
- Item C
Bold text
Emphasis
Superscript
Subscript
• Must Have: Spark, PySpark, Python are must haves. EKS experience and experience in an AWS environment. At least one year of application management experience using Dremio, Presto, Databricks, Starburst, or Snowflake is a must have.
• Must Have Qualifications: Dremio application support and management, AWS environment, Hands on AWS.
Requirements:
• Dremio application management with one year or more experience is a must have.
• Strong hands on experience building ETL pipelines using Apache Spark.
• Hands on experience with AWS services such as Glue, EMR, Lambda, Step Functions, CloudTrail, CloudWatch, SNS, SQS, S3, VPC, EC2, RDS, IAM.
• Proficient in Python and/or Scala programming languages.
• Knowledge of application development lifecycles, & continuous integration/deployment practices.
• Experience with development on AWS and cloud native applications.
• Experience with S3, DynamoDB, Kinesis and Snowflake.
• Experience with Developing Data Platforms on AWS.
• Proficient in Agile Software Development methodology, processes, and practices.
• Experience with the full ELK Stack - Elasticsearch, Logstash, Kibana, Beat agents and REST API integration.
• Experience with programming languages like Golang, Java, JSON etc.
• Fine tuning the Search Relevancy according to the business requirements.
• Develop Elastic alerting solutions using Watchers and Kibana.
• Generate Alerts that will integrate into Service Now/Jira for ticketing.
Qualifications:
• Bachelor’s degree in related field.
• Strong, analytical, focused, self-driven with excellent problem-solving skills.
• Minimum 5 years of hands on in-depth experience of AWS Data Pipelines development and implementation is required.
• AWS Associate or Professional level certifications is a plus.
