Senior Data Engineer

About the Role Design and implement data engineering solutions by translating requirements into technical designs and building scalable data pipelines. Work across data integration, big data, analytics, cloud infrastructure, and data management platforms. Roles & Responsibilities • Translate client requirements into technical designs and implement data engineering solutions. • Design and implement data integration and big data solutions. • Build data ingestion, integration, and transformation functionality from heterogeneous sources in batch and real time. • Work with data storage and computation frameworks and optimize performance. • Build functionality for data analytics, search, and aggregation. • Work with analytics and visualization solutions. • Support infrastructure, cloud computing, and data management platforms. Key Skills • Hadoop ecosystem: HDFS, Sqoop, Kafka, Pulsar, NiFi, Spark, Spark Streaming, Flink, Hive, Oozie, Airflow • Java, Scala, or Python • NoSQL/MPP platforms: HBase, MongoDB, Cassandra, AWS Redshift, Azure SQL DW, GCP BigQuery • AWS data platform services • Batch and real-time data pipelines Nice to Have • Informatica, Talend, Oracle, MySQL, SQL Server, PostgreSQL • Data governance, security, lineage, and catalog tools such as Collibra and Alation • ActiveMQ, RabbitMQ, Solace, search/indexing, and microservices • Data pipeline performance tuning and optimization • Cloud data and Big Data certifications Benefits (W2) • Health insurance • Health savings account • Dental insurance • Vision insurance • Flexible spending accounts • Life insurance • Retirement plan EEO Statement All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.