Data Engineer

Are you a Senior Data Engineer with strong AWS and DynamoDB experience who enjoys building data platforms from the ground up? This role focuses on building an AI-powered analytics layer on top of a network security data platform, helping turn complex operational data into clear, actionable insights. You’ll be working with large volumes of network and security log data from industrial environments, designing the core data infrastructure and enabling visibility through BI dashboards used by stakeholders. Your Role as a Senior Data Engineer: You will take ownership of designing and implementing the data layer that underpins security analytics use cases. This includes structuring high-volume event data, building reliable pipelines, and enabling downstream analytics. This is a hands-on role, working closely with an AI/Analytics specialist and domain experts to ensure the data platform is scalable, reliable, and aligned with real-world security requirements. What You’ll Do: • Design and implement a DynamoDB database for high-volume, time-series network and security data • Define table structures, partition and sort keys, and indexing strategies for performance and scalability • Optimise cost and performance using DynamoDB features (capacity modes, TTL, streams, indexing strategies) • Build robust ETL pipelines to ingest data from Excel, CSVs, and API sources • Clean, validate, and normalise complex, multi-source security data • Automate pipeline orchestration, scheduling, and error handling • Connect the data layer to AWS QuickSight and build interactive dashboards • Design datasets, calculated fields, and visualisations to surface actionable insights • Collaborate with domain experts and stakeholders to translate requirements into data solutions • Produce clear technical documentation (schemas, pipelines, data definitions, runbooks) What You’ll Bring: • Strong hands-on experience with DynamoDB (data modelling, GSIs, performance tuning) • Proven experience building ETL/ELT pipelines in Python (pandas, boto3, etc.) • Solid AWS experience (S3, Lambda, IAM, CloudWatch and related services) • Experience with AWS QuickSight for dashboarding and BI delivery • Strong understanding of NoSQL data modelling and high-throughput data systems • Experience working with messy, multi-format data and implementing data quality checks • Strong Python skills with clean coding practices and version control (Git) • Ability to communicate clearly and work with both technical and non-technical stakeholders Nice to Have: • Experience with AWS Glue and Athena • Exposure to graph databases (Neo4j, Amazon Neptune) • Experience with CI/CD for data pipelines • Background in cybersecurity, network data, or similar domains • Understanding of event-based data structures (process mining or similar) • Experience using AI-assisted development tools Why Join the Remobi community: • Fully/90% remote, b2b/freelance contracts • Opportunity to work on high-impact data and AI programmes for largescale enterprise clients. • Access to a network of experienced data, AI, and engineering professionals 👉 Apply today: If you’re comfortable building data platforms for complex, real-world use cases and want to work on security-focused analytics, apply now!