Data Engineer for Autonomous Defense Systems

About the role

Harmattan AI is building next‑generation autonomous defense systems. As a Data Engineer you will own the data layer that feeds machine‑learning models, turning raw field logs and public datasets into clean, versioned, training‑ready data.

Key responsibilities

• Ingest, decode and store large volumes of unstructured sensor data (video, audio, other streams) into efficient formats.
• Align multimodal data streams temporally and spatially for model consumption.
• Curate, filter, de‑duplicate and revise ingested data and public datasets.
• Define data and labeling requirements, manage dataset‑construction workflows and tooling.
• Version datasets, maintain lineage and ensure reproducible training runs.
• Store data in columnar or sharded formats and manage tiered storage to balance cost and latency.

Required profile

• Degree in a STEM field or equivalent practical experience.
• Proven experience building and maintaining pipelines for large unstructured data at scale.
• Systematic, quality‑mindset and service‑oriented attitude toward model developers.

Required skills

• Strong Python programming.
• Data‑engineering expertise, including pipeline design and optimization.
• Experience optimizing data loaders for training frameworks such as PyTorch.