Jobiglo

No results.

Data Engineer – Ingestion & Dataset Construction

Harmattan AI · Lausanne

New
🇬🇧 English
Python Data engineering PyTorch

Job description

About the role

Our ML teams train models on datasets derived from large volumes of raw, unstructured data, and model quality depends directly on data quality. As a Data Engineer operating out of Paris, Lausanne, or Zurich, you will own the data layer that feeds the team's models, turning terabytes of raw field logs and public datasets into clean, versioned, training‑ready data.

Key responsibilities

  • Ingest, decode, and store raw, unstructured field data (video and sensor streams) into efficient, controlled formats.
  • Align multiple data streams temporally and spatially for multimodal training.
  • Parse, filter, de‑duplicate, and curate both ingested and public datasets into high‑value data.
  • Define data collection and labeling requirements, own dataset‑construction workflow and tooling.
  • Build task‑specific datasets, maintain versioning and lineage, and store data in training‑ready formats while managing storage tiering.
  • Deliver clean, documented datasets and loading tools to keep model training I/O‑bound.

Required profile

  • Degree in a STEM field or equivalent practical experience.
  • Proven experience building and maintaining pipelines for large‑scale unstructured data (video, images, sensor data).
  • Strong Python programming skills and ability to optimise data loaders for frameworks such as PyTorch.
  • Systematic, quality‑minded, pragmatic, and service‑oriented attitude.
  • Full commitment to the mission of providing defensive edge technology.

Required skills

  • Python
  • Data engineering (pipeline design, ingestion, storage, curation, versioning)
  • PyTorch (or similar training frameworks)
  • Columnar and sharded data formats
  • Distributed data processing tools

Questions fréquentes

Le salaire n'est pas communiqué publiquement par le recruteur. Vous pouvez postuler et négocier directement avec Harmattan AI.
Cliquez sur "Postuler maintenant" en haut de la page. Vous pouvez importer votre CV en 1 clic — Jobiglo extrait automatiquement vos informations et postule pour vous.

Why are you reporting this job?

Thank you for your report. We will review this job.

Apply in 30 seconds

Enter your email to apply. An account will be created automatically.

By continuing, you accept our terms of use.

Already have an account? Login

💬 Chat with us on Telegram Chat on WhatsApp

Published 2 hours ago

Expires 1 month from now

6 views · 0 interested

Boost your chances

Upload your CV — we will match you with relevant openings.

Analyzing your CV...

Harmattan AI

Lausanne