ML Infrastructure Engineer

We're looking for an ML Infrastructure Engineer to join White Circle, an AI Safety company building the policy enforcement and optimization layer for AI systems. Backed by $11M from senior leaders at OpenAI, Anthropic, HuggingFace, Mistral, and DeepMind, White Circle processes 100M+ API calls monthly and runs its own LLMs in production.

You will

Build scalable RL and post-training pipelines, including smoke tuning runs for quality testing and ablations.

Design data control systems for rollouts, replay, filtering, evaluation, and policy updates.

Tune training and inference end-to-end for throughput: networking, memory, scheduling, data loading, storage, checkpointing, I/O.

Build infrastructure for model iteration (experiment runs, artifacts, evals, dashboards, reproducibility, cost visibility) and inference infrastructure for post-training and eval loops.

Build agentic development environments: coding-agent harnesses, tool integrations, runtime sandboxes, multi-agent orchestration.

Requirements

Hands-on experience designing and running distributed RL/post-training systems at scale (rollouts, replay buffers, reward signals, policy updates, eval loops).

Strong Python (concurrency, async, multiprocessing, performance optimization) and PyTorch or JAX.

Debugging distributed GPU workloads across CUDA, drivers, containers, NCCL, networking, storage, and checkpointing.

Profiling across the stack (py-spy, PyTorch profiler, Nsight, perf, tracing).

Inference stacks: vLLM, SGLang, TensorRT-LLM, Dynamo, or custom serving.

Ability to connect system metrics to model behavior and learning dynamics.

Relocation to Paris (hybrid) required.

Bonus

Public builder footprint: open-source contributions to RL, distributed ML, inference, eval, or agent infra; active technical presence on X.

Experience at high-bar AI infra/research teams (xAI, Qwen, ByteDance, Prime Intellect, or similar).

Ownership of custom training frameworks, trainers, schedulers, or data loaders.

GPU clusters on Kubernetes, Slurm, Ray; NCCL, RDMA, InfiniBand, RoCE, or EFA.

Rust, C++, CUDA, or Go; serious use of agentic coding tools (Claude Code, Codex, or similar).

We offer

Competitive salary + equity.

Hybrid work from Paris with relocation package.

Top-tier medical insurance in France and flexible time off.

L&D budget, all hardware and tools you need, plus covered AI agent and IDE subscriptions.

Team off-sites twice a year.

Find Jobs in France on Arbeitnow