Block-Wise Differentiable Sinkhorn Attention
A block-wise optimal-transport attention kernel with an exact tail-refinement adjoint, one-reference-tile schedule, and TPU-oriented JAX implementation.
Paper & implementationI’m Dylan, an AI engineer at Valeo and an independent researcher. I work on autonomous driving, efficient machine learning, and the infrastructure around it.
I’ll usually read the source code and trace what happens to the data before changing anything. It takes time, but I’d rather understand why something breaks.
A block-wise optimal-transport attention kernel with an exact tail-refinement adjoint, one-reference-tile schedule, and TPU-oriented JAX implementation.
Paper & implementationHow does a sparse transport graph shape the gradients that pass through it?
Paper & interactive figuresBuilt and optimized internal ML workflows spanning generative augmentation, trace processing, orchestration, and cross-cluster scheduling for perception workloads.
Variants → sequence reconstruction → peptide graphs → MHC ranking.
Estimate policy suitability before a changed environment exposes failure.
From my public Goodreads shelves · Snapshot: 2026-08-25