[DRAFT] DO NOT MERGE Esm2 minifold#1541

Open

jomitchellnv wants to merge 36 commits into

mainfrom

Commits on Mar 31, 2026

Commits on Apr 1, 2026

Commits on Apr 6, 2026

enables layer-wise and component-wise low precision targeting
jomitchellnv
committed
sets layer components low precision to false except ffn
jomitchellnv
committed
removes torch.autocast and uses fsdp2 for autocasting to bf16
jomitchellnv
committed

Commits on Apr 7, 2026

Commits on Apr 8, 2026

1. Reshape einsum → torch.bmm (so we could swap in FP8 later)
Jonathan Mitchell
committed

Commits on Apr 9, 2026

better wandb quant stats logs and heatmaps
jomitchellnv
committed
tri-mul cutlass kernel 43% faster
Jonathan Mitchell
committed

Commits on Apr 14, 2026

adds FP8 Tri Mul attempts
Jonathan Mitchell
committed

Commits on Apr 15, 2026

variant B Code
Jonathan Mitchell
committed

Commits on Apr 16, 2026

status as of april 15 2026
Jonathan Mitchell
committed
cleanup April 15 2026
Jonathan Mitchell
committed
fixed cublas_xbdnn but no perf improvement
Jonathan Mitchell
committed
inference single config
Jonathan Mitchell
committed

Commits on Apr 17, 2026

runtime kernels configs for inference optimization finally cracks bf16
Jonathan Mitchell
committed
Add native transition fc1 fusion path and fix native extension
Jonathan Mitchell
committed
status as of friday april 17 2026
Jonathan Mitchell
committed

Commits on Apr 18, 2026

april 17 eod
Jonathan Mitchell
committed

Commits on Apr 21, 2026

bf16 decomposition
Jonathan Mitchell
committed

Commits on Apr 27, 2026

April 27 2026 need to reconcile
Jonathan Mitchell
committed
TOM
Jonathan Mitchell
committed