Ring Attention for Long-Context Protein Structure Prediction
Research PhaseSummer 2026 work at Lawrence Livermore National Laboratory with Tal Ben-Nun and Brian Van Essen. Integrated ring attention into OpenFold, splitting long-sequence attention across a ring of GPUs so no single device holds the full attention matrix, with a Triton kernel implementation. This made full-length structure prediction of Human Nebulin (NEBU_HUMAN, 8,525 residues) possible where baseline OpenFold runs out of memory.