Horizon-LM: A RAM-Centric Architecture for LLM Training
IntermediateZhengqing Yuan, Lichao Sun et al.Feb 4arXiv
Horizon-LM flips the usual training setup by keeping all long-term model stuff in the computerβs RAM (CPU) and using the GPU only as a fast, temporary calculator.
#Horizon-LM#memory-centric training#CPU-master GPU-template