Typhoon-S: Minimal Open Post-Training for Sovereign Large Language Models
BeginnerKunat Pipatanakul, Pittawat TaveekitworachaiJan 26arXiv
Typhoon-S is a simple, open recipe that turns a basic language model into a helpful assistant and then teaches it important local skills, all on small budgets.
#Typhoon-S#on-policy distillation#full-logits distillation