Scaling Laws for Code: Every Programming Language Matters
IntermediateJian Yang, Shawn Guo et al.Dec 15arXiv
Different programming languages scale differently when training code AI models, so treating them all the same wastes compute and lowers performance.
#multilingual code pre-training#scaling laws#language-specific scaling