Training large artificial neural networks is an art. It has long been known that high quality training data has significant impacts the improvement of large-scale models performance and can even alter the scaling laws related to model and data size. Following this approach, a Microsoft research team, in their new paper Textbooks Are All You Need, crafts ‘textbook quality’ data to train a large language model for code. The resulting phi-1 model surpasses th