Links from August 2023

Open LLM leaderboard - A Hugging Face space that compares and benchmarks various open-source Large Language Models in an open and reproducible way.

The last 12 months has seen explosive growth in open source (stable diffusion, llama, hugging face), open research and open datasets while the drive to censor/limit commercial/closed models makes them perform worse. Large companies appear not well suited to this pace such that there’s prediction that opensource will overtake closed source offerings.

Let’s build GPT:from scratch, in code, spelled out - An in-depth video tutorial demonstrating how to implement a GPT model from scratch, providing step-by-step code implementation.