Resource library

Showing 40 of 396

• Article
  Computing Machinery and IntelligenceArticle

  Alan Turing · The 1950 paper that introduced the imitation game.

  Used in The beginnings: 1950 to the first AI winters

• Article
  A Proposal for the Dartmouth Summer Research Project on AIArticle

  McCarthy, Minsky, Rochester, Shannon · The 1955 proposal that gave the field its name.

  Used in The beginnings: 1950 to the first AI winters

• Article
  History of artificial intelligenceArticle

  Wikipedia · A dated, well-sourced timeline of the early decades.

  Used in The beginnings: 1950 to the first AI winters

• Article
  Artificial intelligence: a brief historyArticle

  Our World in Data · Charts of how training compute, data and capability grew.

  Used in The beginnings: 1950 to the first AI winters

• Course
  Machine Learning SpecializationCourse

  Andrew Ng · The standard first course, free to audit.

  Used in Machine learning basics

• Course
  Intro to Machine LearningCourse

  Kaggle · Short hands-on lessons in the browser.

  Used in Machine learning basicsForecasting, fraud and anomaly detection

• Video
  Machine Learning FundamentalsVideo

  StatQuest · Clear videos on overfitting, bias and variance.

  Used in Machine learning basics

• Book
  The Hundred-Page Machine Learning BookBook

  Andriy Burkov · A compact overview, read first and pay if useful.

  Used in Machine learning basics

• Video
  But what is a neural network?Video

  3Blue1Brown · The best visual introduction to what networks compute.

  Used in Machine learning and the deep learning turnNeurons and networks

• Article
  ImageNet Classification with Deep Convolutional Neural NetworksArticle

  Krizhevsky, Sutskever, Hinton · The AlexNet paper.

  Used in Machine learning and the deep learning turn

• Article
  The Unreasonable Effectiveness of Recurrent Neural NetworksArticle

  Andrej Karpathy · A readable look at language models just before transformers.

  Used in Machine learning and the deep learning turn

• Paper
  Neural Machine Translation by Jointly Learning to Align and TranslatePaper

  Bahdanau, Cho, Bengio · Where the attention mechanism first appeared.

  Used in Machine learning and the deep learning turn

• Paper
  Attention Is All You NeedPaper

  Vaswani et al. · The transformer paper.

  Used in The transformer launch and the models that followedTransformers and attention

• Paper
  BERTPaper

  Devlin et al. · Bidirectional pretraining for understanding tasks.

  Used in The transformer launch and the models that followed

• Paper
  Language Models are Few-Shot LearnersPaper

  Brown et al. · The GPT-3 paper that showed in-context learning at scale.

  Used in The transformer launch and the models that followedThe prompt engineering era

• Paper
  Scaling Laws for Neural Language ModelsPaper

  Kaplan et al. · Loss as a power law in size, data and compute.

  Used in The transformer launch and the models that followedWhy bigger worked: scaling laws

• Paper
  Training Compute-Optimal Large Language ModelsPaper

  Hoffmann et al. · The Chinchilla paper on balancing parameters and tokens.

  Used in The transformer launch and the models that followedWhy bigger worked: scaling laws

• Article
  The Illustrated GPT-2Article

  Jay Alammar · A visual walk through a decoder-only transformer.

  Used in The transformer launch and the models that followed

• Article
  Scaling lawsArticle

  Epoch AI · A literature review of the evidence and its limits.

  Used in Why bigger worked: scaling laws

• Article
  Introducing ChatGPTArticle

  OpenAI · The announcement post from November 2022.

  Used in ChatGPT and how companies kept improving

• Paper
  Training language models to follow instructions with human feedbackPaper

  OpenAI · The InstructGPT paper.

  Used in ChatGPT and how companies kept improvingPretraining, fine-tuning and RL

• Paper
  Llama 2Paper

  Meta · A detailed open description of how a chat model is trained.

  Used in ChatGPT and how companies kept improving

• Article
  Learning to reason with LLMsArticle

  OpenAI · The o1 announcement of test-time reasoning.

  Used in ChatGPT and how companies kept improving

• Paper
  DeepSeek-R1Paper

  DeepSeek · An open recipe for reasoning via reinforcement learning.

  Used in ChatGPT and how companies kept improvingReasoning and thinking modelsReinforcement learning for reasoning

• Article
  State of AIArticle

  Air Street Capital · Yearly free report that summarizes research, industry and policy.

  Used in ChatGPT and how companies kept improving

• Tool
  roadmap.sh AI EngineerTool

  roadmap.sh · A community roadmap of the skills, to compare with this path.

  Used in What is an AI engineer?The map of the AI tooling stackCurated lists and roadmaps

• Article
  The Rise of the AI EngineerArticle

  swyx · The essay that named the role.

  Used in What is an AI engineer?

• Article
  Start AI Engineering in 2026Article★ 459

  Louis-François Bouchard · A learning guide organized by how you like to learn.

  Used in What is an AI engineer?The map of the AI tooling stackCurated lists and roadmaps

• Tool
  TiktokenizerTool

  Vercel · Paste text, see the exact tokens for different models.

  Used in Tokens and the context windowThe messages array, roles and model versions

• Video
  Let's build the GPT TokenizerVideo

  Andrej Karpathy · Two hours on why tokenization causes so many odd model behaviors.

  Used in Tokens and the context window

• Article
  Context RotArticle

  Chroma · Measures how model accuracy degrades as the input gets longer.

  Used in Tokens and the context windowHow context fails

• Article
  Effective context engineering for AI agentsArticle

  Anthropic · Treats context as a finite budget to spend carefully.

  Used in Tokens and the context windowContext engineeringCompaction, isolation and long contextMemory and stateSaving and resuming agent conversationsFrom prompts to agents to harnesses

• Video
  Intro to Large Language ModelsVideo

  Andrej Karpathy · One hour that gives the right mental model of what an LLM is.

  Used in Next-token prediction and sampling

• Video
  Large Language Models explained brieflyVideo

  3Blue1Brown · Eight minutes, the fastest accurate overview.

  Used in Next-token prediction and sampling

• Course
  Neural Networks: Zero to HeroCourse

  Andrej Karpathy · Builds a language model from a bigram counter up to GPT.

  Used in Next-token prediction and samplingBuild a small GPT from scratch

• Docs
  Messages API parametersDocs

  Anthropic · Temperature, top-p, top-k, max tokens and stop sequences.

  Used in Sampling parametersThe messages array, roles and model versions

• Article
  How to generate text: decoding methodsArticle

  Hugging Face · Greedy, beam, top-k and top-p, with code.

  Used in Sampling parameters

• Video
  Let's build GPT: from scratch, in code, spelled outVideo

  Andrej Karpathy · Sampling is built into the generation loop near the end.

  Used in Sampling parametersAttention in numbersBuild a small GPT from scratch

• Video
  Transformers, the tech behind LLMsVideo

  3Blue1Brown · The clearest animated explanation of embeddings and attention.

  Used in Transformers and attention

• Tool
  Transformer ExplainerTool

  Georgia Tech Polo Club · Runs GPT-2 in your browser and lets you change temperature live.

  Used in Transformers and attention