Sign inSign in
ConceptAI & ML

Retrieval-augmented generation

Retrieval-augmented generation is a technique that augments a language model by retrieving specific or domain knowledge documents to use as context for generating outputs.
as Steven Feng defines itStanford UniversityThe wording closest to all 8 definitions
Watch it explained

Know first

Named as a prerequisite by the lectures that define this. The number is how many say so. A grey one has no page yet.

Opens up

Concepts that name this one as a prerequisite.

Lecturers

7

Each in their own terms, from the easiest level.

  • Steven Feng

    Stanford University · Undergraduate

    A technique that retrieves relevant information from an external data store to augment the context and guide an LLM's output.
    • 35:26Overview of Transformers
  • Andrej Karpathy

    Undergraduate

    A technique where ChatGPT references chunks of text from uploaded files to use when creating responses.
    • 41:31Introduction to Large Language Models
  • Jeremy Howard

    Undergraduate

    Retrieval augmented generation uses search to find external documents that help a language model answer a specific question.
    • 1:10:29A Hacker's Guide to Language Models
  • Bryan Wilder

    UC Berkeley · Graduate

    A system that enhances language model responses by retrieving relevant information from an external knowledge base.
    • 2:56Evaluating Probabilistic Decision Making by LLMs: A Decision-Theoretic Framework and Application
  • Cheng Chen

    Carnegie Mellon University · Graduate

    RAG is a cost-efficient approach to generative AI that combines document retrieval with text generation using in-context learning.
    • 40:58SingleStore Database Overview
  • Douwe Kiela

    Stanford University · Graduate

    Coupling a language model to an external memory and retriever to provide retrieved context alongside the input and prompt.
    • 6:08Retrieval Augmented Language Models
  • Ravi Vats

    PyCon AU · Graduate

    RAG powered LLM applications are a subset of LLM applications where you embed or store information about historical user interaction or other data to use as context for better serving users or solving problems.
    • 1:25Ship Reliable RAG: Evals That Grow with Your Retrieval Complexity

Lectures that assume it

1

Connections

18

The lectures that define it or assume it, and the concepts next to it.

7 lecturers. Definitions are written by AI from each lecture’s transcript. A time with a play mark starts the lecture at the moment the lecturer says it.