Benchmarking and Evaluation: How Do We Know What LLMs Can Do?

Name: Benchmarking and Evaluation: How Do We Know What LLMs Can Do?
Uploaded: 2024-06-13T11:11:22.000Z
Duration: 1 h 23 min 47 s
Channel: Jackie Chi Kit Cheung
Description: Jackie Chi Kit Cheung critically examines the methodologies for benchmarking and evaluating Large Language Models, addressing the challenges of assessing their…

Jackie Chi Kit Cheung

McGill University·Jackie Chi Kit Cheung

1:23:47

Notebook

Type below to lock the video timestamp, or press S to capture a slide.

Benchmarking and Evaluation: How Do We Know What LLMs Can Do?

Jackie Chi Kit Cheung McGill University

1:23:47·2024·graduate·Research Seminar

Jackie Chi Kit Cheung critically examines the methodologies for benchmarking and evaluating Large Language Models, addressing the challenges of assessing their true capabilities and limitations.

HOW DO WE KNOW WHAT LLMS CAN DO? BENCHMARKING AND EVALUATION

AI & ML Language Models & NLP Large Language Models (LLMs)Performance Optimization Natural Language Processing Benchmarking

About the lecturer

Speaker directory →

Jackie Chi Kit Cheung

Website Scholar GitHub

Professor of Computer Science

Jackie Chi Kit Cheung is a Professor of Computer Science at McGill University, specializing in natural language processing and the evaluation of large language models.

1 lecture in archiveView profile