Study notebook

Press N to jot a timestamped note or B to pin a moment while watching.

Accelerating the Zig Tokenizer with AVX-512

Niles Salter Software You Can Love

49:25·2026·graduate level·Conference Talk

A detailed presentation on optimizing tokenizer performance in the Zig programming language, leveraging the AVX-512 instruction set for high-throughput text processing.

Systems & CS AI & ML Language Models & NLP Programming Languages Computer Architecture compiler design

Referenced inLobste.rs

Seminar notes & discussion

Sign in to comment

No public seminar notes on this lecture yet.

Related lectures

Code Matters: Reflections on Rust in the LLM Age

Bryan Cantrill · Oxide Computer Company

Shared subfield · Language Models & NLP & Programming Languages

Compiler 2.0: Building the Next Generation of Compilers with Machine Learning

Saman Amarasinghe · MIT

Shared subfield · Programming Languages & Computer Architecture

Let's Reproduce GPT-2 (124M): Distributed PyTorch, FlashAttention & FineWeb

Andrej Karpathy · Eureka Labs

Shared subfield · Language Models & NLP & Computer Architecture

Thinking Like a Compiler: Obfuscation from the Other Side by Laurie Kirk (RE//verse 2026)

Laurie Kirk · RE//verse Conference

Shared subfield · Programming Languages & compiler design

The Future of Programming: Reflections from a Harvard Seminar

Nada Amin · Harvard University

Shared subfield · Language Models & NLP & Programming Languages

Mojo: Modular's Unified Device Accelerator Language

GPU MODE

Shared subfield · Programming Languages & Computer Architecture