ConceptAI & ML
Gumbel-softmax quantization
GSQ is a scalar quantization method that uses Gumbel-Softmax to optimize discrete quantization choices via gradients, closing most of the accuracy gap to trellis quantization while remaining compatible with standard INT grids and GGUF formats.
Know first
Named as a prerequisite by the lectures that define this. The number is how many say so. A grey one has no page yet.
Lecturers
1Connections
4The lectures that define it or assume it, and the concepts next to it.