←News detail

Ma Dongxi NLPUpdated Oct 30 14:12

Dongxi NLP Breaks Down Basic LLM Concepts: The Birth of a Token

English text is being prepared.

AI summary

Dongxi NLP published an article introducing a piece that breaks down the basic concepts of LLMs, covering chat, template, logits, detokenize, tokenize, KV cache, prefill, decode, and other stages.

Quoted post

English text is being prepared.

@dongxi_nlp

https://t.co/nTlZDRnQWp

View original

https://t.co/nTlZDRnQWp

View original post

Body

一颗 token 的诞生。

在这篇里,会把 LLM 的基本概念过一遍,包括:

chat, template logits, detokenize tokenize KV, cache prefill, decode https://t.co/a4FnblpEio

Source

Ma Dongxi NLP