←News detail

Ma Dongxi NLPUpdated Oct 25 23:41

Dongxi NLP Post-Training Series Part 3: LoRA and QLoRA

English text is being prepared.

AI summary

The third article in the Dongxi NLP post-training series focuses on LoRA and QLoRA, organized around three basic concepts: rank, low-rank approximation, and quantization. The author points out that these three concepts can be tied together by a single concept, namely the pattern in a matrix.

Quoted post

English text is being prepared.

@dongxi_nlp

https://t.co/rXRTou2oBs

View original

https://t.co/rXRTou2oBs

View original post

Body

后训练文章系列第三篇,关于 LoRA 和 QLoRA

三个重要的基本概念: rank 秩 low-rank approximation 低秩近似 quantization 量化

它们可以用同一个概念串起来,即矩阵中的 pattern模式。 https://t.co/U3dK7Ew3OJ

Source

Ma Dongxi NLP