Dongxi NLP Post-Training Series Part 3: LoRA and QLoRA
English text is being prepared.
AI summary
The third article in the Dongxi NLP post-training series focuses on LoRA and QLoRA, organized around three basic concepts: rank, low-rank approximation, and quantization. The author points out that these three concepts can be tied together by a single concept, namely the pattern in a matrix.
View original posthttps://t.co/rXRTou2oBs
View original
https://t.co/rXRTou2oBs
Body
后训练文章系列第三篇,关于 LoRA 和 QLoRA
三个重要的基本概念: rank 秩 low-rank approximation 低秩近似 quantization 量化
它们可以用同一个概念串起来,即矩阵中的 pattern模式。 https://t.co/U3dK7Ew3OJ