PrismML 将微型 LLM 带入高通骁龙智能眼镜
PrismML brings its tiny LLMs to Qualcomm-powered smart glasses
PrismML 在高通骁龙峰会上展示了 1-bit Bonsai LLM，可在基于 Snapdragon AR1 Gen 1 平台的 AI 智能眼镜上本地运行。该智能眼镜版本是 20 亿参数的视觉语言模型，支持佩戴者实时询问眼前所见，模型体积缩小 4 倍仍保留标准基准上的几乎全部性能。目前尚无搭载 PrismML 的智能眼镜产品发布。
正文
当前显示原文，中文全文译文尚未就绪。
The AI Lab PrismML — founded by Caltech researchers and advised by UC Berkeley’s Ion Stoica — has created a version of its tiny language models for smart glasses running on Qualcomm’s Snapdragon chips.
On Wednesday, at Qualcomm’s Snapdragon Summit, the chipmaker showcased PrismML’s 1-bit Bonsai LLM, which can be run locally on AI smart glasses built on the Snapdragon AR1 Gen 1 Platform.
As TechCrunch previously reported, PrismML’s claim to fame is that it shrinks larger models substantially (in this case, by 4x), while retaining almost all of their performance on standard benchmarks. The smart glasses version is a 2-billion-parameter model tuned for vision and language, so wearers can ask what they’re looking at in real time.
Prism’s larger goal is open-weight AI that runs on devices and makes better use of the computing power they already have. The startup pitches this as an alternative to depending on the privacy promises of proprietary AI labs and their insatiable need for more compute.
Releasing a model for Qualcomm’s chip is a step toward that vision. But no smart glasses running PrismML have been announced yet.