Zhipu May Launch Native Multimodal Model GLM-Omni
AI summary
X.PIN claims that Zhipu may launch a native multimodal model, GLM-Omni. This system combines image generation with text training, having the model draw out visual reasoning steps before answering, raising text question-answering accuracy from 12.57% to 41.14%. The author also jokes that this is like doodling during one's own exams.
Body
Zhipu AI might drop a native multimodal AI called GLM-Omni.
By pairing image generation and text training, the system allows the AI to draw out visual reasoning steps to look at before answering. This drove text QA accuracy up from 12.57% to 41.14%.
Basically me doodling during exams.