推荐基于ggml的近期项目
Some cool ggml-based work by @mudler_it recently - make sure to check it out.
@mudler_it 最近做了一些很酷的基于 ggml 的工作——一定要去看看。
查看原帖locate-anything.cpp: native C++/ggml (@ggml_org) inference for @NVIDIA's LocateAnything-3B, open-vocabulary object detection / visual grounding, one of the neat detection VLMs out there, from the @LocalAI_API team. Same detections as the official model, now running anywhere with no Python and faster, on CPU and GPU. Quantized GGUF on @huggingface 🤗 Huge…
展开完整原文
locate-anything.cpp: native C++/ggml (@ggml_org) inference for @NVIDIA's LocateAnything-3B, open-vocabulary object detection / visual grounding, one of the neat detection VLMs out there, from the @LocalAI_API team. Same detections as the official model, now running anywhere with no Python and faster, on CPU and GPU. Quantized GGUF on @huggingface 🤗 Huge thanks to @ggerganov for ggml and to @NVIDIAAI for releasing LocateAnything! 🧵
正文
当前显示原文，中文全文译文尚未就绪。
Some cool ggml-based work by @mudler_it recently - make sure to check it out.