←新闻详情

Wired AI更新于 10月25日 20:58

Hugging Face 发布开源 DNA 模型 Carbon-X,可在笔记本本地运行

Hugging Face’s New AI Biology Model Lets You Chat With DNA | WIRED

AI 导读

Hugging Face 周四发布开源 DNA 理解模型 Carbon-X,可在笔记本本地运行,用户能用自然语言询问 DNA 变化对基因活性和健康的影响。该模型与中关村学院和那不勒斯费德里科二世大学的研究者合作开发,基于已有语言模型扩展词表以六字母为单位读取 DNA,并在 3000 亿 token 的 DNA 序列、英文文本和 DNA 与生物描述对应样本上继续训练。模型为 14B 参数,单次可处理约 5 万碱基对的序列,不能上传完整人类基因组;开发者也说明尚未通过湿实验验证预测准确度。

推荐理由

AI 评分 71

Carbon-X 把 DNA 序列与自然语言放进同一个对话界面,并给出 14B 参数可本地运行的取舍,读者可据此判断基因组问答的可用边界。

主题

标签

正文

00Days:00Hours:00Minutes:00SecondsJoin us in MiamiSee the full lineup

The AI platform Hugging Face on Thursday released a new open-source model for understanding DNA that can run locally on a laptop.

Developed in collaboration with researchers at Zhongguancun Academy in China and the University of Naples Federico II in Italy, the model is trained on genomic sequences and natural language so that people can ask questions about the effects of DNA changes on gene activity and health and get conversational answers in return.

Lewis Tunstall, a senior research scientist at Hugging Face, says the tool is meant to help researchers design new drugs and genetic therapies, and it could potentially aid patients in interpreting their own genomes.

“We've unlocked a new capability in language models, which is fundamentally about being able to chat with DNA,” he says of the new model, dubbed Carbon-X. Using natural language means even nontechnical users “can actually ask questions about DNA that wouldn't be accessible through any other tool.”

Known as essentially GitHub for AI models, Hugging Face provides a library of readymade AI tools and a platform for running primarily open-weight and open-source AI applications for developers, researchers, businesses, and people who want to experiment with AI without building everything from scratch. In September, Nvidia agreed to acquire the company for nearly $13 billion. (Hugging Face was also at the center of a major hack by OpenAI’s models earlier this year.)

DNA is more like computer code than natural language. Instead of 0s and 1s, though, it uses As, Cs, Gs, and Ts to encode information. A human genome contains 6 billion of these letters. While the human genome has been sequenced end to end, scientists still don’t understand how most of it works.

Now, AI models are helping researchers decipher some of those mysteries. Last year, Google DeepMind released AlphaGenome, which predicts the effects of DNA sequences and genetic mutations but does so in a numeric format. It also requires more compute power. Evo 2, a model developed by the Arc Institute and Nvidia, along with academic partners, speaks the language of DNA and can generate entire genomes from scratch.

Carbon-X integrates both DNA and natural language in a conversational interface. Think of it like a ChatGPT for DNA.

The team started with an existing language model and expanded its vocabulary to read DNA in groups of six letters. They then continued training on 300 billion chunks of data, or tokens, that combined DNA sequences, English text, and examples linking DNA to biological descriptions. The DNA sequences came from mammals (including humans), other vertebrates, invertebrates, plants, fungi, and protozoa. Tunstall says the team didn’t train the model on viruses because they didn’t want it to be used for potentially dangerous applications.

Users won’t be able to upload full human genomes. The model was trained to be able to ingest DNA sequences of roughly 50,000 base pairs, so users will only be able to query small parts of the genome at a time.

One of the ways scientists could use Carbon-X is to help understand whether a genetic mutation is benign or disease-causing, a key step in developing a targeted drug or genetic therapy. If an intervention targets the wrong mutation, it could be totally ineffective or, worse, cause unintended harm.

Researchers face restrictions when it comes to uploading identifiable or sensitive patient data to frontier AI models, so Tunstall says his team intentionally designed a small model with 14 billion parameters. That will allow it to run locally on the user’s hardware, rather than rely on cloud-based models. No data is sent to Hugging Face or any other company, he says.

The developers of Carbon-X caution that they haven’t validated the model yet with actual wet lab experiments, so they can’t say how accurate its predictions are.

Introducing the app: More ways to make the most of WIRED

Why so many AI researchers think the technology could kill us all

The Big Interview: Patti Harrison had dreams of a tech utopia

I let an AI agent hack all my gadgets—and I’d do it again

来源

Wired AI