Understand this story
On September 16, 2026, Baseten and Base Labs announced a joint effort with Goodfire and Hugging Face to build safety evaluation and monitoring infrastructure for the open-source models they serve, integrating safety research directly into training and inference systems. The work covers three areas: the training phase, where models are made to follow explicit policies, recognize the boundaries of their capabilities, and proactively seek help; the monitoring and intervention phase, which studies inputs, outputs, tool calls, and models' internal states, and connects signals to permissions, isolation, and pre-execution checks; and learning from failures. In terms of division of labor, Base Labs is responsible for developing and publicly releasing the methods, while Baseten integrates them into its deployment infrastructure, offering them as a hosted service and publishing the methods and evidence so that customers and external evaluators can verify them independently. There are currently no further developments.
AI-generated from public reports
Developments
1 confirmed developments
- Source:Baseten Base Labs: ModelsResearch
Reports and discussion timeline
Browse reports and discussion by time. Their evidence levels remain distinct.
Sep 16
Baseten Base Labs: Model ResearchFirst-party
Baseten Partners with Goodfire and Hugging Face to Build Open-Source Model Safety Evaluation and Monitoring Infrastructure
Baseten and Base Labs announced a joint effort with Goodfire and Hugging Face to build safety evaluation and monitoring infrastructure for the open-source models they serve, integrating safety research directly into training and inference systems. The work covers three stages: training (getting models to follow explicit policies, recognize capability boundaries, and proactively ask for help), monitoring and intervention (studying inputs, outputs, tool calls, and model internal states, and connecting signals to permissions, isolation, and pre-execution checks), and learning from failures. Base Labs is responsible for developing and publishing the methods, while Baseten integrates them into its deployment infrastructure, offering them as a hosted service and publishing the methods and evidence so customers and external evaluators can verify them independently.