AI-generated editorial illustration; not a documentary photograph.
Baseten has launched an AI safety initiative through its Base Labs research arm, partnering with Hugging Face and Goodfire AI to develop evaluation and monitoring infrastructure for open-weight models. Announced on Wednesday, the project is intended to produce transparent safety methods that can be incorporated into model training and deployment.
Addressing removable safeguards
The partnership focuses on risks associated with open-weight models, whose parameters can be modified after release. One concern is abliteration, a technique used to remove safeguards from models. TechCrunch reported that Hugging Face currently lists more than 6,000 models described as abliterated, illustrating how widely such modifications are being distributed.
A proposed safety standard
Base Labs plans to develop and publish methods for training and monitoring open models. Baseten is presenting that work as a potential standard built into the model lifecycle, rather than a separate safety layer added after training or deployment. The company argues that access to model internals can make behavior more visible and help turn safety research into transparent controls.
The effort concerns open-weight models, a term that does not necessarily mean the models or their surrounding software meet open-source licensing requirements. Hugging Face is participating as a major host of openly distributed AI models, while Goodfire AI brings a focus on model interpretability and understanding how models reach decisions.
Technical details remain open
The three companies have not disclosed how the infrastructure will operate, what evaluations it will include or when any resulting standard will be available. Goodfire has indicated that safety controls should be embedded in open models and supported by the organizations serving them, but its specific responsibilities in the partnership have not been detailed.
Funding and participation
According to TechCrunch, Baseten raised a $1.5 billion Series F in June at a $13 billion valuation. Goodfire AI raised a $150 million Series B led by B Capital earlier in the year to develop its interpretability platform. Baseten has also invited developers beyond the three participating companies to contribute to the proposed framework.
Source: Base Labs launches an open-weight AI safety partnership with Hugging Face and Goodfire
SIGNAL TITANS
Leave a Reply