Understand this story
Cohere announced that the confidential computing feature of Model Vault has entered public beta. The feature is based on the NVIDIA H100 GPU confidential computing capability on Microsoft Azure, providing hardware-level isolation for hosted model inference. According to the Cohere product and research blog, the scope of encryption extends from data at rest and in transit to prompts, documents, responses, and model execution during inference; after application payloads are end-to-end encrypted, they can only be decrypted in a confidential environment that has passed remote attestation. Customers can cryptographically verify the hardware, firmware, and software configuration before sending sensitive data, and the client will refuse to send requests when the security policy is not met. The existing Model Vault API and request format remain unchanged. The feature is currently in public beta.
AI-generated from public reports
Latest development · Report
Cohere Model Vault Launches Confidential Computing Public BetaDevelopments
1 confirmed developments
Cohere announces public beta of Model Vault confidential computing
Source:English text is being prepared.
Reports and discussion timeline
Browse reports and discussion by time. Their evidence levels remain distinct.
Oct 23
Cohere Product and Research BlogFirst-party
Cohere Model Vault Launches Confidential Computing Public Beta
Cohere announced that the confidential computing feature of Model Vault has entered public beta, providing hardware-level isolation for hosted model inference based on the NVIDIA H100 GPU confidential computing capability on Microsoft Azure. This feature extends the scope of encryption from data at rest and in transit to prompts, documents, responses, and model execution during inference; after end-to-end encryption on the application workload side, decryption can only occur in a confidential environment that has passed remote attestation. Customers can cryptographically verify the hardware, firmware, and software configuration before sending sensitive data; if it does not comply with the security policy, the client will refuse to send the request. The existing Model Vault API and request format remain unchanged.