Cohere Model Vault Launches Confidential Computing Public Beta
Cohere announced that the confidential computing feature of Model Vault has entered public beta, providing hardware-level isolation for hosted model inference based on the NVIDIA H100 GPU confidential computing capability on Microsoft Azure. This feature extends the scope of encryption from data at rest and in transit to prompts, documents, responses, and model execution during inference; after end-to-end encryption on the application workload side, decryption can only occur in a confidential environment that has passed remote attestation. Customers can cryptographically verify the hardware, firmware, and software configuration before sending sensitive data; if it does not comply with the security policy, the client will refuse to send the request. The existing Model Vault API and request format remain unchanged.

Cohere announced that the confidential computing feature of Model Vault has entered public beta, providing hardware-level isolation for hosted model inference based on the NVIDIA H100 GPU confidential computing capability on Microsoft Azure. This feature extends the scope of encryption from data at rest and in transit to prompts, documents, responses, and model execution during inference; after end-to-end encryption on the application workload side, decryption can only occur in a confidential en
Matched fieldsSummary、Body


