Cohere announces public beta of Model Vault confidential computing
Cohere announced that the confidential computing feature of Model Vault has entered public beta. The feature is based on the NVIDIA H100 GPU confidential computing capability on Microsoft Azure, providing hardware-level isolation for hosted model inference. According to the Cohere product and research blog, the scope of encryption extends from data at rest and in transit to prompts, documents, responses, and model execution during inference; after application payloads are end-to-end encrypted, they can only be decrypted in a confidential environment that has passed remote attestation. Customers can cryptographically verify the hardware, firmware, and software configuration before sending sensitive data, and the client will refuse to send requests when the security policy is not met. The existing Model Vault API and request format remain unchanged. The feature is currently in public beta.
Cohere announced that the confidential computing feature of Model Vault has entered public beta. The feature is based on the NVIDIA H100 GPU confidential computing capability on Microsoft Azure, providing hardware-level isolation for hosted model inference. According to the Cohere product and research blog, the scope of encryption extends from data at rest and in transit to prompts, documents, responses, and model execution during inference; after application payloads are end-to-end encrypted, t
Matched fieldsSummary