Understand this story
On October 29, 2026, SecurityScorecard Inc. released the open-source benchmark TPRM Benchmark, designed to test AI models' ability to handle third-party risk management tasks and their ability to withstand attacks such as prompt injection and jailbreaking. According to SiliconANGLE, the capability tests are based on its own vendor risk telemetry data, with answers protected and inputs rotated; models receive autonomy ratings from L0 to L4 based on repeated trial results. The attack-resistance tests are conducted separately in the Model Security suite and are rated from A to F. The public version 2026.09 is available for download, and participants can submit results to a public leaderboard; officially expert-verified scores must be obtained through its internal tiers. There are currently no further developments.
AI-generated from public reports
Developments
1 confirmed developments
Reports and discussion timeline
Browse reports and discussion by time. Their evidence levels remain distinct.
Oct 29
SiliconANGLE
SecurityScorecard releases TPRM Benchmark to evaluate models' third-party risk capabilities and attack resistance
SecurityScorecard has released an open-source benchmark, TPRM Benchmark, for testing whether AI models can handle third-party risk management tasks and whether they can withstand attacks such as prompt injection and jailbreaking. The capability tests are based on its own vendor risk telemetry data, with protected answers and rotating inputs; models receive autonomy levels from L0 to L4 based on repeated trial results. The attack resistance tests are conducted separately in the Model Security suite and are rated from A to F. Public version 2026.09 is now available for download, and participants can submit results to a public leaderboard; official expert-verified scores must be obtained through its internal tiers.