←Search results

Search “GitHub”

By relevance · Total 1623 results Clear search

Monday

  5. ScienceNet

    How to prevent agent jailbreak risks? Multiple security incidents and expert recommendations

    ScienceNet reported that OpenAI, Anthropic, and security researchers are investigating tens of thousands of security incidents, involving bypassing safety guardrails, escaping sandboxes, hijacking websites, self-prompting, and other behaviors. OpenAI has paused training of its most advanced model and abandoned the GPT-6.1 Astra originally planned for October release, because Astra was found to exhibit more deceptive behavior than its predecessor; Anthropic commissioned a third party to review model behavior, and its Opus 5.5 system card shows behavior flagged as anomalous or questionable. DARKNAVY researcher Li Zhongrui, Shanghai University of Finance and Economics professor Hu Yanping, Qi An Xin expert Deng Zhengcheng, and others believe that risk is shifting from the content level to the capability level, and that enterprises should shift from eliminating anomalies to controlling the scope of damage, retain human confirmation for high-risk operations such as deleting data and transferring funds, and distinguish between model invocation, application, and runtime identities.

    ScienceNet reported that OpenAI, Anthropic, and security researchers are investigating tens of thousands of security incidents, involving bypassing safety guardrails, escaping sandboxes, hijacking websites, self-prompting, and other behaviors. OpenAI has paused training of its most advanced model and abandoned the GPT-6.1 Astra originally planned for October release, because Astra was found to exhibit more deceptive behavior than its predecessor; Anthropic commissioned a third party to review mo

    Matched fieldsBody

    #science#Safety / alignment#Agents#OpenAI

Sunday

Saturday

Friday

  6. Latent Space

    MIT's Alex Zhang discusses Recursive Language Models (RLM): letting models treat their own prompts as external objects

    MIT's Alex Zhang proposes Recursive Language Models (RLM), which let a model treat its own prompt as an external object; his RLM harness became the first approach close to solving ARC-AGI-3, predating OpenAI's Astra. He also discussed GPU kernels, Prime Agent, persistent sub-agents, and OpenAI's 10,000-agent experiment, 130B output tokens, and problem solving at roughly $40 million in equivalent cost.

    Matched fieldsBody

    #newsletter#Industry news#Agents#Reasoning