AI · Article
Anthropic Unveils FlashProve, a Tool to Verify an AI Response Came From the Promised Model
GeekNews ·
At a glance
Anthropic has released FlashProve, a research tool that checks whether an AI response was actually produced by the specified model. Users can inspect responses without downloading the model files. It is still experimental and works only under some conditions.
Key points
- The model provider publishes a fingerprint (commitment) of the model in advance and attaches a proof file to each response.
- Users can check the proof file without the model weights to see whether the model was swapped for a different one.
- Currently it verifies only the method of picking the most probable word at each step, within a range of up to 1,024 tokens.
- Creating a proof takes more than 70 times the GPU time of ordinary inference, so the cost is still high.
Why it matters
AI services could secretly switch to cheaper models or manipulate responses without users easily noticing. This is an attempt to use technology to check that trust issue, which makes it important.
Original source
대규모 언어 모델의 검증 가능한 추론 연구 진전
GeekNews · Nov 5, 08:35 KST
Read on GeekNews ↗AI summarized the original article. Check the original for accuracy. Copyright belongs to GeekNews.
Anthropic · Ranking and more news
More from this field
- Anthropic Mathematician Says Claude Helped Crack the Riemann Hypothesis
A video about a claim that an Anthropic mathematician, Levent Alpöge, used Claude to find a proof of the Riemann Hypothesis in about six weeks. The creator skips the heavy math and looks at what this could mean for AI and its future. The proof is still being checked.
TheAIGRID · Nov 21, 08:45 KST - Google Brings Duplex Calling to Gemini, Letting AI Phone Businesses for You
Google has moved its Duplex phone-calling technology into the Gemini app, so Gemini can now call businesses for you. The system has changed a lot since 2018, shifting from narrow custom models to a single stack built on Gemini.
Google Research blog · Nov 21, 08:30 KST - Google Releases Project Genie, an AI That Generates Explorable Worlds
Google has released Project Genie, an AI tool that creates interactive worlds you can explore. The video shows how to access it, walks through a generated world and a T-Rex demo, and discusses why this early technology matters.
The AI Advantage · Nov 21, 08:21 KST - Anthropic Employee Says Claude Helped Prove Riemann Hypothesis
An Anthropic employee and mathematician, Levent Alpöge, says he used the company's Claude chatbot to create a detailed proof of the Riemann hypothesis over about six weeks. The proof has not yet been checked, and it is over 250,000 lines long in Lean, a computer language used to confirm maths proofs.
BBC News · Nov 21, 08:08 KST