AI · វីដេអូ
Your LLM Judge Is Hallucinating Too — Brian Kennedy, ZoomInfo
AI Engineer ·
An English version of this summary isn't ready yet, so the Korean summary is shown below.
មើលត្រួសៗ
ZoomInfo의 엔지니어 Brian Kennedy가 AI 에이전트의 작업을 검사하는 LLM 판정기(LLM judge, AI가 다른 AI의 결과를 평가하는 도구)가 실제로는 얼마나 정확한지 살펴보는 영상이에요. 판정기가 에이전트가 주장한 내용을 실제 도구 결과보다 더 믿는 문제를 다뤄요.
ចំណុចសំខាន់ៗ
- 500개 실제 작업 단계를 점검했더니 판정기가 65%만 맞았어요.
- 한 번에 '이게 좋은가?'를 묻는 대신 작은 예/아니요 질문 7개로 나눠 확인하는 방식을 소개해요.
- 37,000건의 결정을 그림자 모드(실제 적용 없이 결과만 비교하는 방식)로 시험했더니 실패한 도구를 두 배 더 잡았어요.
- 같은 방식이 10배 빠르고 40배 저렴했다고 설명해요.
ហេតុអ្វីវាសំខាន់
AI 에이전트를 만들거나 운영하면서 결과를 자동으로 검증하려는 개발자와 제품 담당자에게 도움이 돼요.
ប្រភពដើម
Your LLM Judge Is Hallucinating Too — Brian Kennedy, ZoomInfo
AI Engineer · Nov 17, 05:16 KST
មើលនៅលើ YouTube ↗AI summarized the video title and description. Check the original for accuracy. Copyright belongs to AI Engineer.
បន្ថែមពីវិស័យនេះ
- Anthropic Mathematician Says Claude Helped Crack the Riemann Hypothesis
A video about a claim that an Anthropic mathematician, Levent Alpöge, used Claude to find a proof of the Riemann Hypothesis in about six weeks. The creator skips the heavy math and looks at what this could mean for AI and its future. The proof is still being checked.
TheAIGRID · Nov 21, 08:45 KST - Google Brings Duplex Calling to Gemini, Letting AI Phone Businesses for You
Google has moved its Duplex phone-calling technology into the Gemini app, so Gemini can now call businesses for you. The system has changed a lot since 2018, shifting from narrow custom models to a single stack built on Gemini.
Google Research blog · Nov 21, 08:30 KST - Google Releases Project Genie, an AI That Generates Explorable Worlds
Google has released Project Genie, an AI tool that creates interactive worlds you can explore. The video shows how to access it, walks through a generated world and a T-Rex demo, and discusses why this early technology matters.
The AI Advantage · Nov 21, 08:21 KST - Anthropic Employee Says Claude Helped Prove Riemann Hypothesis
An Anthropic employee and mathematician, Levent Alpöge, says he used the company's Claude chatbot to create a detailed proof of the Riemann hypothesis over about six weeks. The proof has not yet been checked, and it is over 250,000 lines long in Lean, a computer language used to confirm maths proofs.
BBC News · Nov 21, 08:08 KST