AI · អត្ថបទ
Nvidia Researchers Say Huge AI Context Windows May Be a Dead End
The Decoder ·

មើលត្រួសៗ
Nvidia researchers say very large AI context windows, which let models read whole novels at once, are often unnecessary and costly. In many tests, periodic summaries and targeted lookups worked about as well.
ចំណុចសំខាន់ៗ
- A context window is the AI's working memory, holding everything it can see while writing a reply.
- Context windows have grown quickly; GPT-4 started with 8,192 tokens in March 2023.
- The article says a current model handles about one million tokens, roughly 120 times more.
- In many tests, summaries and targeted lookups performed about as well as huge windows.
ហេតុអ្វីវាសំខាន់
Bigger is not always better, and shorter methods could save money on AI tools.
ប្រភពដើម
Nvidia researchers argue huge AI context windows are a dead end
The Decoder · Nov 22, 01:23 KST
Read on The Decoder ↗AI summarized the original article. Check the original for accuracy. Copyright belongs to The Decoder.
បន្ថែមពីវិស័យនេះ
- Albanese Talks Sovereignty, but Australia Still Relies Heavily on US Tech Giants
Australia's prime minister Anthony Albanese often talks about sovereignty, or national control, but the country still depends heavily on US tech platforms. An outage at Microsoft recently stopped government, business and daily life across the world. The author says the country's reliance on the US is still not being fixed.
The Guardian · Nov 22, 04:00 KST - AI Uncovers Old Software Flaw as Outages Hit Banks, Microsoft and Flights
Security researcher Paulos Yibelo says AI helped him find a serious flaw, called Upload2Shell, in widely used document and image software. The flaw could let hackers break into many companies just by uploading a file. Companies have since released patches.
The New York Times · Nov 22, 02:50 KST - Several AI Agents Can Now Handle Tasks Right From Your Text Messages
A growing number of AI agents can be used just by texting them, with no extra app to download. Users can ask them to schedule things, set reminders, plan trips, or handle other everyday tasks.
TechCrunch · Nov 22, 02:00 KST - LangChain Explains How to Build a Knowledge Factory for AI Agents
LangChain argues that making AI useful for a company depends less on better models and more on structured company knowledge. It describes a 'knowledge factory,' a system for collecting, organizing, and keeping that knowledge up to date so agents can use it. The article shares what LangChain has learned from building its own version.
LangChain blog · Nov 22, 01:45 KST