AI · ផ្លូវការ
Google Launches MKA Benchmark for Visually Complex Knowledge Work
Google Gemini products ·

មើលត្រួសៗ
Google DeepMind, working with Artificial Analysis, released MKA (Multimodal Knowledge Agent), a benchmark that tests how well AI agents (AI that carries out multi-step tasks on its own) handle work where visuals and layout matter, such as blueprints, schematics, reports, and spreadsheets. It includes 200 tasks written by domain experts across 10 fields and 83 occupations.
ចំណុចសំខាន់ៗ
- Each task is a multi-step job that takes a skilled professional three to eight hours and is graded with about 70 yes/no checks.
- Scoring weights factual accuracy at 75% and visual design at 25%.
- Grading is done by an AI from a non-Google company, which matched expert grades 96% of the time.
- Ten public tasks are on Hugging Face, while the 200-task set stays private.
ហេតុអ្វីវាសំខាន់
It gives a way to measure whether AI can handle real work that depends on images and document layout, not just text. Because models differ widely in how many steps they need, it also helps compare efficiency.
ប្រភពដើម
Introducing the Multimodal Knowledge Agent benchmark
Google Gemini products · Nov 11, 01:00 KST
Read on Google Gemini products ↗AI summarized the original article. Check the original for accuracy. Copyright belongs to Google Gemini products.
បន្ថែមពីវិស័យនេះ
- OpenAI Shows How to Claim a Shopify Store in ChatGPT
This video shows how to claim your business in ChatGPT by connecting your Shopify store. You can start in Business Hub or the Shopify App Store. After connecting, you can manage your business information to control how your store appears in ChatGPT.
OpenAI 공식 YouTube · Nov 21, 05:48 KST - OpenAI Sharply Cuts Success of Attacks on GPT-6.2 Astra and Sol Reasoning
OpenAI has greatly strengthened its defenses against attempts to pull the hidden reasoning out of its latest models, GPT-6.2 Astra and GPT-6.2 Sol. In its own internal tests, the success rate of these attacks fell sharply, and OpenAI says it is now bringing some of these improvements to GPT-6 Astra too.
The Decoder · Nov 21, 05:31 KST - Amazon Textract Insights Launches for Verifiable Document Data Extraction
Amazon has launched Amazon Textract Insights, a generative AI feature that pulls specific fields from documents. Users describe the data they want in plain language and get results with a confidence score and the page each value came from. Mixed files, such as a mortgage packet, can be split and matched automatically.
Amazon AWS Machine Learning blog · Nov 21, 05:22 KST - Etsy Sellers Close Shops Over New Policy Allowing AI Training on Their Work
Many longtime sellers on Etsy, the handmade goods marketplace, have closed their shops over new terms that let the company and its partners use seller content to train artificial intelligence. The terms take effect on Dec. 16. Etsy has defended the policy.
The New York Times · Nov 21, 05:19 KST