AI · ផ្លូវការ
Amazon Bedrock AgentCore Cuts Token Costs and Latency for Large JSON Workloads
Amazon AWS Machine Learning blog ·

មើលត្រួសៗ
Flightscape, an airline operations platform, built an AI agent that checks crew training schedules, and it handled 20 MB+ JSON files slowly and at high token cost. The team tried three ways to shrink what gets sent to the model each time, and their tests showed token use down by up to 71% and average latency down by up to 80%. The strategies also aim to keep the agent's reasoning working across long chats.
ចំណុចសំខាន់ៗ
- Flightscape's crew scheduling agent, built on Amazon Bedrock AgentCore, was slow with large JSON data, with average response times above 15 seconds.
- Each tool call sent the whole data file to the AI model, which raised token counts and costs and could fill the model's memory before finishing.
- The team used three strategies to limit the data passed to the model during each conversation turn.
- In tests on a 23 MB sample, token use fell by up to 71% and average latency fell by up to 80%.
ហេតុអ្វីវាសំខាន់
Large data sent to AI agents makes them costly and slow, so these methods can make production AI tools cheaper and more responsive.
ប្រភពដើម
Reducing token costs and latency in Amazon Bedrock AgentCore JSON workloads
Amazon AWS Machine Learning blog · Nov 18, 07:44 KST
Read on Amazon AWS Machine Learning blog ↗AI summarized the original article. Check the original for accuracy. Copyright belongs to Amazon AWS Machine Learning blog.
បន្ថែមពីវិស័យនេះ
- AWS Marketplace Lets AI Agents Buy Software on Their Own
AWS has updated its AWS Marketplace so AI agents can buy software, APIs, data, and content on their own, not just find them. Buyers pay in dollars, and charges are added to their AWS bill.
디지털투데이 · Nov 21, 07:37 KST - Amazon SageMaker HyperPod Global Inference Gateway Routes AI Requests Across Regions
Amazon SageMaker HyperPod now has a Global Inference Gateway that sends each request to the best cluster across regions through one endpoint. Before this, clients had to choose a cluster themselves, and a busy cluster could leave requests waiting while idle GPUs sat elsewhere.
Amazon AWS Machine Learning blog · Nov 21, 07:35 KST - Google Drops Search Button and Adds AI Sidebar to Its Search Homepage
Google has officially rolled out a redesigned desktop search homepage after a successful test. The Google Search button next to the search bar is gone, and a row of AI buttons now sits under the bar. Logged-in users also get a sidebar showing their recent AI Mode conversations.
Ars Technica · Nov 21, 06:58 KST - Meta Rethinks 2030 Net-Zero Goal as AI Data Center Emissions Hit Record High
Meta's 2026 sustainability report said the company is re-evaluating its 2030 net-zero goal. Its emissions rose about 40 percent from 2024 to 2025, the largest jump among the big US tech companies.
Ars Technica · Nov 21, 06:47 KST