PATEO has announced that it will put Nemotron and ByteDance's Doubao language models into its AI box for vehicles, which is built on NVIDIA's Thor chip. The key feature is that the box handles voice conversation and many other functions inside the car, even without an internet connection. Some vehicle programs have already been confirmed for supply, but mass production is expected in the second quarter of 2027.
PATEO, a Chinese auto parts maker, has put language models from NVIDIA and ByteDance into an AI box used inside cars. The key point is that voice recognition and responses work right in the car even when the internet connection is weak.
Large AI jobs often break in a chain reaction, where one error triggers many warnings, making it hard to find where the failure started. NVIDIA has released NVIDIA Attribution, an open-source tool that uses logs, metrics, and scheduler data together to point to the likely cause. The tool follows fixed rules, so the same input always produces the same result.
Large-scale AI training often stops because of hardware or software problems. NVIDIA Recovery is an open-source service that watches training jobs running on a cluster around the clock. When a stall happens, it finds the cause and handles recovery automatically. It is meant to reduce the burden of people checking logs day and night.
Configuring and optimizing Kubernetes for new GPU hardware such as NVIDIA Vera Rubin is complex and error-prone. Drivers, kernels, runtimes, networking,...
Physical AI developers working with world models face two distinct challenges: adapting models to their sensors, tasks, and data, and getting those models into...
In this video, I look at a research release from NVIDIA called Dory, which is a 4B looped transformer. HF: https://huggingface.co/collections/nvidia/nemotron-labs-dory 2nd Channel: https://www.youtube.com/channel/UCUF7WtR4JpVbQqcQGrLeADw Twitter: https://x.com/Sam_Witteveen 🕵️ Interested in building LLM Agents? Fill out the form below Building LLM Agents Form: https://drp.li/dIMes 👨💻Github: https://github.com/samwit/llm-tutorials ⏱️Time Stamps: 00:00 Intro 01:38 What is NVIDIA's Dory? 02:25 Specs 03:06 How a loop transformer works 06:24 The KV cache: per-loop vs last-loop 07:33 Loop Race demo 09:03 Chatting with Dory at 1, 2 and 4 loops 11:13 Benchmarks vs Gemma 4 26B 11:33 Where Dory wins and where it loses 13:06 Deploying Dory 14:26 Takeaways
Amazon Elastic Container Service (Amazon ECS) now supports GPU sharing with NVIDIA Multi-Process Service (MPS), enabling you to run multiple Amazon ECS tasks concurrently on a single NVIDIA GPU. GPU sharing helps you increase GPU utilization and reduce infrastructure costs for workloads that use only part of a GPU's capacity, such as small-model inference, AV/ADAS simulations, embedding generation, and multi-model serving. With GPU sharing, you can pack more workloads onto each GPU instance without changing your application code. You define the GPU memory each container needs and can optionally set a maximum share of GPU compute, and Amazon ECS places tasks on GPUs with available capacity as your services scale and deploy. GPU sharing is supported on Amazon ECS Managed Instances and Amazon ECS on Amazon EC2. On Amazon ECS Managed Instances, Amazon ECS also monitors the MPS control daemon that enables sharing on each instance. If the daemon stops or becomes unhealthy, Amazon ECS automat
Mistral is working with NVIDIA to build AI that helps with engineering tasks. The goal is to connect design, simulation (testing ideas on a computer before running real experiments), and product manufacturing in one flow. The focus areas are aerospace, automotive, and semiconductors.