Back to news

AI · Video

Cartesia's H-Net Tries a Smarter Way to Split Text for AI Training

bycloud ·

At a glance

Cartesia's H-Net is a new way for AI models to handle text, moving past the traditional tokenization step. Instead of splitting text into fixed chunks, it learns to group raw bytes on its own. The video says this can train models much faster on selected tests and help them handle unfamiliar data better.

Key points

Original source

The current tokenization is suboptimal, and we just got a solution.

bycloud · Nov 23, 04:03 KST

Watch on YouTube ↗

AI summarized the video title and description. Check the original for accuracy. Copyright belongs to bycloud.

AI