ត្រឡប់ទៅព័ត៌មានវិញ

AI · អត្ថបទ

llama-modchip Runs 284B DeepSeek Model on 64GB RAM Without a GPU

GeekNews ·

មើលត្រួសៗ

llama-modchip is an open-source project that runs the DeepSeek-V4-Flash model on a computer with 64GB of memory and no graphics card (GPU). It compresses the model file and optimizes CPU calculations to make this possible. According to the project's own measurements, actual memory use in a 256K-token conversation was about 57.61 to 58.9GiB, and it did not use swap, which treats disk space as memory. These results are measured by the project itself.

ចំណុចសំខាន់ៗ

ហេតុអ្វីវាសំខាន់

It shows that large AI models may be run on personal computers without powerful GPUs. However, speed and answer quality vary depending on settings.

ប្រភពដើម

Llama-modchip: GPU 없이 64GB RAM에서 284B DeepSeek 실행

GeekNews · Nov 9, 00:32 KST

Read on GeekNews ↗

AI summarized the original article. Check the original for accuracy. Copyright belongs to GeekNews.

DeepSeek · ចំណាត់ថ្នាក់ និងព័ត៌មានបន្ថែម