[calypso]

Jeli itko probao koristiti RAMDisk za lokalni AI deployment tipa DeepSeek ili nes slicno?

Postavio sam upit onom drugom statistickom pogadjalu (DeepSeek, jel...) za sto bi se dalo koristiti RAMDisk kod lokalne instalacije i ovo mi je napisalo...


What DeepSeek Can Use the RAMDisk For

Model Cache:
- Store frequently accessed model weights (if using llama.cpp or similar).

Temporary File Storage:
- Store intermediate files (logs, tokenized inputs).

Swap for Small-Batch Inference:
- If your system has limited RAM, a RAMDisk can help avoid SSD thrashing.

Faster Disk-Based KV Caching:
- Some inference engines allow offloading cache to disk - use RAMDisk for speed.



Best for:
- Small models (e.g., deepseek-coder-1.3b in 4-bit) that fit entirely in RAMDisk.
- Frequent disk I/O tasks (like caching prompts).