feat: support for memory-mapping model weights#1414

Merged

leejet merged 10 commits into

leejet:masterfrom

wbruna:sd_mmap_weights

May 14, 2026

Commits on May 11, 2026

chore: drop pagecache after each lazy load to bound RAM

pwilkin
authored and
wbruna
committed
chore: tweak POSIX mmap support
wbruna
committed
fix: avoid context allocation failure due to memory-mapped weights

junmo-kim
authored and
wbruna
committed

Commits on May 14, 2026