Largest R1, as in the 671B? How do you accomplish that feat? | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		btbuildem 10 months ago \| parent \| context \| favorite \| on: Complete hardware and software setup for running D... Largest R1, as in the 671B? How do you accomplish that feat?

oynqr 10 months ago [–]

Just do it? Llama.cpp doesn't load the entire thing into ram. It mmaps the file and the kernel takes care of the rest.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact