R01 Research
Menterias
Local execution of large language models.
- Objective
- Enable large language models to run on controlled local hardware.
- Technical problem
- Large models often exceed the memory (VRAM) available on a single machine.
- Approach
- Research on weight streaming across SSD, RAM and VRAM, use of Mixture-of-Experts architectures and hardware-resource optimisation.
- Status
- R&D / prototype program, not commercialised at this stage.