2e97b905b462bd8983dc6a38ed492985bce95908
The remote model cannot be a llama-server that is simply left running: a resident 7-14B holds 16GB against the CPT runs the card is for. So what is always up on the workstation is a supervisor, and llama-server is loaded while the card is free. Still not a scheduler. It arbitrates nothing between callers, and Maven never asks it to start anything.
Merge pull request 'Voice cannot accept a routine (V-367); the last three prompts are Russian (V-404)' (#89) from fix/367-voice-parks-routine-accept into master
Description
No description provided
Languages
Go
97.1%
HTML
0.9%
Shell
0.6%
CSS
0.5%
Makefile
0.3%
Other
0.6%