• Hexarei@beehaw.org
    link
    fedilink
    arrow-up
    2
    ·
    2 days ago

    I just run the llama-swap docker container with a config file mounted, set to listen for config changes so I don’t have to restart it to add new models. I don’t have a guide besides the README for llama-swap.