• sebastiancarlos@lemmy.sdf.orgOP
    link
    fedilink
    arrow-up
    1
    ·
    edit-2
    2 days ago

    Yes. The idea is that you can have any tool on one side (which expects an OpenAI-like LLM API, which is a bit of a de facto standard), and any LLM on the other side (which can be an agent subscription).

    I used this, for example, to test GraphRAG locally (which is designed to make a lot of LLM API calls) by piping it to an agent subscription I already had (and not needing to buy expensive API tokens for the low volume I needed).