Do you host your own ML / AI / LLM? What do you use, and what do you use it for?

  • superglue@lemmy.dbzer0.com
    link
    fedilink
    English
    arrow-up
    5
    arrow-down
    3
    ·
    13 days ago

    I use my gaming rig to serve up qwen3.6-coder to Open Web UI and that’s been very successful in helping me refactor my home lab to be more effecient and easier to support. Over the years of building my server I got everything working, but lets just say it’s a bot of a mess and a lot of shortcuts were taken.

    I plan to look into ComfyUI soon but I do that have much of a use case for it at the moment.