Do you host your own ML / AI / LLM? What do you use, and what do you use it for?

  • dieTasse@feddit.org
    link
    fedilink
    English
    arrow-up
    5
    arrow-down
    1
    ·
    6 hours ago

    Dont waste 5k on an ai computer. Of you want new one, buy for 2k at most. Ai will get optimized more and more. Now we have MoE with which we can run things at home we couldn’t even dream about. The companies loose money fast, there will be massive optimization sooner or later.

    • irmadlad@lemmy.world
      link
      fedilink
      English
      arrow-up
      2
      arrow-down
      1
      ·
      6 hours ago

      Perhaps, but I probably won’t be around for that massive optimization. LOL