• Jo Miran@lemmy.ml
    link
    fedilink
    English
    arrow-up
    3
    ·
    11 days ago

    It’s for work. I can throw quite a bit of money at it, but only if there’s a point.

    • Avid Amoeba@lemmy.ca
      link
      fedilink
      English
      arrow-up
      1
      ·
      edit-2
      11 days ago

      If there’s time and budget to play around with, perhaps get a “cheap” 2x R9700 + 128GB RAM system that can run Qwen 3.8 Flash Next and experiment. If it’s useful enough for your use cases, then get big enough hardware that can run this, which is better than QFN. It would also run the unquantized QFN and the next Qwen Flash version.

      You could also try them via their APIs or on cloud hardware you rent.

      My workplace, a well know NA corporation, has DeepSeek 4.1 Flash deployed on-prem and it’s in active use.