• CompostMaterial@lemmy.world
    link
    fedilink
    English
    arrow-up
    36
    ·
    11 days ago

    I have a Ultra 9, 5090, and 64GB RAM. I can comfortably run a 32B model which gives me the speed and performance of the best GPT/Claude model from about two years ago. It is functional? Yes. Does it do good work? Meh. Does it compare with the latest code models out now? Not even close.