• hirihit640@sh.itjust.works
    link
    fedilink
    English
    arrow-up
    5
    ·
    3 days ago

    I don’t get the negative comments here. This is the c/LocalLLaMa community, and this post is about adding 16 GB of VRAM for fairly cheap. This feels perfectly useful and appropriate.

    For reference, the GPU used is the Tesla V100 SXM2 16GB. The author adds that:

    The V100 SXM2 is not the only option. The P40 gives you 24GB for similar money, though it is slower and has no Tensor Cores. The V100 32GB variant costs more but still undercuts any consumer GPU with that much VRAM.