cross-posted from: https://lemmy.ml/post/45766694

Hey :) For a while now I use gpt-oss-20b on my home lab for lightweight coding tasks and some automation. I’m not so up to date with the current self-hosted LLMs and since the model I’m using was released at the beginning of August 2025 (From an LLM development perspective, it feels like an eternity to me) I just wanted to use the collective wisdom of lemmy to maybe replace my model with something better out there.

Edit:

Specs:

GPU: RTX 3060 (12GB vRAM)

RAM: 64 GB

gpt-oss-20b does not fit into the vRAM completely but it partially offloaded and is reasonably fast (enough for me)

  • SuspciousCarrot78@lemmy.worldEnglish
    2·
    2 hours ago

    Those who know…cry about how much hardware is needed to run it locally :)

    I don’t have near the rig to run it, but I’ve been using it with OR a bit recently. What I like about it is that it’s well behaved with nestled comments and gates. You point most coding models at a task and they will ignore everything to get it done. No - I said do X then stop. JUST X.

    Codex, Claude and GLM are good at holding the line.