SuspiciousCarrot78@aussie.zone to Selfhosted@lemmy.worldEnglish · 8 hours agoDo you host your own AI?message-squaremessage-square109fedilinkarrow-up171arrow-down122file-text
arrow-up149arrow-down1message-squareDo you host your own AI?SuspiciousCarrot78@aussie.zone to Selfhosted@lemmy.worldEnglish · 8 hours agomessage-square109fedilinkfile-text
minus-squaresurewhynotlem@lemmy.worldlinkfedilinkEnglisharrow-up3arrow-down1·4 hours agoI have to recommend switching to llamacpp. It’s SO much faster than ollama.
minus-squarecurbstickle@anarchist.nexusMlinkfedilinkEnglisharrow-up1arrow-down1·edit-24 hours agoOn the list but haven’t gotten to it yet, but I know I should. I could probably get a bit more out of that box with it, expand the context windows a bit…
I have to recommend switching to llamacpp. It’s SO much faster than ollama.
On the list but haven’t gotten to it yet, but I know I should. I could probably get a bit more out of that box with it, expand the context windows a bit…