It’s all dependent on VRAM. If you can load the distilled models with your GPU without maxing out your VRAM it will run just as fast as any server farm.
RX 580x
It looks like your video card only has 8 GB of VRAM. That will be your bottleneck.
JoYo 🇺🇸
UTC-04
I have scores hidden and block at the first sign of asshattery. If I block you and that means you win, then please enjoy the win. I want you to.
“Your boos mean nothing, I’ve seen what makes you cheer.”
- 0 Posts
- 2 Comments
Joined 5 years ago
Cake day: November 13th, 2019
You are not logged in. If you use a Fediverse account that is able to follow users, you can follow this user.
deleted by creator
deleted by creator
deleted by creator
yah that’ll do it too. ive got a 6800xt which isn’t technically supported but it works well.