Hacker reverse engineers his Samsung TV and finds on-device AI listening for your dog and baby, watching what you watch, and borrowing your soundbar’s mic if the TV doesn’t have one. Then OpenAI banned him for reverse-engineering it.
Source:
Hacker reverse engineers his Samsung TV and finds on-device AI listening for your dog and baby, watching what you watch, and borrowing your soundbar’s mic if the TV doesn’t have one. Then OpenAI banned him for reverse-engineering it.
Source:
Exllama is old! Ironically. It was around during the Llama2 days, hence the name.
The paper behind its quantization method is pretty old too, and it had KV cache quantization with hadamard rotation like a year before Google’s TurboQuant paper made it popular. llama.cpp (the engine behind GGUFs) isn’t as cutting edge as people think, unfortunately.
I’m not disagreeing, I just find it amusing how “oldschool” some of this stuff is now.
deleted by creator