Is there anyway to make it use less at it gets more advanced or will there be huge power plants just dedicated to AI all over the world soon?

  • rmuk@feddit.uk
    link
    fedilink
    English
    arrow-up
    5
    ·
    edit-2
    8 hours ago

    Imagine someone said “make a machine that can peel an orange”. You have a thousand shoeboxes full of Meccano. You give them a shake and tip out the contents and check which of the resulting scrap piles can best peel an orange. Odds are none of them can, so you repeat again. And again. And again. Eventually, one of boxes produces a contraption that can kinda, maybe, sorta touch the orange. That’s the best you’ve got so you copy bits of it into the other 999 shoeboxes and give them another shake. It’ll probably produce worse outcomes, but maybe one of them will be slightly better still and that becomes the basis of the next generation. You do this a trillion times and eventually you get a machine that can peel an orange. You don’t know if it can peel an egg, or a banana, or even how it peels an orange because it wasn’t designed but born through inefficient, random, brute-force evolution.

    Now imagine that it’s not a thousand shoeboxes, but a billion. And instead of shoeboxes, it’s files containing hundred gigabytes of utterly incomprehensible abstract connections between meaningless data points. And instead of one a few generations a day, it’s a thousand a second. And instead of “peel an orange” it’s “sustain a facsimile of sentience capable of instantly understanding arbitrary, highly abstracted knowledge and generating creative works to a standard approaching the point of being indistinguishable from humanity such that it can manipulate those that it interacts with to support the views of a billionaire nazi nepo-baby even against their own interests”. When someone asks for an LLM to generate a picture of a fucking cat astronaut or whatever, the unholy mess of scraps that behaves like a mind spits out a result and no-one knows how it does it aside from broad-stroke generalisation. The iteration that gets the most thumbs up from it’s users gets to be the basis of the next generation, the rest die, millions of times a day.

    What I just described is NEAT algorithms, which are pretty primitive by modern standards, but it’s a flavour of what’s going on.