Ive been watching “AI in context” for a few weeks (they make long form biopic content on current state of AI - really good stuff).
This dropped today; it’s about the wheeling and dealing behind closed doors at OpenAI re: Sam Altman’'s firing. It’s a lot more watchable than that sounds :)
https://www.youtube.com/watch?v=_eYTkvZqbnQ
The line that brought me to a stand still was “the future of AI depends on the moral compass of like 5 people”.
I know we’re all about local LLMs here…but it’s sad to see yet another “Don’t Be Evil” mission statement get swallowed up market forces. OpenAI was meant to bring balance to the Force, not leave it in ruins, and yet…
I think folks here (and Lemmy generally) are more savvy about AI then the gen pop…but even if you’re training a nanoGPT model from scratch on hardware you own …you’re still beholden to outside forces. Eg: the people’s champion - Qwen - seems to have split or gone closed weights for 3.7.
Things that make you go hmm.
Anyway…just signal boosting a cool video.
More precisely, it depends on the moral compass of five psychopaths.
Oh…i hope you’re wrong. I really, really hope you’re wrong.
But the incentive structure sure does seem to reward that.
The incentive structure is how we behave as humans. Just about anyone would do anything for a million bucks, including working for a child rapist, so as long as that’s true the incentive is for child rapists to make sure they have a lot of money to employ people so they won’t get in trouble for raping children.
Until people are willing to tell these pedophile billionaires to fuck off, it’s going to keep getting worse.
Yes, it does.
(This is actually one of the topics I tend to beat to death, so…)
It’s not unique to AI or to any other industry or organization.
Broadly, in the competition to climb the ladder of success in a hierarchical system, an individual must continually make choices.
A person with honor, integrity and/or empathy will have some number of possible choices that they’ll eliminate immediately, even if they’re strategically superior, simply because their moral standards won’t allow for them.
People without any of those qualities, which is to say psychopaths and sociopaths, are not similarly constrained. They’re wholly willing and able to choose the most personally beneficial course of action, entirely regardless of the harm it might do others.
So all other things being more or less equal, psychopaths and sociopaths actually have a competitive advantage in hierarchical systems, so for all intents and purposes, hierarchical systems actually reward and effectively select for antisocial personality disorder.
Right? No one becomes a billionaire (or trillionaire) with clean hands.
I don’t know what to do about that. I know a lot of people secretly hoping AI leads us to luxury space communism…but…if we’re building portals to summon aliens (AGI)…do we trust big corpo with that?
It’s a mess.
Democracy (3 legged slouching towards Bethlehem) is the worst system…apart from all the others.
You’re right, it is that way now. But it’s not intrinsic to hierarchy, just to the current system.
As a counterexample, not as an endorsement, consider feudalism (the old form, not technofeudalism). While psycho/sociopaths have an advantage reaching the top, there is a reasonable chance that their children will not be sick in the same way.
Also Athenian Democracy, where people were randomly selected to form ruling council, judiciary, and assembly, so only as likely as the populace prevalence to be a psychopath. That system lasted for hundreds of years, including being taken over by (probably) sociopaths and returning afterwards to democracy.
Well - yes - I should maybe stipulate competitive hierarchy.
Though I would tend to argue that hereditary hierarchy is relatively likely to go the same way, if for different reasons. The problem there isn’t that sociopaths and psychopaths win, since there is no competition for them to win… Instead the problem is that they’re bred by drawing from a pool that’s privileged and shielded from harsh realities and eventually entirely loses touch with the rest of humanity.
If I had my way about it, we’d have Athenian democracy starting this very moment. Even with the very real threat of poor choices being made by random assortments of assholes, idiots and lunatics, it still could not possibly be worse than government by people eager to sell their influence and people eager to buy it.
I seem to recall a story about a Roman farmer / ex general, who was voulten-told into being emperor, solved the problem at hand, and went back to farming, no fuss no muss. All in the space of a fortnight.
As BDE goes, that’s the full John Holmes. Hell, that’s two dicks worth of BDE.
which they have none, totally amoral.