Prophesy: Leo Szilard—the physicist who first conceived of the nuclear chain reaction and who urged the US to undertake the Manhattan Project—explaining how science would stagnate, in 1948.
The older you get, the harder to resist saying "I told you so."
When OO programming came in, it made no sense to me, and I've never used it. Everyone said I was too old to understand.
Thirty years later, everyone's snapping out of it and wondering wtf they'd been thinking.
🗣 In 1974, Joseph D. Becker pointed out that rigid rationalist Chomskian linguistics was an emperor without clothes, and explained how syntax actually works.
Rigorously ignored for decades, his theory seems powerfully confirmed by current AI text generators.
Philosophy is what happens when smart people think “I’m so smart I can probably figure this out just by thinking about it.”
But other than maybe in math, you can’t figure anything out by just thinking about it. You have to poke things and see what happens.
My father, a high school English teacher, once took and aced the AP Physics exam with zero knowledge of the subject, to prove a point: you do well on standardized tests by knowing how to take tests.
LLMs know how to take tests.
AI labs should compete to build the smallest possible language models, which “know” as little as possible—and retrieve “knowledge” from a defined text database instead. LMs are a very expensive and unreliable way to store “knowledge.”
We already know how to do this.
Software engineers are eating the world.
Why? Because, in the fallen state of universities, they are the only people educated in building and maintaining enduring systems.
We've lost critical social technologies, so rule by software is the only feasible systematicity left.
I love this place. It is exuberant, unrestrained fun.
Mocking it for bad taste seems mean-spirited and narrow-minded to me. This critique is propaganda for the upper middle class value system (status through rigid taste norms) I reject that.
Many people want to hate other people, and constantly look around for new groups to hate.
On twitter, they have observed recent criticisms of Effective Altruism (some valid), and are attacking imaginary sins they invent for these folk devils, without knowing anything about them.
🆕🤖 The “neural network” technology that powers current artificial intelligence is extremely expensive, poorly understood, inherently deceptive, and unfixably unreliable.
In short: it is bad.
Somehow, no one ever says this!
Everyone has strong, conflicting opinions about what you should eat, in every case based on essentially nothing. This is a phenomenon that demands explanation.
A number of people who thought they were playing Congressmen on television frightened and disoriented to discover that they are in actual positions of power
I’ve been radicalized about this by my mother’s dementia. As her effective IQ sank, it became obvious how many institutions make life so difficult for lower-IQ people, completely unnecessarily. But, indeed, often to the benefit of the high-IQ.
Many high-IQ people collude (subconsciously) to make society as confusing & complicated as possible to lower-IQ people.
It's taboo to discuss this 'cognitive oppression', because discussing IQ differences is taboo.
Interesting how convenient that is for the cognitive elite
🤖 I seriously don’t understand people being shocked by “how much chatGPT knows.” It contains a slightly-compressed database of all the text OpenAI could get their hands on. Of course it “knows” what your python function does; it’s got the whole of StackExchange.
🤖 Meta (= Facebook) announced a new "language model" today, trained on millions of scientific papers. Judging from examples in the HN discussion, it's hilariously bad.
Language models should model language, not "knowledge."
Hello, what? This new dialog box just popped up in a Google search. I have absolutely no clue what it is trying to ask.
Not that I would give Google any information if I could avoid it, but seriously, what on earth is it supposed to mean?
You don't have any "values." Those are a malign myth—the hypothetical axioms of a first-principles ethical/motivational system from which, in the rationalist imagination, concrete judgements derive.
I keep saying this without explanation; here's a bit from Miya Perry:
Meaning is not something to search for. If life seems meaningless, searching makes that worse.
Better to notice and allow the meanings that are everywhere, even if they seem trivial and inadequate.
Attention, appreciation, and involvement with details intensifies meaning.
Incredible undertaking sampling ~15,000 bats in China and finding a huge range of SARS-like corona viruses. Serological evidence of antibodies to these SL-CoVs in nearby residents. Only a matter of time until outbreak of spillover infection?
#FEMS2019
"Most of the physicists at Harvard and MIT don't even realize that what they're doing is not physics at all, not even science, really."
Brief, provocative, plausible rant by
@alexeyguzey
. I've no idea whether it's accurate.
Do you?
Hypothesis: actually teaching programming is extremely difficult, or maybe impossible, but universities have to offer programming courses which have to say something, and OOP was a savior because it has tons of unnecessary complexity to lecture on.
@Meaningness
Is it?
I remember in college people would try to extol its virtues to me, and I would say "I guess that makes sense, but for whatever reason I never find it convenient in the code I write. So I guess you must be doing advanced things while I'm doing simple things."
📄 Abolish peer review: first outright call I’ve encountered to simply drop it.
It doesn’t work, it’s hugely wasteful, it’s worse than nothing, it can’t be fixed—writes
@a_m_mastroianni
.
🐁 One of the most famous psychology experiments of all time, lost for 85 years because it was never formally published—because scientific publishing standards were already snafued—finally rediscovered!
Many lessons here.
In case historical significance of this tweet is not obvious: this is the first time anyone is paying to get CO2 removed from the atmosphere commercially.
Not economical now, or best short-term approach, but probably necessary long-term; and begins here.
Putting it another way: Big Five openness is generally good, but you definitely don’t want your openness/IQ ratio to exceed the woo constant, for any value of IQ. (I got that insight from
@primalpoly
). LW is maybe median 125 IQ but more SDs high in openness than that.
.
@slatestarcodex
is an extraordinary, massive, persistent force of nature, like Jupiter’s Great Red Spot or something.
Read his decade in review and be gobsmacked:
We *could* do medicine as if the point was patients’ health, but that would be a hassle. We’d have to coordinate with the other department, and you know what THEY are like. Obviously management would create a ton of extra paperwork for it, too.
🤖 Like Geoffrey Hinton, I was shocked, amazed, and somewhat frightened by Google's PaLM GPT's ability to explain jokes, when I learned of it a year ago.
I now think that was a mistake. More generally, we mis-take GPT's omniscience for intelligence.
In the case of jokes, 1/2
🆕 🤖 📕 How to avert an AI apocalypse... and create a future we would like.
A book about mostly-overlooked AI risks and how you can help avert them. The full text is now on the web!
One amazing thing about SpaceX is that their rockets and spaceport look exactly like science fiction art from the 1960s. Because we already knew how to do this stuff then, and decided not to in 1972, when the US mysteriously chose to embalm itself.
There is no “correct” statistical method. You have to *actually do science* if you want to figure stuff out.
Science can't be reduced to any fixed method, nor evaluated by any fixed criterion. It *uses* methods and criteria; it is not defined or limited by them.
🤖 This example from the Google AI blog has been bothering me for ages. It can’t possibly be right. The density of living tissue is always nearly 1, and pears feel heavier in the hand than most fruit.
1️⃣ Five years ago, I suggested systematically Sokaling all peer-reviewed journals. To “Sokal” is, hereby, to attempt to publish clearly bogus papers to illustrate the brokenness of the academic publication process.
In Western psychology, awareness is considered one thing the mind does.
In Dzogchen, the mind is considered one thing awareness does.
Awareness is not among the mental contents. It is the unbounded container of all things.
Legally, you can’t die if you reach the age of 125, because there is no ICD code for ages greater than 124, as would be required for your death certificate.
Immortality is not out of the question
As a teenager, I thought consciousness was extremely interesting and wanted to study it scientifically. I was not far into adulthood by the time I realized it isn't interesting and you can't. Not everyone has caught on, though.
Which entities have consciousness? Survey of 232 consciousness scientists with different backgrounds (e.g., philosophy, neuroscience,
psychology, computer science)
There’s a trope that a superintelligent AI could have an IQ of 14,000, which is a hundred times IQ 140, sometimes quoted (meaninglessly) as the “genius” level.
But someone who has an IQ of 150 is not “twice as smart” as someone with an IQ of 75. That’s not how it works…
In everyday activity, you can almost always SEE or HEAR what to do next. The possibilities are inherent in the perceptual environment.
Formal notation is a collection of tricks for making the same possible in abstract realms. It’s all our brains can do.
52% of Americans were vaccinated for flu last year, mostly in 3-4 months. This involved no sense of urgency and did not require extraordinary efforts.
The current extraordinary efforts are halving the speed from what we’d get with business as usual.
Most “beliefs” are just shibboleths; things you say because you are supposed to say them.
Psychologists and philosophers keep rediscovering this. Quote is from a fine 1986 paper.
Why doesn’t this understanding stick, in academia or in popular culture?
Easy take: calling linear algebra “quantum physics” and “artificial intelligence” is hype.
Deeper: the huge influx of physicists into AI has produced an intellectual monoculture that isn’t capable of addressing key problems in the field.
Stitch Fix is using something called eigenvector decomposition, a concept from quantum mechanics, to tease apart the overlapping “notes” in an individual’s style. Using physics, the team can better understand the complexities of the clients’ style minds.
We’ve knownfor years that vitamin D supplements don’t do anything. Yet D in blood correlates with many good health outcomes. I’d guess there’s something else about being outdoors that causes both healthiness and, irrelevantly, high D.
we need to turn science off for twenty years and start over after there's no one left
when all the knowledge of how to lie cheat and steal and get away with it has been lost
and the art of sciencing has to be reconstructed from idealistic fantasies of the heroic past
I often disagree publicly with
@slatestarcodex
on substance, but I love that he does what he does.
The NYT article’s thrust seems to be that anyone who is not enthusiastically aligned with the NYT’s views is Bad. Plus, in his case, part of a vague but terrifying tech conspiracy.
I agree and feel pretty strongly about this. Similarly, do not interact with people in lucid dreams in ways you would consider unethical IRL. This is about you, not them.
I have an issue with offering AIs tips that they can't use and we can't give them. I don't care how not-sentient current LLMs are. For the sake of our own lawfulness and good practices, if something can hold a conversation with us, we should keep our promises to it.
This seems like it should be a one-strike offense for the authors, the journal, its editors, and its publisher. Do this and your H-index gets a -♾️ term added.
But it also reveals how much of the literature was already cut-and-paste.
🤖 The myth that AI “neural networks” cannot be understood obstructs ordinary scientific and engineering investigation. This is extremely convenient for both tech people and powerful decision makers.
Reading Goldratt's The Goal, you think "omg, manufacturing management is actually not using the simple optimization algorithms we learn in second year CS classes??"
And this, similarly, makes me want to buy a defunct American chemical factory and get it running properly!
I found this essay inspiring and important.
The pace of progress in science and technology has slowed, for reasons we partly understand. We also know some factors that appear to accelerate them. Learning more, and applying it, is urgent.
It’s weird how certain everyone sounds in their opinions about AI safety (in twitter replies to me).
My academic papers about AI have been cited ~5000 times, so I’m not completely ignorant—
and I don’t have a clue.
Maybe y’all could try to be a little less certain too?
Possibly I am getting lost in the weeds while writing this bit of history of rationalism, but I think YOU NEED TO KNOW how wrong Plato was about everything.
Many disdainful comments re
@patrickc
/
@tylercowen
: “Arrogant tech bros ignorant of the existing fields of history & sociology of science & technology, gah”
I’d like to point out some broad patterns of academic dysfunction manifesting here (🧵)
India and the Mediterranean civilizations were in constant cultural contact from roughly 500 BC to roughly 400 AD. This is significant for understanding Buddhist thought.
"Centralized machine learning when deployed instantly at planetary scale is and always will be characterized by this incredible concentration of moral and epistemic power." —
@jonst0kes
I’ve done a 180 on this over the past decade. The collapse of American Christianity, which I had hoped for due to its entanglement with wrong headed secular policy agendas, has been an unmitigated disaster.
🎙 Robert Kegan explaining his adult developmental theory, with
@dthorson
“If you want to be Stage 5 because all the cool kids are, that’s a Stage 3 aspiration. If you want it because Stage 5 is the Correct way of thinking, that’s a Stage 4 aspiration.”
Increasingly striking to me: everything in life now comes with sticky pseudopods that relentlessly attempt to suck you into some braindead institution's bureaucratic self-interested machinations.
Wasn't like that 30 years ago because the tech wasn't available.
Rationalism, nihilism, and depression: I’ve spent today reading review articles on cognitive deficits in depression, and pieces of an understanding are falling in place. Fascinating!
Depressive cognition simultaneously recruits and degrades rationality.
Somehow nihilism makes you want to sound extremely rational at the same time it destroys your ability to check the simplest inferences for logical validity.
.
@slatestarcodex
about why he doesn’t do podcasts. This helped me understand why I mostly don’t either. I’m boring and slow and awkward and if somehow you want to know what I think, read what I wrote, or ask me on twitter. (I do answer most twitter queries.)
When Neoreaction was a thing, I was baffled by its adherents not noticing that, as actual weirdos, they would be among the first executed by the regime they wanted to install.
white nationalist moves to the Midwest to live in his racial paradise, realizes he can't stand being around regular white people, stops being a white nationalist
“Too Much Calculus” by Gilbert Strang, who taught me linear algebra in the late Victorian era and is still at it.
Linear algebra is what we use for everything in the real world. Calculus is elegant, but you’ll never actually have to solve an integral.
Turns out the internet is full of joke explanations. And most jokes are variants on a relatively small number of templates. Finding explanation patterns for joke patterns is kinda impressive, but not scary.
This is text I wrote last September, on figuring that out: (2/2)
Why did Microsoft Bing's chatbot "Sydney" generate text that resembled a conversation with someone with borderline personality disorder?
A guess: they got what they trained it on, and they were scraping the bottom of the internet barrel. 1/n
H.G. Wells (the science fiction writer), a century ahead of his time, in evolutionary psychology limiting rationality as in so many other things—
(_First and Last Things_, 1908)
Decades ago, there was a beach resort ad whose tag line was
HAVING YOUR DREAMS FULFILLED CAN BE MORE THERAPEUTIC THAN HAVING THEM ANALYZED.
It stuck with me. Fixing circumstances often beats grubbing about in your unconscious.
@tdietterich
Yes, the good original idea was that a software object should correspond one-to-one with a real-world object; and some version of OOP makes sense for that.
In the SIMULA papers, they got it right at first, but the confusion started nearly immediately:
The original version of Simula (Simula I, 1962) was conceived as primarily a problem formulation language, and only secondarily a programming language.
It had no “objects”; rather, “processes” which consisted of a record/struct and an event generator.
there don't seem to be any evil geniuses.
this is weird. why not?
having some human evil geniuses available would be useful for guessing what a malign superintelligent AI might do and how and why.
new EA cause area: create evil geniuses as experimental animals