Everything Is Correlated

74 gmays 21 8/22/2025, 2:05:53 AM gwern.net ↗

Comments (21)

senko · 2h ago
The article missed the chance to include the quote from that standard compendium of information and wisdom, The Hitchhiker's Guide to the Galaxy:

> Since every piece of matter in the Universe is in some way affected by every other piece of matter in the Universe, it is in theory possible to extrapolate the whole of creation — every sun, every planet, their orbits, their composition and their economic and social history from, say, one small piece of fairy cake.

sayamqazi · 1h ago
Wouldnt you need the T_zero configuration of the universe for this to work?

Given different T_zero configs of matter and energies T_current would be different. and there are many pathways that could lead to same physical configuration (position + energies etc) with different (Universe minus cake) configurations.

Also we are assuming there is no non-deterministic processed happening at all.

senko · 1h ago
I am assuming integrating over all possible configurations would be a component of The Total Perspective Vortex.

After all, Feynman showed this is in principle possible, even with local nondeterminism.

(this being a text medium with a high probability of another commenter misunderstanding my intent, I must end this with a note that I am, of course, BSing :)

Evidlo · 1h ago
This is such a massive article. I wish I had the ability to grind out treatises like that. Looking at other content on the guy's website, he must be like a machine.
kqr · 31m ago
IIRC Gwern lives extremely frugally somewhere remote and is thus able to spend a lot of time on private research.
tux3 · 27m ago
IIRC people funded moving gwern to the bay not too long ago.
pas · 19m ago
lots of time, many iterations, affinity for the hard questions, some expertise in research (and Haskell). oh, and also it helps if someone is funding your little endeavor :)
tmulc18 · 1h ago
gwern is goated
dang · 2h ago
Related. Others?

Everything Is Correlated - https://news.ycombinator.com/item?id=19797844 - May 2019 (53 comments)

stouset · 2h ago
Correlated, you mean?
pnt12 · 34m ago
Those would be all articles posted in HN :)
syntacticsalt · 35m ago
I don't disagree with the title, but I'm left wondering what they want us to do about it beyond hinting at causal inference. I'd also be curious what the author thinks of minimum effect sizes (re: Implication 1) and noninferiority testing (re: Implication 2).
apples_oranges · 58m ago
People didn't always use statistics to discover truths about the world.

This, once developed, just happened to be a useful method. But given the abuse using those methods, and the proliferation of stupidity disguised as intelligence, it's always fitting to question it, and this time with this correlation noise observation.

Logic, fundamental knowledge about domains, you need that first. Just counting things without understanding them in at least one or two other ways, is a tempting invitation for misleading conclusions.

st-keller · 57m ago
„This renders the meaning of significance-testing unclear; it is calculating precisely the odds of the data under scenarios known a priori to be false.“

I cannot see the problem in that. To get to meaningful results we often calculate with simplyfied models - which are known to be false in a strict sense. We use Newtons laws - we analyze electric networks based on simplifications - a bank-year used to be 360 days! Works well.

What did i miss?

whyever · 38m ago
It's a quantitative problem. How big is the error introduced by the simplification?
jongjong · 5m ago
Also, I'm convinced that the reason humans intuitively struggle to figure out causality is because the vast majority of causes and effects are self-reinforcing cycles and go both ways. There was little evolutionary pressure for us to understand the concept of causality because it doesn't play a strong role in natural selection.

For example, eat a lot and you will gain weight, gain weight and you will feel more hungry and will likely eat more.

Or exercise more and it becomes easier to exercise.

Earning money becomes easier as you have more money.

Public speaking becomes easier as you do it more and the more you do it, the easier it becomes.

Etc...

ctenb · 1m ago
> Public speaking becomes easier as you do it more and the more you do it, the easier it becomes.

That's saying the same thing twice :)

2rsf · 1h ago
eisvogel · 2h ago
It's just as I suspected - there are NO coincidences.
petters · 2h ago
If two things e.g. both change over time, they will be correlated. I think it can be good to keep this article in mind
andsoitis · 2h ago
there is but a single unfolding, and everything is part of it