The Hardware Lottery (2020)

This has been brought up before[1] but I think we're going to see some huge refactoring of compute hardware as LLMs threaten to eat our power grid for lunch. (Oh, and drink all our water too)

[1] https://news.ycombinator.com/item?id=38377263