Sleep Is for Backpropagation (2017)

Comments (1)

ijidak · 20h ago

So, I post this because I wonder if the key to models that improve daily is "sleep". E.g. well never get around garbage collector pauses for models.

I'm sure this is not an original idea, but it hit me today and I figured I would love to hear thoughts from this community.

Canyon.mid (canyonmid.com)

Datalog in Rust (github.com)

How to modify Starlink Mini to run without the built-in WiFi router (olegkutkov.me)

Show HN: Meow – An Image File Format I made because PNGs and JPEGs suck for AI (github.com)

1k year old 3 sisters crop farm found in Northern Michigan (smithsonianmag.com)

An origin trial for a new HTML <permission> element (developer.chrome.com)

The Keyset (dougengelbart.org)

The Art of Lisp and Writing (dreamsongs.com)

Ruby on Rails Audit Complete (ostif.org)

Nvidia CEO criticizes Anthropic boss over his statements on AI (tomshardware.com)

That 'unsubscribe' button may be a scam (popsci.com)

Childhood leukemia: how a deadly cancer became treatable (ourworldindata.org)

Tiny-diffusion: A minimal implementation of probabilistic diffusion models (github.com)

Q-learning is not yet scalable (seohong.me)

Text-to-LoRA: Hypernetwork that generates task-specific LLM adapters (LoRAs) (github.com)

I have reimplemented Stable Diffusion 3.5 from scratch in pure PyTorch (github.com)

Infinite Grid of Resistors (mathpages.com)

Foundations of Computer Vision (visionbook.mit.edu)

CI/CD Observability with OpenTelemetry Step by Step Guide (signoz.io)

Notes on the History of the Map Tile (placing.technology)

The Talented Ms. Highsmith (yalereview.org)

Waymo rides cost more than Uber or Lyft and people are paying anyway (techcrunch.com)

Cloud outage knocks out internet services across the globe (zdnet.com)

AMD's AI Future Is Rack Scale 'Helios' (morethanmoore.substack.com)

Breaking My Security Assignments (akpain.net)

Meta-analysis of three different notions of software complexity (typesanitizer.com)

The Algebra of an Infinite Grid of Resistors (mathpages.com)

Solar Orbiter gets world-first views of the Sun's poles (esa.int)

Chicken Eyeglasses (en.wikipedia.org)

Inside the Apollo “8-Ball” FDAI (Flight Director / Attitude Indicator) (righto.com)

Last fifty years of integer linear programming: Recent practical advances (2024) (inria.hal.science)

Cray versus Raspberry Pi (aardvark.co.nz)

Debunking HDR [video] (yedlin.net)

Tintin, Hergé and Chang – A Friendship That Changed the World (thewire.in)

Endometriosis is an interesting disease (owlposting.com)

Have a damaged painting? Restore it in just hours with an AI-generated “mask” (news.mit.edu)

How multiplication is defined in Peano arithmetic (devlinsangle.blogspot.com)

Bioprospectors mine microbial genomes for antibiotic gold (cen.acs.org)

Large language models often know when they are being evaluated (arxiv.org)

Dance Captcha (dance-captcha.vercel.app)

SIMD-friendly algorithms for substring searching (2016) (0x80.pl)

The Many Sides of Erik Satie (thereader.mitpress.mit.edu)

"Make in India" Relies on "Made in China" (hinrichfoundation.com)

TimeGuessr (timeguessr.com)

Fixing the mechanics of my bullet chess (jacobbrazeal.wordpress.com)

Unsupervised Elicitation of Language Models (arxiv.org)

How to Build Conscious Machines (osf.io)

Solidroad (YC W25) Is Hiring (solidroad.com)

Slowing the flow of core-dump-related CVEs (lwn.net)

Seven replies to the viral Apple reasoning paper and why they fall short (garymarcus.substack.com)

Sleep Is for Backpropagation (2017)

Comments (1)