Meta's Llama 3.1 can recall 42 percent of the first Harry Potter book

Comments (1)

aspenmayer · 12m ago

If you've seen as many magnet links as I have, with your subconscious similarly primed with the foreknowledge of Meta having used torrents to download/leech (and possibly upload/seed) the dataset(s) to train their LLMs, you might scroll down to see the first picture in this article from the source paper, and find uncanny the resemblance of the chart depicted to a common visual representation of torrent block download status.

Previously, related:

Extracting memorized pieces of books from open-weight language models - https://news.ycombinator.com/item?id=44108926 - May 2025

Datalog in Rust (github.com)

The Art of Lisp and Writing (dreamsongs.com)

Ruby on Rails Audit Complete (ostif.org)

Q-learning is not yet scalable (seohong.me)

CI/CD Observability with OpenTelemetry Step by Step Guide (signoz.io)

Infinite Grid of Resistors (mathpages.com)

I have reimplemented Stable Diffusion 3.5 from scratch in pure PyTorch (github.com)

The Algebra of an Infinite Grid of Resistors (mathpages.com)

Breaking My Security Assignments (akpain.net)

Waymo rides cost more than Uber or Lyft and people are paying anyway (techcrunch.com)

AMD's AI Future Is Rack Scale 'Helios' (morethanmoore.substack.com)

Chicken Eyeglasses (en.wikipedia.org)

Solar Orbiter gets world-first views of the Sun's poles (esa.int)

Inside the Apollo “8-Ball” FDAI (Flight Director / Attitude Indicator) (righto.com)

Meta-analysis of three different notions of software complexity (typesanitizer.com)

Dance Captcha (dance-captcha.vercel.app)

Bioprospectors mine microbial genomes for antibiotic gold (cen.acs.org)

Text-to-LoRA: Hypernetwork that generates task-specific LLM adapters (LoRAs) (github.com)

Have a damaged painting? Restore it in just hours with an AI-generated “mask” (news.mit.edu)

How multiplication is defined in Peano arithmetic (devlinsangle.blogspot.com)

Last fifty years of integer linear programming: Recent practical advances (inria.hal.science)

Debunking HDR [video] (yedlin.net)

Cray versus Raspberry Pi (aardvark.co.nz)

Endometriosis is an interesting disease (owlposting.com)

Fixing the mechanics of my bullet chess (jacobbrazeal.wordpress.com)

The Many Sides of Erik Satie (thereader.mitpress.mit.edu)

SIMD-friendly algorithms for substring searching (2016) (0x80.pl)

Unsupervised Elicitation of Language Models (arxiv.org)

TimeGuessr (timeguessr.com)

How to Build Conscious Machines (osf.io)

Root Cause of the June 12, 2025 Google Cloud Outage (twitter.com)

Seven replies to the viral Apple reasoning paper and why they fall short (garymarcus.substack.com)

Slowing the flow of core-dump-related CVEs (lwn.net)

Clinical knowledge in LLMs does not translate to human interactions (arxiv.org)

Student discovers fungus predicted by Albert Hoffman (wvutoday.wvu.edu)

Self-Adapting Language Models (arxiv.org)

We investigated Amsterdam's attempt to build a 'fair' fraud detection model (lighthousereports.com)

How the Final Cartridge III Freezer Works (pagetable.com)

Peano arithmetic is enough, because Peano arithmetic encodes computation (math.stackexchange.com)

Solidroad (YC W25) Is Hiring (solidroad.com)

Implementing Logic Programming (btmc.substack.com)

Flies grow their gyroscopes: Study reveals how flight stabilizers take shape (phys.org)

Filedb: Disk-based key-value store inspired by Bitcask (github.com)

If the moon were only 1 pixel: A tediously accurate solar system model (2014) (joshworth.com)

Iconic icons to showcase your skills (github.com)

The international standard for identifying postal items (akpain.net)

Frequent reauth doesn't make you more secure (tailscale.com)

Wrong ways to use the databases, when the pendulum swung too far (luu.io)

Beware the Intention Economy: Collection and Commodification of Intent via LLMs (hdsr.mitpress.mit.edu)

Spatializing 6k years of global urbanization from 3700 BC to AD 2000 (nature.com)

Meta's Llama 3.1 can recall 42 percent of the first Harry Potter book

Comments (1)