Judge rules Apple executive lied under oath, makes criminal contempt referral (thebignewsletter.com)

Back in the old days, people used to do general-purpose GPU programming by using shaders like GLSL. This is what inspired NVIDIA (and other companies) to eventually create CUDA (and friends). This is an implementation of GPT-2 using WebGL and shaders. Enjoy!

Comments (25)

ianand · 1d ago

As the guy who did GPT2 in Excel, very cool and kudos!!

Curious why you chose WebGL over WebGPU? Just to show it can be done?

(Also see my other comment about fetching weights from huggingface)

nathan-barry · 1d ago

This was a final project for a graphics class where we used WebGL a lot. Also I was just more familiar with OpenGL and haven't looked that much into webGPU

divan · 21h ago

Someone needs to implement Excel using graphics shaders now.

ianand · 9h ago

Lol. You joke but... https://www.reddit.com/r/GraphicsProgramming/comments/pg9dw8...

ronsor · 1d ago

Probably because WebGPU support is still rather iffy.

_dijs · 22h ago

ianand, I immediately thought of you when I saw this post. Miss you friend.

ianand · 9h ago

Dude, been forever. Thanks. Will DM you.

littlestymaar · 1d ago

> Curious why you chose WebGL over WebGPU? Just to show it can be done?

For a WebGPU implementation, one can use transformers.js directly (or many other libraries actually), maybe WebGL is more original.

[1]: https://huggingface.co/docs/transformers.js/index

85392_school · 21h ago

Transformers.js wraps the ONNX runtime which is rather versatile (WASM, WebGL, WebGPU, and WebNN). It's not the backend that makes it novel.

Philpax · 1d ago

I'm reminded of this VRChat world, which runs Qwen2-0.5B in a shader: https://vrchat.com/home/launch?worldId=wrld_e919c1f4-8399-43...

supuun · 4h ago

> Back in the old days, people used to do general-purpose GPU programming by using shaders like GLSL. This is what inspired NVIDIA (and other companies) to eventually create CUDA (and friends).

I learned about this at the lecture last week. So fun to see this project.

gitroom · 22h ago

Nice, that takes some serious grinding to pull off in shaders. Makes me kinda wonder - does pushing old tools like WebGL actually force deeper understanding of how these models work compared to just grabbing a new library?

helloplanets · 1d ago

Would absolutely read a 'making of' post on this project!

badmonster · 23h ago

Super cool project! How much of the inference time is actually GPU-bound vs CPU-bound in the browser? Curious if WebGPU would offer a big perf boost over WebGL2 here.

SamosaGuru · 1d ago

Would be really cool to have it hosted on a website if it can be a static page so we could try it out

nathan-barry · 1d ago

Working on getting it up on Github pages, will let you know. Not sure if there will be an issue with hosting the weights, I'll look into it

Philpax · 1d ago

You may be able to fetch the weights directly from Hugging Face. I'd try that first.

ianand · 1d ago

Checkout https://github.com/jseeio/gpt2-tfjs fetches the weights for GPT2 from huggingface on the fly.

jasonjmcghee · 22h ago

I haven't looked at your implementation, but if you can read ONNX weights... https://huggingface.co/Xenova/gpt2

jasonjmcghee · 23h ago

Incredible. Was going to suggest tossing up a github page with it, but looks like one is currently in-progress? (https://nathan-barry.github.io/gpt2-webgl/) but doesn't seem to load for me currently.

Looks like it's trying to load the typescript directly / hosting the source files: `<script type="module" src="src/main.ts"></script>` - instead of hosting the dist folder.

nathan-barry · 22h ago

Yeah, right now the weights aren't even pushed to the repo so there's no way for the github page to load them in. I've looked a tiny bit into it and might end up making a fix for it, having it load the weights by fetching them from somewhere else on load, but probably not today.

There is a link to the zipped up folder with the weights here: https://github.com/nathan-barry/gpt2-webgl/releases/download...

If anyone wants to make a PR which fetches the file from there, unzips it, then loads in the weights from there that would be greatly appreciated.

Narishma · 23h ago

Now do it with the fixed function pipeline so I can run it on my 3dfx Voodoo card.

throwaway314155 · 1d ago

This is pretty rad. I've built and run the project on my MacBook and can't seem to get the visualizations to show as they appear in the GitHub demonstration. I'm running Firefox but I think that should support WebGL features you're using?

Happy to file an issue on the repository as well if you'd prefer that.

nathan-barry · 1d ago

Yeah it'd be great if you could file an issue and show what you see! I was using Safari but I'm gonna check other browsers to test if it works on them

throwaway314155 · 1d ago

Great! I've filed an issue.

Redis is open source again (antirez.com)

Widespread power outage in Spain and Portugal (bbc.com)

Someone at YouTube needs glasses (jayd.ml)

Apple violated antitrust ruling, judge finds (wsj.com)

I use zip bombs to protect my server (idiallo.com)

Judge rules Apple executive lied under oath, makes criminal contempt referral (thebignewsletter.com)

Show HN: I built a hardware processor that runs Python (runpyxl.com)

Watching o3 guess a photo's location is surreal, dystopian and entertaining (simonwillison.net)

Internet in a Box (internet-in-a-box.org)

Qwen3: Think deeper, act faster (qwenlm.github.io)

LibreLingo – FOSS Alternative to Duolingo (librelingo.app)

An end to all this prostate trouble? (yarchive.net)

Firefox tab groups are here (blog.mozilla.org)

Office is too slow, so Microsoft is making it load at Windows startup (pcworld.com)

Finland Bans Smartphones in Schools (yle.fi)

ICE Deports 3 U.S. Citizen Children Held Incommunicado Prior to the Deportation (aclu.org)

Migrating away from Rust (deadmoney.gg)

Port of Los Angeles says shipping volume will plummet 35% next week (cnbc.com)

Claude Integrations (anthropic.com)

Try Switching to Kagi (daringfireball.net)

I created Perfect Wiki and reached $250k in annual revenue without investors (habr.com)

Only Teslas exempt from new auto tariffs thanks to 85% domestic content rule (fuelarc.com)

All four major web browsers are about to lose 80% of their funding (danfabulich.medium.com)

Starting July 1, academic publishers can't paywall NIH-funded research (nih.gov)

Jepsen: Amazon RDS for PostgreSQL 17.4 (jepsen.io)

Show HN: My self-written hobby OS is finally running on my vintage IBM ThinkPad (github.com)

How to live an intellectually rich life (utsavmamoria.substack.com)

Sycophancy in GPT-4o (openai.com)

Chain of Recursive Thoughts: Make AI think harder by making it argue with itself (github.com)

The Friendship Recession: The lost art of connecting (happiness.hks.harvard.edu)

Retailers will soon have only about 7 weeks of full inventories left (fortune.com)

Cloth (cloudofoz.com)

Why did Windows 7 log on slower for months if you had a solid color background? (devblogs.microsoft.com)

How a single line of code could brick your iPhone (rambo.codes)

A faster way to copy SQLite databases between computers (alexwlchan.net)

Xiaomi MiMo Reasoning Model (github.com)

108B Pixel Scan of Johannes Vermeer's Girl with a Pearl Earring (hirox-europe.com)

Show HN: I built a synthesizer based on 3D physics (anukari.com)

Show HN: I made a web-based, free alternative to Screen Studio (screenrecorder.me)

How the US defense secretary circumvents official DoD communications equipment (electrospaces.net)

You Wouldn't Download a Hacker News (jasonthorsness.com)

Apple App Store guidelines remove ban on encouraging external payments in US (developer.apple.com)

U.S. Economy Contracts at 0.3% Rate in First Quarter (wsj.com)

Amazon to display tariff costs for consumers (punchbowl.news)

O3 beats a master-level GeoGuessr player, even with fake EXIF data (sampatt.com)

Third party cookies must be removed (w3ctag.github.io)

Show HN: Beatsync – perfect audio sync across multiple devices (github.com)

Indian court orders blocking of Proton Mail (techcrunch.com)

Accountability Sinks (250bpm.substack.com)

Ask HN: What are you working on? (April 2025)

Show HN: GPT-2 implemented using graphics shaders

Comments (25)