Refrag: Rethinking RAG Based Decoding

Comments (1)

datadrivenangel · 3h ago

Am I misunderstanding this or is basically just taking RAG results and doing a vector search on the results and only passing some to the context window?

Also, why do these AI papers never get speedup times in human time units?

Data Colonialism Is, Unfortunately, a Thing [video] (youtube.com)

Death of the Holocaust Industry (twitter.com)

Show HN: Ainews247.org – the best, most valuable, fun, AI content, aggregated (ainews247.org)

US Warns Hidden Radios May Be Embedded in Solar-Powered Highway Infrastructure (reuters.com)

Lead-In to Brain-Computer Interface. How to Measure BioData (udemy.com)

A Lightweight License Plate Recognition Method Based on YOLOv8 (mdpi.com)

LLM Benchmark and Optimization Explorer (bentoml.com)

AI tool detects LLM-generated text in research papers and peer reviews (nature.com)

What Every Programmer Should Know About Memory (2007) [pdf] (people.freebsd.org)

AI Moderation: Inconsistencies in Hate Speech Detection Across LLM-Based Systems (aclanthology.org)

Randomly selecting points inside a triangle (johndcook.com)

Brazil's Supreme Court finds Bolsonaro guilty of plotting military coup (theguardian.com)

Introducing Quote Posts (blog.joinmastodon.org)

Show HN: I created a blender tutor that answers with visual cues (overlayflow.com)

Microsoft Goes Back to Basic, Open-Sources Bill Gates' Code (gizmodo.com)

Rethinking AI Infrastructure: The Rise of PCIe Switches (semiengineering.com)

You Need to Be Bored. Here's Why [video] (youtube.com)

Show HN: Nannabanana.ai – Nanna-approved image generator (nannabanana.ai)

I had the same idea for *...*

Ask HN: Is the market for AI Agent automations that big?

Gaza: The AI Human Laboratory (thecairoreview.com)

AI Bubble Watch (computerworld.com)

An Interview with Dan Kim About Intel, Nvidia, and the U.S. Government (stratechery.com)

The Pachinko Machine Plays You (fluxus.io)

Rackspace Email Service Down (status.apps.rackspace.com)

Google is shutting down Tables, its Airtable rival (techcrunch.com)

Seymour Papert: Kids and Computers [video] (youtube.com)

OrioleDB – 5.5x faster storage extension for Postgres is now open source (twitter.com)

AnyBlox: Future-Proof Columnar Data Storage (gienieczko.com)

Critical ignoring when information abundance is detrimental to democracy (sciencedirect.com)

How to command a virtual browser session with voice (anchorbrowser.io)

Natcast to Lay Off Majority of Its Staff (spectrum.ieee.org)

35 percent of VMware workloads expected to migrate elsewhere by 2028 (arstechnica.com)

Four Quadrants of Personality: Extending Psychoanalysis with Motion (benbernsteintherapy.com)

Launch HN: Ghostship (YC S25) – AI agents that find bugs in your web app

Show HN: Unheard.fm – No-repeat, user-controlled music discovery for Spotify (unheard.fm)

'Fairy circles' can provide clues to depth of natural hydrogen sources (phys.org)

Hey guys I built an AI tool that converts invoices into clean Excel sheets (smartinvoice.tech)

Widespread Third-Party Tracking on Hospital Websites: Risks and Liability (2023) [pdf] (pmc.ncbi.nlm.nih.gov)

Kefir 0.5.0 Release Announcement (C17/C23 Compiler) (kefir.protopopov.lv)

From Vibe Coding to Disciplining: AI's Role in Software Development (banes-lab.com)

Show HN: Runner – the anti-vibe coding agent (runnercode.com)

Rails on SQLite: new ways to cause outages (andre.arko.net)

Everything Becomes Extendable (minimal-reflections.pages.dev)

Claude's Memory Architecture Is the Polar Opposite of ChatGPT's (shloked.com)

Sophont announces $9.22M seed round to build multimodal models for healthcare (sophont.med)

Typecasting: The Use and Misuse of Period Typography in Movies (2001) (marksimonson.com)

Ask HN: What do you think is an alternative to AI technique?

How Trump lost the podcast bros (vox.com)

Oh-My-Fish (github.com)

Refrag: Rethinking RAG Based Decoding

Comments (1)

I had the same idea for ...