Understanding Context Windows

Comments (2)

johndonavon · 2h ago

I think degraded performance as the context window increases is one of the largest issues models are facing today. Do you think we've reached the end of any "RAM" based context performance and that external storage/ retrieval mechanisms is the only way forward?

rkayg · 1h ago

I think we're in the early innings of RAM implementations. I also think RAM and external storage / retrieval are kind of the same thing in that efficient RAM implementation works best w/ another storage system. I hope to do a deeper dive here, but in the mean time check out https://arxiv.org/abs/2310.08560

Ask HN: Why Is My Happiness Tied to My Productivity?

Snapchat open source cross-platform mobile framework. Looking for beta testers

We'll need a universal basic income (UBI) in an AI-driven world

GitHub Outage?

Tell HN: Regulations.gov Comments API is shutting down on Friday

Google's RCS disconnected in several countries

Ask HN: How can ChatGPT serve 700M users when I can't run one GPT-4 locally?

Ask HN: What toolchains are people using for desktop app development in 2025?

Ask HN: With all the AI hype, how are software engineers feeling?

Ask HN: What trick of the trade took you too long to learn?

Comparing 6M Feature Selection Methods on Credit Risk Data

Ask HN: What tech skill gave you the biggest boost in your career?

Ask HN: Has anyone built anything useful using AI?

Tell HN: Anthropic expires paid credits after a year

Vectorless: open-source PDF chatbot without RAG

Ask HN: Has any of the Pivotal Tracker replacement attempts succeeded?

Ask HN: What are some comfy/stress-free jobs a SWE can do? (LCOL country)

What's your favorite CLI tool for integrating LLMs into your terminal workflow?

Ask HN: Advice for someone who wants to try AI-assisted coding?

Ask HN: Canadian founders, how do you build in SF?

Does anyone know a detailed residential cost estimator

Ask HN: Why is Usenet not coming back?

Ask HN: Best way to get a land line for my kids?

Ask HN: What do you dislike about ChatGPT and what needs improving?

Ask HN: What's Going on with AI Psychosis?

Feature Request: "Copy" Button Should Copy Only Main Output

GPT5 is worse than 4.1-mini for text and worse than Sonnet 4 for coding

ChatGPT 5 is slow and no better than 4

Ask HN: How would you build second brain in the AI era?

Ask HN: In which programming language is it better to make your own language?

Ask HN: Do you think differently about working on open source these days?

ChatGPT-5 Can't Do Basic Math

Tell HN: Charles Irby has passed away

GPT-5 streaming requires submission of biometric data

Ask HN: Are you running local LLMs? What are your key use cases?

Ask HN: OpenAI GPT-5 API seems to be significantly slower – is this expected?

Understanding Context Windows

Comments (2)