Create "packages" of context for popular API & Libraries - make them freely available via public url
Keep the packages up to date. They'll be newer than the cutoff date for many models, and they'll be cleaner then the data a model slurps in using web search.
Voila, you're now the trusted repository of context for the developer community.
You'll get a lot of inbound traffic/leads, and ideas for tangential use cases with commercial potential.
You can't start fresh chats with updated context and you still need to create multiple chat in your preferred chat service and copy-paste data. But this is SO good to use with development environment through docs or MCP! Thanks for sharing
hoerzu · 31d ago
To be free and not forward credentials I built an alternative to all-in-one chatting without auth and access to search API through the web:
https://llmcouncil.github.io/llmcouncil/
Provides simple interface to chat with Gemini, Claude, Grok, Openai, deepseek in parallel
tapeo · 31d ago
I love this, it can be very useful to have ready to use library of context data and at the same time a perfect solution to bring in new users. Thanks so much.
lagniappe · 31d ago
Of all the suggestions here, this is the one.
deepdarkforest · 31d ago
wouldn't that be just 3rd party llms.txt?
No comments yet
wewewedxfgdf · 31d ago
I thought about building something along these lines (not the same but vaguely similar).
Then Gemini AI Studio came along with a 1 million token window and allowed me to upload zip files of my entire code base and I lost interest in my own thing.
TZubiri · 31d ago
It technically handles 1M tokens, but if you ask it questions it's obvious that it's too much to handle.
Just upload a novel and ask it questions, you'll see how it botches simple stuff
icelancer · 31d ago
Easiest way to prove it can't handle the full context in reality is to upload a one hour documentary movie with audio and ask it to write timestamps of chapters/critical moments. It can't handle this beyond 10 minutes even remotely reliably.
wewewedxfgdf · 31d ago
Good or bad it's a zillion times better than Claude or ChatGPT where you can't even upload a zipfile.
zwaps · 31d ago
If you want this in numbers check the nolima benchmark
golfer · 31d ago
Seems like this needs to be updated. Lots of newer models not on their list.
douglasisshiny · 31d ago
Is it not a bit weird to freely give give away your entire code base (I assume it's personal, not your company's, but maybe I'm wrong) to an entity like Google?
myflash13 · 31d ago
As a business owner that uses Cursor, this is a real risk that I worry about (third parties stealing my code). However, the massive productivity benefit of having access to AI tools far outweighs the risk of them copying my business based on the code alone. Besides, AI is making code less and less valuable. My code is not the moat -- the hard part is the network, traction, brand, distributions, etc.
douglasisshiny · 30d ago
Do you have actual data showing cursor (or any LLM) is a massive productivity benefit for coding? What are the heuristics?
sampullman · 31d ago
How common is it to have a personal project that isn't open source? Probably more common than I think, but it seems like a foreign concept to me.
Either my code isn't commercialized so I don't mind "giving" it away, or it is commercialized but wouldn't be safe from a clean room implementation anyway. Isn't that what bigco would do of they really wanted to steal your idea?
tapeo · 31d ago
Yes the long context it's complementary, in other chat services like Gemini you have to rewrite that base context everytime for each new fresh chat, plus they lack of specific data import tools and projects management
jmcmaster · 31d ago
How are you handling privacy / security / confidentiality if I upload all this data? No way I could use this for work.
tapeo · 31d ago
Yes actually that it's not a trivial topic.
What I can do is to make it very transparent on how data is managed.
The files content are appended to the context builder, then the context and messages are processed through OpenRouter, which is a provider that offers APIs to all the AI models, and the output generated (and the account data) is stored on a secured database on Mongodb platform.
Because I unfortunately still need to eat and if I'm fired that will be much harder
neuroelectron · 31d ago
Spread the love
jeswin · 31d ago
An agentic flow can solve this within an existing UI/app; I already use such a workflow when I have to bring in project documentation. That will be your competition.
Since it's a commercial product and feedback can be useful: people would generally be hesitant to leave their existing apps if there's a workaround. There's a certain stickiness to them, even ChatGPT. Personally I use self-hosted LibreChat, and the history and additional features it provides are important to me.
tapeo · 31d ago
I appreciate the feedback!
Yes I will work on make the context management more productive with a ready to use service and with abilities to switch from other services easily.
owebmaster · 31d ago
There is a huge market available not using any App yet.
iankp · 31d ago
Isn't NotebookLM already exactly web and file context (a "ContextChat")?
Edit: I assume it is basically a similar product, but your differentiators are mainly the customer getting to choose their model, and you getting to write your own context adding ergonomics (like adding links from a Sitemap)?
tapeo · 31d ago
Exactly, similar plus tools to import and manage projects context fast (like GitHub private repos and sitemaps url), multiple ai model and pay per use like using APIs
imranq · 31d ago
Nice idea!
I think it would be better if it was just context and not connected to any model. Think of one place where you can hook in your drive folder, GitHub, etc. and have it produce the best context for the task you want to achieve. Then users can copy that to their model or workflow of choice
tapeo · 31d ago
Thank you, this could be a cool feature too add! For example the ability to click a link that redirects to other chat services with your project base context you built and optionally all the messages sent until there
For what I can see it doesn't offers the flexibility of importing content from a detailed sitemap or private GitHub repositories in a fast way (and more tools to come).
Then it doesn’t has the possibility to switch to different AI models plus you have to pay a monthly subscription.
scottward · 31d ago
Cool! I was excited when I saw this and signed up.
One key thing I was hoping for was a consistent resync with source material particularly google docs. Looks like I'll have to download then upload to your app whenever they change.
Is that right? Auto syncing in the plan?
tapeo · 31d ago
Auto syncing added to the plan!
scottward · 31d ago
Cool. One option is just to integrate with make/n8n/zapier so I could a) trigger on doc changes and then b) upload (and overwrite) the doc in your app
tapeo · 31d ago
Yes this sounds very useful and productive. Having project context updated based on external events. I will share it on socials when ready, thanks for the feedback!
scottward · 31d ago
Sure! Email your users too - since I'm one of them I'll get the email. :)
tapeo · 31d ago
Will do thanks again!
causalmodels · 31d ago
This is really nice. Any chance you have conversation branching on the roadmap?
Conversation branching released! send a message if you want to share your opinion!
tapeo · 31d ago
I tried to solve my own problems that I had while copy and pasting the same starting context from chat to chat. Now I can generate the base context and start new chats from there.
ramoz · 31d ago
Yes def a needed thing for power users.
You and I are going to end up competing because im evovling my original solution in this space, https://github.com/backnotprop/prompt-tower ... best of luck, great execution thus far.
tapeo · 31d ago
Thank you, will take a look at your software, competition is always good
J_cst · 31d ago
I use RooCode and find it quite effective with the ability to switch agents and models within the tasks currently. I recently moved from Cline to RooCode.
tapeo · 31d ago
Yes could be an alternative if you only need it on a development environment
dangus · 31d ago
So now our jobs are shifting from doing work, to telling the AI to do work, so now we need management tools to better manage how we are telling the AI to do work.
I must have taken a turn to the wrong timeline.
icelancer · 31d ago
Yeah. That's how it works with employees, too.
tapeo · 31d ago
New tools for a new kind of work!
econ · 31d ago
You give instructions as someone who can do the job themselves.
That ability will decay of course and you will be managing with the best of them. Eh, I mean the worse :)
ta988 · 31d ago
10% fee over the openrouter fees. That's fees all the way down.
tapeo · 31d ago
You're right, I have in roadmap to optmize it by using directly the providers APIs. Would you prefer different pricing like lifetime license?
subscribed · 30d ago
That's a modest price for the service. It's like using openrouter - you don't have to use it, right?
argestes · 31d ago
This is nice. I would love to be in a mailing list regarding updates
Create "packages" of context for popular API & Libraries - make them freely available via public url
Keep the packages up to date. They'll be newer than the cutoff date for many models, and they'll be cleaner then the data a model slurps in using web search.
Voila, you're now the trusted repository of context for the developer community.
You'll get a lot of inbound traffic/leads, and ideas for tangential use cases with commercial potential.
Provides simple interface to chat with Gemini, Claude, Grok, Openai, deepseek in parallel
No comments yet
Then Gemini AI Studio came along with a 1 million token window and allowed me to upload zip files of my entire code base and I lost interest in my own thing.
Just upload a novel and ask it questions, you'll see how it botches simple stuff
Either my code isn't commercialized so I don't mind "giving" it away, or it is commercialized but wouldn't be safe from a clean room implementation anyway. Isn't that what bigco would do of they really wanted to steal your idea?
What I can do is to make it very transparent on how data is managed.
The files content are appended to the context builder, then the context and messages are processed through OpenRouter, which is a provider that offers APIs to all the AI models, and the output generated (and the account data) is stored on a secured database on Mongodb platform.
It’s all defined in the privacy policy here: https://contextch.at/docs/privacy-policy/index.html
[1] https://techpolicy.sanford.duke.edu/blogroll/fortune-500-com...
[2] https://techpolicy.sanford.duke.edu/blogroll/examining-data-...
Since it's a commercial product and feedback can be useful: people would generally be hesitant to leave their existing apps if there's a workaround. There's a certain stickiness to them, even ChatGPT. Personally I use self-hosted LibreChat, and the history and additional features it provides are important to me.
Yes I will work on make the context management more productive with a ready to use service and with abilities to switch from other services easily.
Edit: I assume it is basically a similar product, but your differentiators are mainly the customer getting to choose their model, and you getting to write your own context adding ergonomics (like adding links from a Sitemap)?
I think it would be better if it was just context and not connected to any model. Think of one place where you can hook in your drive folder, GitHub, etc. and have it produce the best context for the task you want to achieve. Then users can copy that to their model or workflow of choice
https://repoprompt.com/
https://www.anthropic.com/news/projects
Then it doesn’t has the possibility to switch to different AI models plus you have to pay a monthly subscription.
One key thing I was hoping for was a consistent resync with source material particularly google docs. Looks like I'll have to download then upload to your app whenever they change.
Is that right? Auto syncing in the plan?
You and I are going to end up competing because im evovling my original solution in this space, https://github.com/backnotprop/prompt-tower ... best of luck, great execution thus far.
I must have taken a turn to the wrong timeline.
That ability will decay of course and you will be managing with the best of them. Eh, I mean the worse :)