Show HN: Convert Large CSV/XLSX to JSON or XML in Browser
Here's a few things that makes this converter different: - runs in the browser - all parsing and conversion is client side can handle data any size data - automatically detects delimiters, encodings, and data types as it parses - Live preview with column renaming, search/replace, and data cleanup - Export to JSON or XML — clean, structured output that can be used for API or Databases
backstory: I built this tool for myself. I work with massive CSV and TXT files, some over 10GB, and opening them in Excel would freeze my laptop, some of the online converters only limits to a certain size, so I started learning Python and pandas but ended up wasting so much time trying different delimiters or fixing badly structured data just to make it usable, and I thought this would be a really fun project to build
I'd love some feedback. Thank you
URL: https://csvforge.com
Shameless plug: I am working on a similar problem of Excel not being a great tool for large datasets. My desktop app[1] lets you import raw data files and query them using SQL. (The website needs to be updated, the app looks much better than the current screenshots).
[1]: https://textquery.app
1. Open the site in an incognito window.
2. Turn off your Internet.
3. Do what you’ve got to do.
4. Close browser window.
As a bonus, and this makes it is better than just flipping the offline switch in developer tools, if you turn off Internet in a way that keeps the browser thinking it’s online, you can also peek at whether any network requests are made (for pathological cases where the app does everything locally but phones home anyway).
The funny thing is that it feels safer to download a desktop app and give it the same data even though it's usually much harder to validate if it's shipping your data somewhere else.
What kind of safeguards are possible with a web app?
A couple of kb of open standard vanilla js that does some simple things faster than legacy spreadsheets etc ever could.
Even to the point of creating invoices, reports etc based on standard filters stored in local storage…
If so, how much time did it take you?