Ask HN: Any PDF Benchmarks?

1 nnurmanov 1 6/13/2025, 7:16:51 AM

I am testing several PDF parsing libraries, and unfortunately, most of them have issues. For example, many struggle with non-English languages, while others can’t reliably handle tables. Having a standardized PDF benchmark would be incredibly helpful — at the very least, it would allow us to identify obvious shortcomings without needing to install and test each library individually.

Is anyone building such a benchmark?

Comments (1)

nnurmanov · 19h ago

For example, markitdown from MS can't recognize Cyrillic text, when I started researching into it, I found that they use pdfminer.six under the hood and there is an unresolved issue with supporting languages.

Docling is OK with tables, but fails with cyrillic text;

marker-pdf is OK with tables, but it also fails with cyrillic text;

What other pdf parser libraries exist? I am looking for preferably on-premise solutions, but if I won't find a reliable and accurate solution, I might consider cloud based solutions as well.

Regenerate Your Land (gramagrasslivestock.com)

Show HN: Hack to Save Any Videos from YouTube (github.com)

The Tech Job Meltdown (professoraxelrod.com)

Fastmigrate: Database Migrations for SQLite (github.com)

When Lee Miller Took a Bath in Hitler's Tub (newyorker.com)

Show HN: QuickGenAI – Turn Any Link into AI Lead Magnet (quickgen.ai)

Signed Git pushes for Linux kernel development server (2020) (people.kernel.org)

Solving Life's Annoyances with Constraint Programming [video] (youtube.com)

Propagation via lazy clause generation (2009) (link.springer.com)

MLB removes A's 'reverse boycott' game broadcasts from digital archive (sfgate.com)

There Aren't Enough Cables to Meet Growing Electricity Demand (bloomberg.com)

Show HN: Dual Elliptic Curve Math Backdoor in Python (leetarxiv.substack.com)

Rethinking Losses for Diffusion Bridge Samplers (arxiv.org)

The twom database format (fastmail.com)

The Case for Code‑Centric System Dynamics (SD) (teachyourselfsystems.com)

C2y: Hitting the Ground Running (thephd.dev)

Building web apps from scratch – HTTP – Part 4 (coz.is)

Japan struggles to fend off a world without enough matcha (japantimes.co.jp)

Meta AI searches made public – but do all its users realise (bbc.com)

Alexandr Wang – What I learned in 2016 (medium.com)

Window-sized device taps the air for safe drinking water (news.mit.edu)

Apple's Liquid Glass Effect for React (github.com)

Hybrid Still Isn't Working (hbr.org)

Show HN: A visual, knowledge map based interface for deep research/deep dives (proread.ai)

Show HN: SharkMCP, a Tshark MCP Server (github.com)

Ecology: A World Without Mosquitoes (nature.com)

Intel Vulkan Linux Driver Lands Initial Support for VP9 Decoding (phoronix.com)

How to make StackExchange (and others) more fun (rubenerd.com)

FIFA 'more poorly governed today than 10 years ago' (theguardian.com)

Random AI Greentext Generator (haiku.tulv.in)

Solving LinkedIn Queens with APL (pitr.ca)

Ask help Need endorsment to publish a working AI alignment protocol to ArXiv

How to Choose a Good Scientific Problem [pdf] (cell.com)

Ahead of Protests, Waymo Scales Back Robotaxi Service Nationwide (wired.com)

Subpixel Zoo: A Catalog of Subpixel Geometry (geometrian.com)

Ask HN: Genuine alternatives to Google and Apple for releasing paid apps

Coming to Apple OSes: A seamless, secure way to import and export passkeys (arstechnica.com)

Chess with Different Armies (chessvariants.com)

Anne Wojcicki is taking back control of 23andMe (theverge.com)

Historical Tech Tree (historicaltechtree.com)

Tying Yourself to the Mast (usefulfictions.substack.com)

Protecting Gemini from Prompt Injection Attacks (security.googleblog.com)

Show HN: Automate final cut pro's XML language

Cloudflare Radar – AI Insights (radar.cloudflare.com)

Lemony is a plug-and-play device for secure on-premise AI (venturebeat.com)

New York passes a bill to prevent AI-fueled disasters (techcrunch.com)

Poets on Translation: Otherwise the Same (poetryfoundation.org)

Photon transport through the entire adult human head (spiedigitallibrary.org)

U.S. Army bringing in big tech executives as lieutenant colonels (taskandpurpose.com)

Show HN: Gem and I built an open-source app to learn Japanese (nihongo.site)

Ask HN: Any PDF Benchmarks?

Comments (1)