Lots of people want to use to scrape pdf links which we already support by default but looking at some of the logs and comments on the docs we still run into issues. Would be good to have more reliable methods + more/better fallbacks.

I think the currently implementation only gets the text from the html but it doesn't convert to markdown. Would be nice to attempt a conversion.