Fix Tavily API compatibility with exe.dev documentation

GitHub issue #202 Feature Shipped ibuildthecloudvia discord May 11, 2026 View Discord message View GitHub mirror

Author: ibuildthecloud Channel: #feedback Link: https://discord.com/channels/1405685085923049482/1405686161791516873/1502805161746235503


Issue

Tavily's webfetch/extract API cannot read exe.dev docs.

Context

This was discovered during documentation access attempts. A workaround exists: markdown versions of docs can be accessed by appending .md to the URL (e.g., https://exe.dev/docs/shelley/llm-gateway.md).

Next Steps

  • Investigate why Tavily's crawler is unable to parse exe.dev documentation
  • Determine if this is a site structure/formatting issue or a Tavily API limitation
  • Consider implementing a fix to make docs more accessible to web scraping tools

Attachments

discord-bug

1 Comment

josharianvia github May 13, 2026

This should be fixed now.