Fix Tavily API compatibility with exe.dev documentation
Author: ibuildthecloud Channel: #feedback Link: https://discord.com/channels/1405685085923049482/1405686161791516873/1502805161746235503
Issue
Tavily's webfetch/extract API cannot read exe.dev docs.
Context
This was discovered during documentation access attempts. A workaround exists: markdown versions of docs can be accessed by appending .md to the URL (e.g., https://exe.dev/docs/shelley/llm-gateway.md).
Next Steps
- Investigate why Tavily's crawler is unable to parse exe.dev documentation
- Determine if this is a site structure/formatting issue or a Tavily API limitation
- Consider implementing a fix to make docs more accessible to web scraping tools
Attachments
discord-bug
1 Comment
This should be fixed now.