Consider adding llms.txt to provide information to help LLMs use a website at inference time

[likidu]

Is your feature request related to a problem? Please describe.
Our docs should be ready for the AI.

llms.txt (https://llmstxt.org/) is a new emerging standard to add a /llms.txt markdown file to websites to provide LLM-friendly content. This file offers brief background information, guidance, and links to detailed markdown files.

Describe the solution you'd like

Add /llms.txt in our docs for AI LLMs to easily inference the content just like /robot.txt for search engine.

Describe alternatives you've considered
A clear and concise description of any alternative solutions or features you've considered.

Additional context

Here is a curated list of llms.txt that used for other products:
https://directory.llmstxt.cloud/

We can pretty much learn and re-used what they have been doing.