pull down to refresh
robots.txt is for crawlers, llms.txt is for LLMs (there are some competing proposals)
robots.txt
llms.txt
robots.txtis for crawlers,llms.txtis for LLMs (there are some competing proposals)