✨ Add robots.txt to allow AI crawlers
Introduce a new robots.txt file to explicitly allow various AI crawlers to access the site, enhancing visibility and indexing by search engines.
Introduce a new robots.txt file to explicitly allow various AI crawlers to access the site, enhancing visibility and indexing by search engines.