AI Crawler Index

AI Crawler Index

Official
1.0.0 Remote connection

MCP server for Task Machine agents. Identify AI crawlers by user-agent or IP, and build the robots.txt that matches your stance.

Use AI Crawler Index with Task Machine Website