Simple robots.txt template. Keep unwanted robots out (disallow). White lists (allow) legitimate user-agents. Useful for all websites.
-
Updated
Feb 18, 2024
Simple robots.txt template. Keep unwanted robots out (disallow). White lists (allow) legitimate user-agents. Useful for all websites.
Current CIDR-formatted list of unwanted bots caught on my systems.
collection of bash scripts to fill iptables with ip adresses
Automatically Block Followers of the user(s).
Add a description, image, and links to the blocking-bots topic page so that developers can more easily learn about it.
To associate your repository with the blocking-bots topic, visit your repo's landing page and select "manage topics."