AI Scrape Protect is a WordPress plugin designed to protect your website from scraping for AI training purposes. It achieves this by adding opt-out instructions to the robots.txt file for the most common AI scraping bots and including meta tags to control how your content is used.
Version 5.0 introduces a full settings page with granular per-bot control, categorised bot management, AJAX-powered toggles, and support for custom user agents.
Features
- Adds
User-agentandDisallowrules to yourrobots.txtfile to block a comprehensive list of AI scraping bots. - Generates compact robots.txt output: all blocked bots are grouped under a single
Disallow: /directive. - Introduces meta tags in the HTML
<head>to provide additional instructions to AI bots. - Separate toggles for content meta tags (
noai,nosummary,DisallowAITraining) and image meta tags (noimageai). - Settings page with five categorised tabs: Search Engines, AI Training, AI Search & Answers, General Indexing, Custom Bots.
- Group toggle per category to block or allow all bots in that category at once.
- Individual per-bot toggle with description and company information for each bot.
- Custom bots tab: add and remove your own user agent strings.
- Global enable/disable toggle and separate toggles for robots.txt and meta tags.
- “Apply default settings” button to reset all options.
- Admin bar icon linking to the settings page (visible to administrators only). Icon reflects the current enabled state.
- Physical
robots.txtdetection notice: warns you if a file in your root directory overrides WordPress’s virtual robots.txt. - Fully AJAX-powered settings page: changes are saved instantly without page reloads.
- Extensible via the
aisp_user_agentsfilter for developers. - Multisite note: settings are stored per site using
get_option/update_option. Network-wide configuration is not supported.
Note: robots.txt and meta tag opt-out instructions are not always respected by all bots. This plugin is a measure to discourage scraping rather than a guaranteed technical block.
Screenshots
Settings page: Global toggles for enabling robots.txt rules and meta tags.
Bot management tabs: Per-category tabs with individual bot toggles and descriptions.
Custom bots tab: Add and remove your own user agent strings.
robots.txt output: Compact grouped format with all blocked bots under a single Disallow directive.