{"id":360158,"date":"2026-09-09T21:03:48","date_gmt":"2026-09-09T21:03:48","guid":{"rendered":"https:\/\/wordpress.org\/plugins\/globe-boss-crawlboost\/"},"modified":"2026-10-11T22:25:54","modified_gmt":"2026-10-11T22:25:54","slug":"globe-boss-crawlboost","status":"publish","type":"plugin","link":"https:\/\/ary.wordpress.org\/plugins\/globe-boss-crawlboost\/","author":18049618,"comment_status":"closed","ping_status":"closed","template":"","meta":{"version":"2.7.0","stable_tag":"2.7.0","tested":"7.1.3","requires":"6.0","requires_php":"7.4","requires_plugins":null,"header_name":"Globe Boss CrawlBoost","header_author":"Globe Boss","header_description":"A read-only crawl diagnostics console. Measures how Google & Bing crawlers reach your site \u2014 HTTP health, 304 validators, soft-404s, wasteful URLs, and IndexNow change notifications. Never modifies your sitemap, robots.txt, canonicals, or meta robots.","assets_banners_color":"0f1424","last_updated":"2026-10-11 22:25:54","external_support_url":"","external_repository_url":"","donate_link":"","header_plugin_uri":"https:\/\/www.globeboss.com\/crawlboost\/","header_author_uri":"https:\/\/www.globeboss.com\/","rating":0,"author_block_rating":0,"active_installs":0,"downloads":187,"num_ratings":0,"support_threads":0,"support_threads_resolved":0,"author_block_count":0,"sections":["description","installation","faq","changelog"],"tags":{"2.6.1":{"tag":"2.6.1","author":"globeboss","date":"2026-09-09 21:03:38","revision":3688998},"2.7.0":{"tag":"2.7.0","author":"globeboss","date":"2026-10-11 22:25:54","revision":3740214}},"upgrade_notice":{"2.7.0":"<p>Documentation fix. No functional changes. The Crawler Log Analyser was always included free; the previous readme described it as a paid feature in error.<\/p>","2.0.0":"<p>Major rebuild. CrawlBoost is now a read-only diagnostics console that works alongside your SEO plugin. Old sitemap\/robots data is removed automatically on update.<\/p>"},"ratings":[],"assets_icons":{"icon-128x128.png":{"filename":"icon-128x128.png","revision":3689013,"resolution":"128x128","location":"assets","locale":"","width":128,"height":128},"icon-256x256.png":{"filename":"icon-256x256.png","revision":3689013,"resolution":"256x256","location":"assets","locale":"","width":256,"height":256}},"assets_banners":{"banner-1544x500.png":{"filename":"banner-1544x500.png","revision":3689013,"resolution":"1544x500","location":"assets","locale":"","width":1544,"height":500},"banner-772x250.png":{"filename":"banner-772x250.png","revision":3689013,"resolution":"772x250","location":"assets","locale":"","width":772,"height":250}},"assets_blueprints":{},"all_blocks":[],"tagged_versions":["2.6.1","2.7.0"],"block_files":[],"assets_screenshots":[],"screenshots":[]},"plugin_section":[],"plugin_tags":[12510,209544,23519,204677,158001],"plugin_category":[55],"plugin_contributors":[277270],"plugin_business_model":[],"class_list":["post-360158","plugin","type-plugin","status-publish","hentry","plugin_tags-crawl","plugin_tags-crawl-budget","plugin_tags-diagnostics","plugin_tags-indexnow","plugin_tags-log-analysis","plugin_category-seo-and-marketing","plugin_contributors-globeboss","plugin_committers-globeboss"],"banners":{"banner":"https:\/\/ps.w.org\/globe-boss-crawlboost\/assets\/banner-772x250.png?rev=3689013","banner_2x":"https:\/\/ps.w.org\/globe-boss-crawlboost\/assets\/banner-1544x500.png?rev=3689013","banner_rtl":false,"banner_2x_rtl":false},"icons":{"svg":false,"icon":"https:\/\/ps.w.org\/globe-boss-crawlboost\/assets\/icon-128x128.png?rev=3689013","icon_2x":"https:\/\/ps.w.org\/globe-boss-crawlboost\/assets\/icon-256x256.png?rev=3689013","generated":false},"screenshots":[],"raw_content":"<!--section=description-->\n<p>CrawlBoost is a <strong>diagnostics layer<\/strong>, not another SEO plugin. It measures how efficiently crawlers reach your site and tells you what to fix \u2014 but it never modifies your XML sitemap, robots.txt, canonical tags or meta robots. That means it works <strong>alongside<\/strong> Yoast, Rank Math, SEOPress or All in One SEO instead of fighting them.<\/p>\n\n<p>Everything below is included. There is no paid tier, no locked feature and no upgrade prompt.<\/p>\n\n<h4>Crawler Log Analyser<\/h4>\n\n<p>Upload your server access log \u2014 Apache or Nginx combined format, plain or gzipped \u2014 and CrawlBoost parses it in PHP on your own server. The file is never transmitted anywhere.<\/p>\n\n<p>You get the data no SEO plugin can give you, because none of them read your logs:<\/p>\n\n<ul>\n<li>Which crawlers actually visited, and how often<\/li>\n<li>What they fetched most, and what they never reached<\/li>\n<li>The status codes your server returned to each bot<\/li>\n<li>Crawl budget spent on URLs that should never have been crawled<\/li>\n<li>Fake crawlers \u2014 requests claiming to be Googlebot, verified by IP<\/li>\n<\/ul>\n\n<p>Access logs contain IP addresses and are personal data under GDPR, which is exactly why parsing happens locally and nothing is uploaded to a third party.<\/p>\n\n<h4>On-site diagnostics<\/h4>\n\n<ul>\n<li><strong>Page Inventory Health<\/strong> \u2014 flags empty, thin and noindex pages across your published content, with page-builder awareness for WPBakery, Elementor, Divi and GoodLayers so builder-driven pages are not falsely reported as empty.<\/li>\n<li><strong>Soft-404 &amp; Status Integrity Scan<\/strong> \u2014 finds pages that return HTTP 200 but read like missing pages, and audits your existing sitemap for URLs resolving to 3xx, 4xx or 5xx. The sitemap is read in-process, with no loopback HTTP requests, so it works on hosts with low PHP worker limits.<\/li>\n<li><strong>HTTP Validator Audit<\/strong> \u2014 checks whether unchanged pages return <code>304 Not Modified<\/code> to conditional requests (ETag \/ Last-Modified). Audit only; it never forces 304 responses.<\/li>\n<li><strong>URL Waste Radar<\/strong> \u2014 flags tracking, filter, session, feed, cart, REST and trackback URLs in your content that waste crawl budget. Detection only, and it names which system owns each fix.<\/li>\n<li><strong>IndexNow Change Notifications<\/strong> \u2014 instantly tells Bing, Yandex, Seznam, Naver and Yep when you publish, update or delete a page. Automatically stays off when your SEO plugin already provides IndexNow, to avoid duplicate submissions.<\/li>\n<\/ul>\n\n<p>Every finding shows the tested URL, the response, why it may matter, and <strong>which system owns the fix<\/strong> \u2014 because CrawlBoost reports, it doesn't change your site.<\/p>\n\n<h3>External services<\/h3>\n\n<p>This plugin connects to one external service, and only when the site owner explicitly enables it.<\/p>\n\n<p><strong>IndexNow (api.indexnow.org)<\/strong><\/p>\n\n<p>The plugin sends URL-change notifications to the IndexNow API so that participating search engines (Bing, Yandex, Seznam, Naver, Yep) are told immediately when a public page on your site is published, updated or deleted. This service is only used when the site owner enables IndexNow on the CrawlBoost settings screen. When enabled, on each qualifying post transition or deletion the plugin sends a POST request to https:\/\/api.indexnow.org\/indexnow containing: the site's host, a plain-text key generated by the plugin, the public URL of the key verification file hosted on the same site, and the list of URLs that have changed. No visitor data, no personal data and no post content is transmitted \u2014 only public URLs of the site's own content. If IndexNow is not enabled, no requests are made.<\/p>\n\n<p>IndexNow is a shared protocol operated by Microsoft and other participating search engines. See the IndexNow documentation and terms at https:\/\/www.indexnow.org\/documentation and the Bing Webmaster \/ IndexNow terms of use at https:\/\/www.bing.com\/webmasters\/help\/indexnow-8752a615 and privacy statement at https:\/\/privacy.microsoft.com\/privacystatement .<\/p>\n\n<p>The Crawler Log Analyser uses no external service. Uploaded logs are parsed entirely on your own server and are not transmitted anywhere.<\/p>\n\n<!--section=installation-->\n<ol>\n<li>Upload the <code>globe-boss-crawlboost<\/code> folder to <code>\/wp-content\/plugins\/<\/code>, or install through the Plugins screen.<\/li>\n<li>Activate the plugin.<\/li>\n<li>Open CrawlBoost in the admin menu and run each scan.<\/li>\n<li>To use the Crawler Log Analyser, download an access log from your host \u2014 usually under Raw Access in cPanel or Access Logs in your host panel \u2014 and upload it on the Log Analyser screen.<\/li>\n<\/ol>\n\n<!--section=faq-->\n<dl>\n<dt id=\"does%20this%20conflict%20with%20my%20seo%20plugin%3F\"><h3>Does this conflict with my SEO plugin?<\/h3><\/dt>\n<dd><p>No. CrawlBoost is read-only \u2014 it never writes sitemaps, robots.txt, canonicals or meta robots. It detects your SEO plugin and works alongside it.<\/p><\/dd>\n<dt id=\"where%20do%20i%20find%20my%20server%20access%20log%3F\"><h3>Where do I find my server access log?<\/h3><\/dt>\n<dd><p>Most hosts expose it under Raw Access in cPanel, or Access Logs in your hosting panel. CrawlBoost reads Apache and Nginx combined-format logs, plain or gzipped.<\/p><\/dd>\n<dt id=\"is%20my%20log%20file%20uploaded%20anywhere%3F\"><h3>Is my log file uploaded anywhere?<\/h3><\/dt>\n<dd><p>No. Parsing happens in PHP on your own server and the file is never transmitted to any third party.<\/p><\/dd>\n<dt id=\"how%20large%20a%20log%20file%20can%20it%20handle%3F\"><h3>How large a log file can it handle?<\/h3><\/dt>\n<dd><p>Parsing runs inside a normal PHP execution window, so the ceiling is whatever your host allows. If a file times out, split it by date range and upload the parts separately.<\/p><\/dd>\n<dt id=\"does%20it%20slow%20down%20my%20site%3F\"><h3>Does it slow down my site?<\/h3><\/dt>\n<dd><p>No. Scans are run manually from the admin screens, are batched and locked to a single run at a time, and nothing runs on front-end page loads.<\/p><\/dd>\n<dt id=\"why%20doesn%27t%20indexnow%20notify%20google%3F\"><h3>Why doesn't IndexNow notify Google?<\/h3><\/dt>\n<dd><p>Google does not participate in the IndexNow protocol. IndexNow notifies Bing, Yandex, Seznam, Naver and Yep.<\/p><\/dd>\n<dt id=\"will%20it%20fix%20the%20problems%20it%20finds%3F\"><h3>Will it fix the problems it finds?<\/h3><\/dt>\n<dd><p>No, by design. It shows you what to fix and where \u2014 your SEO plugin, theme, host or server. Making those changes itself is how plugins conflict with each other and break sites.<\/p><\/dd>\n<dt id=\"is%20there%20a%20paid%20version%3F\"><h3>Is there a paid version?<\/h3><\/dt>\n<dd><p>No. CrawlBoost is free, and every feature is included.<\/p><\/dd>\n\n<\/dl>\n\n<!--section=changelog-->\n<h4>2.7.0<\/h4>\n\n<ul>\n<li>Documentation corrected. The previous readme and plugin header described the pre-rebuild diagnostics architecture and incorrectly listed the Crawler Log Analyser and related features as a separate paid product. The Log Analyser has been included in the free plugin since the 2.2.0 rebuild.<\/li>\n<li>Removed the Pro advertising submenu, promotional banner and Free-vs-Pro comparison table. There is no paid tier.<\/li>\n<li>Plugin header description updated to match the shipped feature set.<\/li>\n<\/ul>\n\n<h4>2.2.0 \u2013 2.6.1<\/h4>\n\n<ul>\n<li>Undocumented at the time of release. The significant change across these versions was the move away from loopback HTTP scanning, which failed on hosts with low PHP worker limits, to the Crawler Log Analyser and internal WP_Query-based inventory checks. Every scan now runs without the plugin making HTTP requests to its own site.<\/li>\n<\/ul>\n\n<h4>2.0.0<\/h4>\n\n<ul>\n<li>Complete rebuild as a read-only crawl diagnostics console: Crawl Health Monitor, HTTP Validator Audit (304), Soft-404 &amp; Status Integrity Scan, URL Waste Radar, and IndexNow change notifications. Removed all site-modifying features (XML\/HTML sitemap, robots.txt editor) to guarantee zero conflict with SEO plugins. Automatic migration cleans up data from earlier versions.<\/li>\n<\/ul>","raw_excerpt":"Read your server access log inside WordPress and see what Google, Bing and AI crawlers actually did. Read-only, works alongside any SEO plugin.","jetpack_sharing_enabled":true,"_links":{"self":[{"href":"https:\/\/ary.wordpress.org\/plugins\/wp-json\/wp\/v2\/plugin\/360158","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/ary.wordpress.org\/plugins\/wp-json\/wp\/v2\/plugin"}],"about":[{"href":"https:\/\/ary.wordpress.org\/plugins\/wp-json\/wp\/v2\/types\/plugin"}],"replies":[{"embeddable":true,"href":"https:\/\/ary.wordpress.org\/plugins\/wp-json\/wp\/v2\/comments?post=360158"}],"author":[{"embeddable":true,"href":"https:\/\/ary.wordpress.org\/plugins\/wp-json\/wporg\/v1\/users\/globeboss"}],"wp:attachment":[{"href":"https:\/\/ary.wordpress.org\/plugins\/wp-json\/wp\/v2\/media?parent=360158"}],"wp:term":[{"taxonomy":"plugin_section","embeddable":true,"href":"https:\/\/ary.wordpress.org\/plugins\/wp-json\/wp\/v2\/plugin_section?post=360158"},{"taxonomy":"plugin_tags","embeddable":true,"href":"https:\/\/ary.wordpress.org\/plugins\/wp-json\/wp\/v2\/plugin_tags?post=360158"},{"taxonomy":"plugin_category","embeddable":true,"href":"https:\/\/ary.wordpress.org\/plugins\/wp-json\/wp\/v2\/plugin_category?post=360158"},{"taxonomy":"plugin_contributors","embeddable":true,"href":"https:\/\/ary.wordpress.org\/plugins\/wp-json\/wp\/v2\/plugin_contributors?post=360158"},{"taxonomy":"plugin_business_model","embeddable":true,"href":"https:\/\/ary.wordpress.org\/plugins\/wp-json\/wp\/v2\/plugin_business_model?post=360158"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}