How to Test if nobots is actively functional

Just started using Caddy. Got a webserver going that display a static html splash page. I have added the nobots plugin, created and added a bomb.gz, then used this example from the documentation:

nobots "bomb.gz" { "Mozilla/5.0 (compatible; Googlebot/2.1; +" "Googlebot/2.1 (+" "Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/41.0.2272.96 Mobile Safari/537.36 (compatible; Googlebot/2.1; +" "Googlebot-News" "Googlebot-Image/1.0" "Googlebot-Video/1.0" "compatible; Mediapartners-Google/2.1; +" "Mediapartners-Google" "AdsBot-Google (+" "AdsBot-Google-Mobile-Apps" "APIs-Google (+" }

Caddy server is running and displaying the page.

How can I test if nobots is working as intended now?
Also, with the snippet above, am I correct to understand it will stop every indexing bots pretty much?

download user agent plugin of Firefox. Put Googlebot into your useragent and then access your website.

1 Like

Thanks :slight_smile:

This topic was automatically closed 90 days after the last reply. New replies are no longer allowed.