how to rewrite for crawler {
@bot {
header User-Agent bot
#header User-Agent yandex
#header User-Agent baiduspider
#header User-Agent facebookexternalhit
#header User-Agent embedly
#header User-Agent quora\slink\spreview
#header User-Agent outbrain
#header User-Agent pinterest

root * /root/data/hadi
rewrite /auth/* /index.html

rewrite @bot{uri}


not work.

curl --user-agent “Googlebot/2.1 (+”
return empty

Please fill out the help thread template.

This topic was automatically closed after 30 days. New replies are no longer allowed.