Does Adsbot obey a global (“\*”) disallow? In their doc (List of Google’s special-case crawlers) I found following passage: `AdsBot` ignores the global robots.txt user agent (`*`) with the ad publisher’s permission.
Any ideas what “with the ad publisher’s permission.” means? In other docs google explicitly states that \* does not affect adsbot crawling.
Trend Engine: AI-Powered News & Trends 