Our VOD-Servers are being crawled by the Googlebot (User Agent “Googlebot-Video/1.0”)
We have many terabytes of data there and we want to avoid that traffic.
I would like to put a robots.txt to prevent the googlebot from continuing.
Wowza runs on its own subdomain so the robots.txt would need to be hosted from Wowza itself.
Is there a good practice for that
Or does wowza support ways of setting up the X-Robots-Tag in the HTTP headers?