20 Jan
2013
20 Jan
'13
12:15 p.m.
Hi,
this is due multiple web spiders (Bing, Baidu, ...) hitting the trac and cgit. Patches for the robots.txt are welcome.
Put this in git.osmocom.org/robots.txt (currently it returns 403)
--- User-agent: * Disallow: / ---
The git should just not be crawled at all IMHO.
Cheers,
Sylvain