slow osmocom website

Sylvain Munaut 246tnt at gmail.com
Sun Jan 20 11:15:38 UTC 2013


Hi,

> this is due multiple web spiders (Bing, Baidu, ...) hitting the trac
> and cgit. Patches for the robots.txt are welcome.


Put this in git.osmocom.org/robots.txt  (currently it returns 403)

---
User-agent: *
Disallow: /
---

The git should just not be crawled at all IMHO.

Cheers,

   Sylvain




More information about the baseband-devel mailing list