mirrors/nitter
Watch
1
0
Fork
You've already forked nitter
 0
mirror of https://github.com/zedeus/nitter synced 2026-09-05 22:59:31 +00:00
Code Issues Projects Releases Packages Wiki Activity
963 commits 5 branches 0 tags 7.5 MiB
Commit graph nitter/public/robots.txt
Author SHA1 Message Date
minus
c543a1df8c
 		Block search engines via robots.txt (#631) 
Prevents instances from being rate limited due to being senselessly
crawled by search engines. Since there is no reason to index Nitter
instances, simply block all robots. Notably, this does *not* affect link
previews (e.g. in various chat software).
 2022-06-04 17:48:25 +02:00