savannah-hackers-public
[Top][All Lists]
Advanced

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[Savannah-hackers-public] Please disallow www-commits in robots.txt


From: Thérèse Godefroy
Subject: [Savannah-hackers-public] Please disallow www-commits in robots.txt
Date: Wed, 10 May 2023 18:18:36 +0200
User-agent: Mozilla/5.0 (X11; Linux x86_64; rv:102.0) Gecko/20100101 Thunderbird/102.10.0

Hello,

I was searching for an article with DuckDuckGo, and guess what appeared
on top of the results...
https://lists.gnu.org/archive/html/www-commits/2023-05/msg00082.html
and
https://lists.gnu.org/archive/html/www-commits/2023-05/msg00062.html !!

I understand it wouldn't be practical to make this list private, but it
could at least be off-limits for crawlers.

Thanks!

Thérèse



reply via email to

[Prev in Thread] Current Thread [Next in Thread]