Disallow /message-id/mbox/ in robots.txt
authorMagnus Hagander <magnus@hagander.net>
Tue, 23 Nov 2021 11:04:09 +0000 (12:04 +0100)
committerMagnus Hagander <magnus@hagander.net>
Tue, 23 Nov 2021 11:04:09 +0000 (12:04 +0100)
These require login and shouldn't be spidered, but had somehow been
missed.

pgweb/core/views.py

index 20399387b8b514af479c048e4eb8aa1258649655..ef19f6afb91103603b42cd02d5a81e1ee3579aa5 100644 (file)
@@ -164,6 +164,7 @@ Disallow: /search/
 Disallow: /message-id/raw/
 Disallow: /message-id/flat/
 Disallow: /message-id/resend/
+Disallow: /message-id/mbox/
 
 Sitemap: https://www.postgresql.org/sitemap.xml
 """, content_type='text/plain')