about summary refs log tree commit homepage
path: root/lib/PublicInbox/Repobrowse.pm
diff options
context:
space:
mode:
authorEric Wong <e@80x24.org>2016-01-19 01:16:19 +0000
committerEric Wong <e@80x24.org>2016-04-05 18:58:27 +0000
commite90aa39b6447ceef78d31d4c68291585eb02244a (patch)
treeb1307ffb83ae07a12ee90cb14228c8f00b56a088 /lib/PublicInbox/Repobrowse.pm
parent2b79ca6a1f3f12cac616b2bce800f7f9487c8170 (diff)
downloadpublic-inbox-e90aa39b6447ceef78d31d4c68291585eb02244a.tar.gz
It is expensive and of dubious usefulness to have tree content
auto-followed and indexed by search engines.  Reduce the
links we recommend to crawlers so they don't waste resources
of users running our code or waste the time of search engine
users finding low-value content.

We will allow indexing blobs, however, as they may contain
useful information for others to refer to.

Of course, I definitely want search engines to index commit
messages; as I consider those to be the most important data
served.
Diffstat (limited to 'lib/PublicInbox/Repobrowse.pm')
0 files changed, 0 insertions, 0 deletions