Merge branch 'robots-help' into 'master'

Add the /help page in robots.txt Closes #44433 See merge request gitlab-org/gitlab-ce!17928

Merge branch 'robots-help' into 'master'
c628f8f4 · Robert Speicher · 551b9e10 · 71f707bf · c628f8f4
Commit c628f8f4 authored 6 years ago by Robert Speicher
--- a/public/robots.txt
+++ b/public/robots.txt
@@ -20,6 +20,7 @@ Disallow: /projects/new
 Disallow: /groups/new
 Disallow: /groups/*/edit
 Disallow: /users
+Disallow: /help
  
 # Global snippets
 User-Agent: *