Discourse/discourse
Discourse/discourse
2
0
Fork 0
mirror of https://github.com/discourse/discourse.git synced 2025-09-06 09:10:25 +08:00
Code Packages Activity Actions 11

add a warning in robots.txt when using subfolder

Browse source
This commit is contained in:
Régis Hanol 2018-04-12 00:00:15 +02:00
parent 062bf8bad3
commit 1a9271dd2f
1 changed files with 4 additions and 1 deletions
Download patch file Download diff file Expand all files Collapse all files

5
app/views/robots_txt/index.erb
View file

@ -1,4 +1,7 @@
# See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file
# See http://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file
<% if Discourse.base_uri.present? %>
# This robots.txt file is not used. Please append the content below in the robots.txt file located at the root
<% end %>
#
<% @allowed_user_agents.each do |user_agent| %>
User-agent: <%= user_agent %>