Sitemap URL is example.com in robots.txt

asked 2012-03-23 09:31:44 -0500

todofixthis

1272 ●44 ●39 ●63

updated 2012-04-14 15:39:55 -0500

When I view my site's robots.txt file in my browser, I notice that the Sitemap URL is incorrect:

http://expats.askbot.com/robots.txt:

User-agent: *
Disallow:

Sitemap: http://example.com/sitemap.xml

Note that the URL for the sitemap uses example.com as its domain.

Following the instructions in http://askbot.org/en/question/2715/sitemapxml-is-using-examplecom, I changed the domain for my website, and now http://expats.askbot.com/sitemap.xml is displaying the correct URLs, but robots.txt is still broken.

Comments

Thanks for reporting this, will take a look now and fix it.

Fitoria ( 2012-03-23 09:52:47 -0500 )edit

add a comment

answered 2012-03-23 12:19:46 -0500

Fitoria

1148 ●7 ●25 http://fitoria.net/

Fixed:

http://expats.askbot.com/robots.txt

User-agent: *
Disallow:


Sitemap: http://expats.askbot.com/sitemap.xml

edit flag offensive delete link

Comments

Thanks! Will this take effect for any domain name (i.e., as specified in Django admin)? Or will it need to be manually updated if/when I change the domain name for the site?

todofixthis ( 2012-03-23 12:53:03 -0500 )edit

for the moment this is set according to your domain name you cannot change it.

Fitoria ( 2012-03-23 12:55:30 -0500 )edit

Looks like this might be getting set globally; I accessed <http://expats.askbot.com/robots.txt> just now, and the Sitemap: entry is now http://help.simplecv.org/sitemap.xml. According to GWT, http://askcre.com/sitemap.xml has also appeared in robots.txt.

todofixthis ( 2012-03-26 00:19:15 -0500 )edit

add a comment

Your Answer

Please start posting anonymously - your entry will be published after you log in or create a new account.

Add Answer

Sitemap URL is example.com in robots.txt

Comments

1 Answer

Comments

Your Answer

Question Tools

Stats

Related questions

Sitemap URL is example.com in robots.txt edit

Comments

1 Answer

Comments

Your Answer

Question Tools

Stats

Related questions

Sitemap URL is example.com in robots.txt