Sitemap URL is example.com in robots.txt

When I view my site's robots.txt file in my browser, I notice that the Sitemap URL is incorrect:

http://expats.askbot.com/robots.txt:

User-agent: *
Disallow:

Sitemap: http://example.com/sitemap.xml

Note that the URL for the sitemap uses example.com as its domain.

Following the instructions in http://askbot.org/en/question/2715/sitemapxml-is-using-examplecom, I changed the domain for my website, and now http://expats.askbot.com/sitemap.xml is displaying the correct URLs, but robots.txt is still broken.

Comments

Thanks for reporting this, will take a look now and fix it.

Fitoria (2012-03-23 09:52:47 -0500) edit

add a comment see more comments

Fixed:

http://expats.askbot.com/robots.txt

User-agent: *
Disallow:


Sitemap: http://expats.askbot.com/sitemap.xml

1.1k

Fitoria

answered 2012-03-23 12:19:46 -0500

edit flag offensive 0 remove flag delete link

Comments

Thanks! Will this take effect for any domain name (i.e., as specified in Django admin)? Or will it need to be manually updated if/when I change the domain name for the site?

todofixthis (2012-03-23 12:53:03 -0500) edit

for the moment this is set according to your domain name you cannot change it.

Fitoria (2012-03-23 12:55:30 -0500) edit

Looks like this might be getting set globally; I accessed <http://expats.askbot.com/robots.txt> just now, and the Sitemap: entry is now http://help.simplecv.org/sitemap.xml. According to GWT, http://askcre.com/sitemap.xml has also appeared in robots.txt.

todofixthis (2012-03-26 00:19:15 -0500) edit

add a comment see more comments

Sitemap URL is example.com in robots.txt edit

Comments

1 Answer

Comments

Sitemap URL is example.com in robots.txt