Ask Your Question
0

Sitemap URL is example.com in robots.txt

asked 2012-03-23 09:31:44 -0600

todofixthis gravatar image

updated 2012-04-14 15:39:55 -0600

When I view my site's robots.txt file in my browser, I notice that the Sitemap URL is incorrect:

http://expats.askbot.com/robots.txt:

User-agent: *
Disallow:

Sitemap: http://example.com/sitemap.xml

Note that the URL for the sitemap uses example.com as its domain.

Following the instructions in http://askbot.org/en/question/2715/sitemapxml-is-using-examplecom, I changed the domain for my website, and now http://expats.askbot.com/sitemap.xml is displaying the correct URLs, but robots.txt is still broken.

edit retag flag offensive close merge delete

Comments

1

Thanks for reporting this, will take a look now and fix it.

Fitoria gravatar imageFitoria ( 2012-03-23 09:52:47 -0600 )edit

1 Answer

Sort by ยป oldest newest most voted
1

answered 2012-03-23 12:19:46 -0600

Fixed:

http://expats.askbot.com/robots.txt

User-agent: *
Disallow:


Sitemap: http://expats.askbot.com/sitemap.xml
edit flag offensive delete link more

Comments

Thanks! Will this take effect for any domain name (i.e., as specified in Django admin)? Or will it need to be manually updated if/when I change the domain name for the site?

todofixthis gravatar imagetodofixthis ( 2012-03-23 12:53:03 -0600 )edit

for the moment this is set according to your domain name you cannot change it.

Fitoria gravatar imageFitoria ( 2012-03-23 12:55:30 -0600 )edit

Looks like this might be getting set globally; I accessed <http://expats.askbot.com/robots.txt> just now, and the Sitemap: entry is now http://help.simplecv.org/sitemap.xml. According to GWT, http://askcre.com/sitemap.xml has also appeared in robots.txt.

todofixthis gravatar imagetodofixthis ( 2012-03-26 00:19:15 -0600 )edit

Your Answer

Please start posting anonymously - your entry will be published after you log in or create a new account.

Add Answer

Question Tools

Stats

Asked: 2012-03-23 09:31:44 -0600

Seen: 373 times

Last updated: Mar 23 '12