Ask Your Question
2

"502 Bad Gateway" when visiting certain URLs, Part 3

asked 2012-10-25 00:21:49 -0500

todofixthis's avatar

Googlebot found another bad URL:

http://expats.qa/get-editor/

When viewing it on my hosted site, I get an Nginx 502 Bad Gateway error.

edit retag flag offensive close merge delete

1 Answer

Sort by ยป oldest newest most voted
2

answered 2012-10-25 00:24:32 -0500

Evgeny's avatar

I've fixed this in the repository. Replaced with Access Forbidden, maybe "Bad Request" will be better. This request requires some parameters to work, it's a part of the internal api.

edit flag offensive delete link more

Comments

Google sure is good at finding these URLs. Would it be prudent to start adding them to robots.txt?

todofixthis's avatar todofixthis  ( 2012-11-15 09:19:49 -0500 )edit
1

Yes, the non-content urls should not be crawled.

Evgeny's avatar Evgeny  ( 2012-11-15 09:22:57 -0500 )edit

Your Answer

Please start posting anonymously - your entry will be published after you log in or create a new account.

Add Answer

Question Tools

Stats

Asked: 2012-10-25 00:21:49 -0500

Seen: 1,054 times

Last updated: Oct 25 '12