First time here? Check out the FAQ!
Ask Your Question
2

"502 Bad Gateway" when visiting certain URLs, Part 3
 
   
  
 
 
Googlebot found another bad URL:
 
http://expats.qa/get-editor/
 
When viewing it on my hosted site, I get an Nginx 502 Bad Gateway error.
 
 
To enter a block of code:
 
     
  • enter empty line after your previous text
    •  
  • paste or type the code
    •  
  • select the code and press the  button above
    •  
 
Preview: (hide)
  
 
 
 
 
 
 todofixthis's avatar

      1.3k
    
 
 
 
 todofixthis 
 
 
    asked 12 years ago 
 
 
 
 
        
 
 
 
Comments
 
 
 
  see more comments  
 
 
 
 
 
 1 Answer
  
  
  
 
 
 
 
2
 
 
  
 
 
 
 
 
 
I've fixed this in the repository. Replaced with Access Forbidden, maybe "Bad Request" will be better. This request requires some parameters to work, it's a part of the internal api.
 
 
To enter a block of code:
 
     
  • enter empty line after your previous text
    •  
  • paste or type the code
    •  
  • select the code and press the  button above
    •  
 
Preview: (hide)
  
 
 
 
 
 
 Evgeny's avatar

      13.2k
    
 
 
 
 Evgeny 
 
 
    answered 12 years ago 
 
 
 
 
     link   
 
 
 
Comments
 
 
 
 
  
 
 
 
Google sure is good at finding these URLs.  Would it be prudent to start adding them to robots.txt?
 
 
 todofixthis's avatar todofixthis (12 years ago)   
 
 
  
 
 
1
  
 
 
 
Yes, the non-content urls should not be crawled.
 
 
 Evgeny's avatar Evgeny (12 years ago)   
 
 
  
 
  see more comments