These are soft 404`s that appear in GWT -->under crawl errors. Why are these appearing and what what should i do with them? Thinking of non-indexing them all.
These are soft 404's that appear in GWT -->under ;crawl errors. ; Why are these appearing and what what should i do with them? Thinking of non-indexing them all.
Thank you
Jann Grond: You can ignore them or if you want to, you can remove them from the index in GWT. https://support.google.com/webmasters/answer/2409439?hl=en
Athanasios Giannias: Thanks +Jann Grond ;. If i remove them they will just reappear . These soft 404's are from my site itself. The question is why are they appearing? ;
Tony McCreath: Click on one then select the linked from tab. That should tell you why Google went there.
Rajeshwar Reddy: You seem to have broken link form other website. Find the source and request that webmaster to edit it. It wont show up again in analytics.
Athanasios Giannias: Sorry for the delay. Have clicked in to all the links. All of the seem to work perfectly , with only exception ; ;http://dromeasbikes.com/en/search?search_query=%3Fsearch_query%3D
Rajeshwar Reddy: Hey, I believe user should be logged in to access "order" in your website. If so any user ; or Google bot can not access these links. You need not show Google bot the order folder right? You can put that folder in robots.txt. If you made changes to your website, you should redirect to appropriate url for Paypal links.
Athanasios Giannias: thank you +Rajeshwar Reddy ;. So i should plainly put the order form in the robot.txt, so it will not be indexed by google any more? The paypal login form as well? ;
Adding a url to robots.txt only stops it being crawled whereas the result you want is noindex. You can use a meta noindex or X-Robots-Tag=noindex header response.