(Entry was posted by Shao Chieh Lo on this post in the Dumb SEO Questions community on Facebook, 05/14/2020).

Is it a good idea to block product comparison page?

Is it a good idea to block product comparison page in robots.txt like this?
I am thinking in some case this kind of page can be good landing pages for comparison keywords~
Let me know your thought or experiences,
Thanks,

This question begins at 00:15:05 into the clip. Did this video clip play correctly? Watch this question on YouTube commencing at 00:15:05

Share on Twitter

Share on Facebook

YOUR ANSWERS

Selected answers from the Dumb SEO Questions Facebook & G+ community.

Richard Hearne: Robots.txt is a very blunt tool, and few SEOs appear to consider the implications for the flow of PageRank. For really large sites this can be a very big issue - you sink PageRank by blocking crawlability (same thing can happen with NOINDEX FWIW).

If you need to block crawl due to low quality content the better way to address the underlying issue is to remove/improve that content. I always view robots/txt blocks as a bandaid rather than a cure. Just my â‚¬0.02...
Shao Chieh Lo: Richard Hearne Thank you so much! Very helpful advice!