Dumb SEO Questions

(Entry was posted by Greg Krista on this post in the Dumb SEO Questions community on Facebook, 08/26/2014).

Robots.txt Disallow.

Sorry for all the posts!

If I have a set of pages in the Robots.txt that I want to Disallow but they are still being indexed by Google, should I add the NOINDEX meta tag to the page?

There is a discussion internally about if we need to or not

I am thinking we need to add this code because some of these pages rank and are found when you use an advanced search operator

Love to hear everyone`s thoughts!

-Greg?
This question begins at 01:13:33 into the clip. Did this video clip play correctly? Watch this question on YouTube commencing at 01:13:33
Video would not load
I see YouTube error message
I see static
Video clip did not start at this question

YOUR ANSWERS

Selected answers from the Dumb SEO Questions Facebook & G+ community.

  • Greg Kristan: Sorry for all the posts!

    If I have a set of pages in the Robots.txt that I want to ;Disallow but they are still being indexed by Google, should I add the NOINDEX meta tag to the page?

    There is a discussion internally about if we need to or not

    I am thinking we need to add this code ;because some of these pages rank and are found when you use an advanced search operator

    Love to hear everyone's thoughts!

    -Greg
  • Ryan Decorsie Ewen: I think the best solution is dissallow via robots.txt and NOINDEX on pages and rel=nofollow on any links that point to those pages to maximise your link juice.
  • Archie Watt: The robots.txt file is about preventing crawling, which isn't the same thing as indexing.

    If you block a page in robots.txt and also have a noindex meta tag, Google won't be able to crawl the page to see that you're asking them not to index it.

    So in short, remove the robots.txt block & add a noindex meta tag.
  • Greg Kristan: +Archie Watt thanks ;for the clarification!  ;
  • Sopan Gedam: Thanks for question
    same thing happening with my site
    can anybody suggest ;

View original question in the Dumb SEO Questions community on Facebook, 08/26/2014).