(Entry was posted by Jose Fontanez on this post in the Dumb SEO Questions community on Facebook, 08/08/2019).

NoIndex directive will no longer have effect

Since the NoIndex directive will no longer have effect on Robots.txt file, how you will address to use NoIndex to directories or folders? An important thing to mention is that we also want to disallow these directories.
In a Google Webmaster Blog Post, I read that if I want to place a NoIndex on Meta or Http header having a Disallow on the Robots.txt, the NoIndex will no longer take effect.

Article Link: https://support.google.com/webmasters/answer/93710

The real question is... How can I place a NoIndex and Disallow at the same time?

Thank you...

This question begins at 00:07:15 into the clip. Did this video clip play correctly? Watch this question on YouTube commencing at 00:07:15

Share on Twitter

Share on Facebook

YOUR ANSWERS

Selected answers from the Dumb SEO Questions Facebook & G+ community.

Brenda Michelin: htaccess file or nginx config file
Richard Hearne: Disallow != NOINDEX.

If you want to disallow a directory you use robots.txt.

If you want to NOINDEX a directory and all subpages you can do so either with HTML robots META tag, or HTTP header, both of which must be applied to each document you want to NOINDEX.

Take care as these are very different things for SEO.
Richard Hearne: Oh, and to answer the question under "Read More". You can`t. By definition a disallowed URL cannot be crawled, and therefore Googlebot can never see a NOINDEX directive. If you need something NOINDEXed you must allow crawl.