Dumb SEO Questions

(Entry was posted by Scott Clark on this post in the Dumb SEO Questions community on Facebook, 07/18/2019).

Google seems to ignore x-robots-tag: noindex

Have any of you had cases where Google seems to completely ignore x-robots-tag: noindex?
This question begins at 00:22:07 into the clip. Did this video clip play correctly? Watch this question on YouTube commencing at 00:22:07
Video would not load
I see YouTube error message
I see static
Video clip did not start at this question

YOUR ANSWERS

Selected answers from the Dumb SEO Questions Facebook & G+ community.

  • Chris Slater: No, but I’m monitoring this issue...
  • Neal Kindschi: If I`m not mistaken, Google has dropped support for the noindex directive in robots.txt
  • Scott Clark: Neal Kindschi that`s different
  • Neal Kindschi: Scott Clark Then I am mistaken. Carry on
  • Micah Fisher-Kirshner: No, been on the other end where the x robots noindex tag takes predominance over the page html index tag
  • Jesse McDonald: I`ve had them ignore a page set to noindex/no follow from the second it was published. I had to set the page to noindex/follow and submit it to index which then took it out.
  • Richard Hearne: The biggest problem I`ve seen with using directives via headers - and this applies more to larger websites that use third party CDNs, caching services and the like - is that you might not be serving the same headers to Googlebot that you expect.

    Have you tested the page in question via Search Console and looked at what Google is getting?

    Second theory - are you sending conflicting directives with the same page?

    Third theory - have you carefully checked to ensure that what you`re sending in the header is correct?

View original question in the Dumb SEO Questions community on Facebook, 07/18/2019).