Dumb SEO Questions

(Entry was posted by Robbie King on this post in the Dumb SEO Questions community on Facebook, 02/17/2022).

Can I only use robots.txt?

Potentially very dumb SEO questionnoindex + nofollow vs robots.txt; both seem to achieve the same thing, no?. Why would I use a combination of noindex+nofollow when I can just use robots.txt?
This question begins at 00:49:47 into the clip. Did this video clip play correctly? Watch this question on YouTube commencing at 00:49:47
Video would not load
I see YouTube error message
I see static
Video clip did not start at this question

YOUR ANSWERS

Selected answers from the Dumb SEO Questions Facebook & G+ community.

  • George G.: Not true. Robots just blocks crawling on your own site. If an outside link points to the page, it can get indexed. On the contrary noindex will always keep the page off the index.

    2d
  • Robbie King: George G. amazing, thank you

    2d
  • Jesús Moreno Casas: George G. Where I check this on Google guidelines?

    2d
  • Roger Montti: Jesús Moreno Casas Check Google`s Dev pages.

    Robots text is NOT the same as noindex and you shouldn`t use both, ever

    Robots = Don`t Crawl.

    Noindex = Don`t include in the index, including any links on the page.

    1d
  • Juan Dalisay Jr.: George G. How can Google index the outside link to a page blocked by robots?

    2d
  • Roger Montti: Juan Dalisay Jr. Google adds a robots blocked page to the index because the link tells Google it`s worth indexing.

    BUT the SERPs won`t show a snippet for the page.

    1d
  • Michael Martinez: Technically, I`m not sure there is really a justification for "noindex, nofollow" any more (at least as far as Google is concerned) because Google says once the page has fallen out of the index its links won`t be followed anyway.

    2d
  • Ash Nallawalla: Be careful not to combine a noindex directive with a robots.txt block, else the crawler will not get to read that noindex tag.

    https://developers.google.com/.../crawling/block-indexing....

    DEVELOPERS.GOOGLE.COMImpedir que la Búsqueda indexe páginas con la directivaImpedir que la Búsqueda indexe páginas con la directiva

    2d
  • Zachary Toto: There is a difference between telling search engines not to index, not to follow, and not to crawl.

    2d
  • Trenton Erker: Zachary Toto well that’s inaccurate. See above.

    2d
  • Zachary Toto: Trenton Erker Well no that`s the fact do your research.

    2d
  • Trenton Erker: Zachary Toto lol please see above

    2d

View original question in the Dumb SEO Questions community on Facebook, 02/17/2022).