(Entry was posted by Greg Krista on this post in the Dumb SEO Questions community on Facebook, 06/25/2016).

Stopping Google and Bing from indexing

I have a site with internal search. I`ve noticed the internal search URL will change to ? once a user types in something because it is dynamically created. In terms of stopping Google and Bing from indexing this content, should my robots.txt look like this
Disallow: /search/?
or
Disallow: /search/?*
Thanks!

This question begins at 00:12:44 into the clip. Did this video clip play correctly? Watch this question on YouTube commencing at 00:12:44

Share on Twitter

Share on Facebook

YOUR ANSWERS

Selected answers from the Dumb SEO Questions Facebook & G+ community.

Greg Kristan: I have a site with internal search. I've noticed the internal search URL will change to ? once a user types in something because it is dynamically created. In terms of stopping Google and Bing from indexing this content, should my robots.txt look like this
Disallow: /search/?
or
Disallow: /search/?*
Thanks!
Kyle Hawk: Is the internal form using a GET action? That would explain the sudden appearance of the "?". I would think it wouldn't matter. If you put in /search/ it will know what the page is regardless if there is a "?" present or not.