When to allow crawlers

Selected answers from the Dumb SEO Questions Facebook & G+ community.

• 
  Nazmun Nahar: You can submit every URL when the post is completely ready though I don`t think it`s important for new pages. Google will crawl new pages automatically. You can submit after editing/updating old pages.
• 
  Victoria Gitelshtein: Probably if you have a lot of work to be done, you can ask for crawling in the middle of work. To see how its going... And then in the end after all the task will be done...
• 
  Michael Martinez: If it`s a relatively small site wait until you`ve finished a page before submitting it for crawling. If it`s a larger site then submit each section as it`s completed. You can always get the ball rolling with incomplete content but you may not be happy with what you see in the search results. The important thing is to get content into the index. As long as the search algorithms are happy they`ll come back for more.
• 
  Katarina Lujak: it has 3000+ crawled urls, around 300 valid 200 html pages indexed. I have to go through the woods, clear that up and submit another crawling. but I`m guessing these valid ones should be fine. it`s a small site, not many products and variations. plus most of the content is duplicated - someone before me did copy pasting seo.
• 
  Brenda Michelin: Are they Submitted and Valid; or Found and Valid. What does the rest of your Coverage Report say?
• 
  Katarina Lujak: they are found and valid, ahrefs. the site is all new, but it has some good backlinks so appeared on the first page after a month. robot txt and sitemap are non existing.
  
  rest of the report says there is a lot of 301 from the old site, a lot of them permanently moved.
• 
  Michael Martinez: Katarina Lujak Ahrefs cannot tell you what Google knows or determines. To assess indexing status and assessment, you should only use the search engines` own dashboards.
• 
  VJ Thakur: I think you have already submitted sitemap in search console.
  You need to add all of your link in your sitemap and submit the sitemap in search console. That will help you to crawling your pages or site repidally.
• 
  Katarina Lujak: VJ Thakur it could be that developer who made the site did that already, but my client has no idea about that. I`m still waiting for some access users and contact of that developer so I can do a complete audit. Gsc is on the list for sure, if not done
• 
  VJ Thakur: Katarina Lujak ok, then you need to Google search console and check status of url. I think if their are any error.