200, 000+ pages, only 50% are indexed

Selected answers from the Dumb SEO Questions G+ community.

• 
  Michael Martinez: Are you asking why the other pages are not being indexed, how to get them indexed, or both, or something else? How long did you wait for the site to be recrawled? Does site navigation link to the unindexed pages or are you just using XML sitemaps to...Lihat Lainnya
• 
  Razvan Alexa: Thanks for the answer Michael Martinez, your blog was the first I read about SEO many years ago. There is no "noindex" or "nofollow" and the pages are not orphaned, we have a section for these new products even on the homepage. This is what is baffling...Lihat Lainnya
• 
  Michael Martinez: This is a situation where I would consider crawling the site to see what the SEO crawler finds. And I know people who follow my comments will be SHOCKED I recommended that.
• 
  Razvan Alexa: In fact I was just looking at my options for this service right now :) what would you recommend deepcrawl, oncrawl, smth else?
• 
  Dave Elliott: Razvan Alexa deepcrawl is an awesome tool but ridiculously expensive! Screaming Frog, the answer is always screaming frog.
• 
  Razvan Alexa: Hey Dave Elliott screaming frog is great but crashes on sites bigger than 300, 000 pages. No matter how much ram i allocated, still crashed. Had better results with sitebulb. Thanks for the reply
• 
  Dave Elliott: Razvan Alexa these days there is an option to use your hard drive rather than your RAM. Took me a couple of days but i managed to do a 4.5million page site a couple of weeks ago.
• 
  Razvan Alexa: Got it...thanks, I`ll have a look
• 
  Dave Elliott: there in fact
• 
  Razvan Alexa: Thanks mate
• 
  Michael Martinez: It has been a while since I worked with Magento but I think there is a settings report, is there not? If that`s the CMS I am thinking of, have you printed out the settings to see what is active/inactive?
• 
  Razvan Alexa: I did...aparently there is a problem with the sitemap content....something I asked the developer to check 10 times...thank you for the feedback
• 
  Jim Munro: Hi Razvan Alexa, your question was discussed by the Panel during Dumb SEO Questions HOA 285. Watch it on Youtube: https://www.youtube.com/watch?v=B_Q0hFZu0Mk&t=41m5s... Lihat Lainnya
• 
  Razvan Alexa: Thanks a lot Jim Munro, I feel like a superstar :)
• 
  Razvan Alexa: I have about 15 years of SEO experience and a few big client sites under my belt, so if you ever need someone to help others I`d be happy to participate Jim Munro
• 
  Jim Munro: Razvan Alexa. Please follow me on G+ and DM me a link to your profile so I can follow back. This is to enable me to send the invitations from the HOA app.
• 
  Jim Munro: Got it, Razvan Alexa. I`ll send an invitation this week at this time: https://www.timeanddate.com/worldclock/fixedtime.html...
• 
  Razvan Alexa: Sound good Jim Munro, looking forward to it