Dumb SEO Questions

(Entry was posted by Alistair Lattimore on this post in the Dumb SEO Questions community on Facebook, Thursday, June 20, 2013).

Visualising Googlebot Crawl With Excel

Visualising Googlebot Crawl With Excel

A while ago I had a need to better understand how Googlebot was crawling throughout a website. Scanning through log files isn`t practical for a high traffic site and most traditional web log analysers didn`t provide the information I needed - so I extracted it myself using a customisable log file analyser and visualised it in Excel for easy consumption.

This question begins at 01:06:49 into the clip. Did this video clip play correctly? Watch this question on YouTube commencing at 01:06:49
Video would not load
I see YouTube error message
I see static
Video clip did not start at this question


Selected answers from the Dumb SEO Questions G+ community.

  • Sławomir Zdunek:

    What a read! I feel guilty that I`ve never analysed my log files. I do have access to Cpanel and quite often I look through the stats there but I`m not sure if I can download any data from there. I`m going to ask my host provider if it is possible to get this log file. Thanks for sharing this article.

View original question in the Dumb SEO Questions community on G+, Thursday, June 20, 2013).

Reference Links