(Entry was posted by Alistair Lattimore on this post in the Dumb SEO Questions community on Facebook, Thursday, June 20, 2013).

Visualising Googlebot Crawl With Excel

Visualising Googlebot Crawl With Excel

A while ago I had a need to better understand how Googlebot was crawling throughout a website. Scanning through log files isn`t practical for a high traffic site and most traditional web log analysers didn`t provide the information I needed - so I extracted it myself using a customisable log file analyser and visualised it in Excel for easy consumption.

This question begins at 01:06:49 into the clip. Did this video clip play correctly? Watch this question on YouTube commencing at 01:06:49

You can download this video (473MB) to watch later. You can also download the audio only version (168MB) of this HOA.

Share on Twitter

Share on Facebook

YOUR ANSWERS

Selected answers from the Dumb SEO Questions G+ community.

Sławomir Zdunek: What a read! I feel guilty that I`ve never analysed my log files. I do have access to Cpanel and quite often I look through the stats there but I`m not sure if I can download any data from there. I`m going to ask my host provider if it is possible to get this log file. Thanks for sharing this article.