Visualising Googlebot Crawl With Excel
A while ago I had a need to better understand how Googlebot was crawling throughout a website. Scanning through log files isn`t practical for a high traffic site and most traditional web log analysers didn`t provide the information I needed - so I extracted it myself using a customisable log file analyser and visualised it in Excel for easy consumption.
What a read! I feel guilty that I`ve never analysed my log files. I do have access to Cpanel and quite often I look through the stats there but I`m not sure if I can download any data from there. I`m going to ask my host provider if it is possible to get this log file. Thanks for sharing this article.
