Visualising Googlebot Crawl With Excel
A while ago I had a need to better understand how Googlebot was crawling throughout a website. Scanning through log files isn`t practical for a high traffic site and most traditional web log analysers didn`t provide the information I needed - so I extracted it myself using a customisable log file analyser and visualised it in Excel for easy consumption.