Dumb SEO Questions

(Entry was posted by Karol Soja on this post in the Dumb SEO Questions community on Facebook, 04/24/2014).

Which tools would you use to analyze 16M backlinks?

Which tools are you using to analyze huge amount of backlinks(16, 000, 000)? I mean some manual work - filtering, sorting, marking. Microsoft Excel is bit slow and tends to hang with such amount of data. I know about tools like LRT and Link Detox, but I need something to conduct some raw analysis. ?
This question begins at 00:12:58 into the clip. Did this video clip play correctly? Watch this question on YouTube commencing at 00:12:58
Video would not load
I see YouTube error message
I see static
Video clip did not start at this question

YOUR ANSWERS

Selected answers from the Dumb SEO Questions Facebook & G+ community.

  • Karol Soja: Which tools are you using to analyze huge amount of backlinks(16,000,000)? I mean some manual work - filtering, sorting, marking. Microsoft Excel is bit slow and tends to hang with such amount of data. I know about tools like LRT and Link Detox, but I need something to conduct some raw analysis. ;
  • NeotericUK LTD: link research tool is the best tool to analyze huge amount of backlinks
  • Karol Soja: I know but I am looking rather for Excel alternative - too merge data for few sources, add my own comments etc. ;
  • Marcus Wong: You can try +SEO Spyglass ;. I have been using it, but not to the extent of having 16m links. It is a desktop application, and runs on Java, so I'm not sure whether it will fit your bill. But if you need to filter, sort, and mark certain links, it definitely has that capability. ;
  • Daniel Delos: Excel has a maximum of just over 1 million rows. You can use MS Access which I believe is free from Microsoft or at least the trial.

    Otherwise you would need to remove unnecessary links like sitewide links or multiple links from the same domain. If this is acceptable for your purposes, you can use Scrapebox's dup remove addon to remove multiple links from the same domain and/or split a single file into multiple lists of 1 million links each (or any other number). It's made for splitting huge files into more manageable sizes.
  • Micah Fisher-Kirshner: Sounds like it's time to get a SQL database to analyze all that data.
  • Karol Soja: +Micah Fisher-Kirshner ;Yep, I suppose that this is one of the best soultions, but I decided to ask here first :)
  • Micah Fisher-Kirshner: There's only so much data Excel can handle before you either work in the tool itself (filtering then exporting to a manageable size) ;or move to a database.

View original question in the Dumb SEO Questions community on Facebook, 04/24/2014).

All Questions in this Hangout