Coverage of Forum index

December 5, 2009 in Forum Search, Statistics | 3 comments

I wanted a quick visual of how much of the forum I have indexed… The current thread id maximum is at around 1.42 millions, and I only have 33k threads in my database. Lots of empty space in there.. ugh. I can do better, I promise!

This is my first visualization, blue dot is an indexed thread. Top left corner is id zero, and it grows to the right, 1000 pixels/threads to the right. So the 20th line represents threadids 20,000-20,999. First pixel on line 1400 is threadid 1,400,000-1,400,999 etc. Click on image for full size view.

Popmundo Forum Search database coverage

Later I might add color to show which thread is in Turkish, English, Spanish etc. unless I make a traditional pie chart or something.

  1. HerbAcosta’s avatar

    HerbAcosta on December 11, 2009 at 10:22

    How do you index it? Is it only threads that you view? If so, maybe you’d want to let others have the ability to also add to your index when they view it, could get the threads you’re missing. I’d install a script to do that for you if you made one :)

    Reply

    1. Alanas Anikonis’s avatar

      Alanas Anikonis on December 12, 2009 at 11:54

      Well I use a combination of manual work and automation depending on what time of day it is.

      So far I’ve been unwilling to share the indexing script, but it wouldn’t hurt to have it out there for general use.
      But thanks for the interest, I’ll make a post about it when (if) I require help from others.

      Reply