Webometric Thoughts

April 22, 2009

I Hate My Job: The Web is Just a Jumbled Mess!

Filed under: network diagram,webometrics — admin @ 9:18 am

At the moment I am investigating the linking between 1337 environmental technology web sites. Of the 1337 sites, 751 nodes create one large network:

You spend days sorting a list of URLs, collecting data, finding errors, starting again…and at the end you just have a big ball of string.

A webometrician’s job is to draw conclusions from such a jumbled mess: I hate my job.

5 Comments »

  1. Hi,

    Are you able to let us know how you do this? Looks very interesting. Is the source code available?

    Thanks! Dave.

    Comment by Anonymous — April 22, 2009 @ 9:55 am

  2. This diagram is based on data available through the Yahoo API using combinations of link, linkdomain, and site commands. I’m currently using the LexiURL software (http://lexiurl.wlv.ac.uk/), but it is not particularly difficult to write yourself.

    Due to the large number of sites included in this particular study a new feature had to be added to LexiURL which isn’t included in the released version yet. The released version allows network diagrams to be created by searching for links between each pair of sites in a URL list (which for 1,000 sites would be almost a million queries), the new version just collects the inlinks for a set of URLs then works out if the inlinking sites were the URLs you were interested in.

    I’m not the author of the LexiURL software, that’s the head of the group he adds the features I need. Unfortunately the source code is not available (probably because of his shameful programming abilities).

    Comment by David — April 22, 2009 @ 10:24 am

  3. pandora@beckman.influences” rel=”nofollow”>.…

    áëàãîäàðåí….

    Trackback by Brian — November 27, 2014 @ 1:10 am

  4. donning@mack.teamster” rel=”nofollow”>.…

    ñïñ!…

    Trackback by todd — February 2, 2015 @ 1:07 pm

  5. midshipmen@dummies.zone” rel=”nofollow”>.…

    tnx for info!…

    Trackback by jamie — February 13, 2015 @ 9:43 pm

RSS feed for comments on this post. TrackBack URL

Leave a comment

Powered by WordPress