You aren't signed in     Sign In    Help

Overview of relationships between groups - February 2008

The "hole" surrounded by the trail mentioned in the description.
dogs
cats
Graffiti and Street Art
I'd start a pool here
Red Light District
cameraphones
I was faved, therefore I am.
food!
HDR
Some "anything goes" groups.
africa and africans
Finland, Iceland, Sweden, Denmark
France
Foot Fetish groups - so that's where they come from! :)
Portugal
spain
signs
Graveyards and cemetaries
these are up in the north because you have to keep warm somehow
Cars
Weddings
Couples + love + kissing
Coffee, with a little tea and music mixed in
Trains
Bicycles
holga
b&w-film-centric
NYC
Australia!
equipment
junkies
insomniacs
Fashion Accessories
(mostly hand made)
music
Flight
Toronto -- guess we do bicycles here too!
100 views
New Orleans
sunrise, sunset
Dude, you forgot Norway!
st kitts!
London Calling...
Weed smokers
crafting
Labradors!
Overview of relationships between groups - February 2008 by GustavoG.
After squashing a couple of obstinate bugs, here it is: the updated version of the network of groups. Here we see the main cluster and several smaller clusters surrounding it. The tiny clusters I posted earlier.

This graph depicts the interconnections between 3629 groups (7211 links, in case anyone cares). All these groups have at least 400 members, and share public content with other groups. There is an additional, esoteric cutoff leaving out groups with too little shared content, mostly to make this graph vaguely close to something one can try to interpret. I'm not sure how well it does in that respect - in my opinion, it's quite ugly...

The September 2005 version had a tightly connected core, and many "tendrils" radiating from it. There were no obvious "loops" connecting the tendrils. This has changed a bit. The "core" is much larger this time, too. I guess I should have used a slightly stricter parameter to make it "open up" a bit more.

One of the most interesting things I observed in this graph is that there is a big "hole", or rather there is a continuum of related concepts coming out of the main cluster and looping around, back to the main cluster. Let's follow this trail.

I start from a subcluster of groups about dogs, quite interconnected among themselves. The "Dogs!" group links to "Cats & Dogs", a bridge into the cats subcluster. We pass by several cat groups and link from "Cat world on flickr" to "The Living World", which in turn links us to "Creatures", the gateway into the reptilian subcluster. From there we move on to the "Critters" group, in the spider neighborhood. Then we move up to the insects subcluster, and we follow the trail from "Flying Insects" to "Dragonflies", we fly on to "Odonata" and splash into the "Pond Life" group. "Ponds" naturally links us to "Ducks and Geese", and we realize that "Waterfowl" are "Water Birds". Still too specific? We move on to "Unlimited Birds", and discover that there are many birds in "Tennessee". Apparently not only birds - we see there are caves there, and trains. "All aboard! Trains - Real and Surreal" will bring you via "Public Transit" and "subway" to a variety of destinations, including Buenos Aires and Athens, deep into the main cluster.
But let's not forget the dogs! Their "PetPics" show them chasing "squirrels", which as we all know are "Backyard Wildlife". Several wildlife groups await, including "Jeff Corwin - Animal Planet", for Portuguese-speaking wildlife - naturally bringing us to a host of brazilian groups, and back into the main, tightly-interconnected cluster.

Oh yes, you'll notice plenty of subclusters that include almost only groups devoted to the important industry of producing views and comments, and the crucial duty of tallying views and favorites. From "5 faves and less", the group trails converge on various redundant groups singing the praises of the pinnacles of photographic creation. I couldn't fail to notice that the groups devoted to "views" are tightly connected to the Red Light District groups, while those devoted to favorites and interestingness are pretty much in limbo.

An unfortunate technical detail: all special characters are rendered as ".", making some group names (particularly those in Arabic) rather unreadable. Sorry about that. In any case, you'll need the original size to be able to read the text.

Update: the Groups Browser now reflects the updated data. 
This photo has notes. Move your mouse over the photo to see them.

Comments

view profile

striatic  Pro User  says:

NICE!

off to the original size i go!

--
[discovered in the photophlow welcome room] (?)
Posted 22 months ago. ( permalink )

view profile

Ange Halle  Pro User  says:

this looks like a fractal to me.
Posted 22 months ago. ( permalink )

view profile

jmpboia  Pro User  says:

bela foto...


Seen in a darckr gallery of your photos (mine, ?).
Posted 22 months ago. ( permalink )

view profile

biotron  Pro User  says:

wooo!
Posted 22 months ago. ( permalink )

view profile

Tàbhastal  Pro User  says:

I think I see the Virgin! Or is it the Flying Spaghetti Monster?

BTW, where is the Red Light District? Not that I would go there, or anything...and does it link to Photos of My Ex?
Posted 22 months ago. ( permalink )

view profile

schoschie  Pro User  says:

I can drool for hours over visualizations of complex data.
Posted 22 months ago. ( permalink )

view profile

schoschie  Pro User  says:

Did you write your own software to make these? If so, what did you write it in?
Posted 22 months ago. ( permalink )

view profile

otherthings  Pro User  says:

Another job well done, Gustavo! Really fascinating.
Posted 22 months ago. ( permalink )

view profile

txkimmers  Pro User  says:

I need to hook this puppy up to my big screen tv tonight and really explore it.

Wonderful stuff.
Posted 22 months ago. ( permalink )

view profile

GustavoG  Pro User  says:

Did you write your own software to make these? If so, what did you write it in?

As usual, it's mostly Perl, with the layout being done in yEd.
Posted 22 months ago. ( permalink )

view profile

Eli the Bearded  Pro User  says:

This is an thought-provoking graph. The intermeshing of "red light district" (as you put it) with view count groups, but the isolation of the favoriting groups is a interesting observation.

How do the size-is-everything groups fit in? Ones like 10 million photos, 5 million photos, etc. Too diverse connections to make it to the graph or hidden somewhere in there?

--
Seen in your FlickrLand analyses, 2008 set. (?)
Posted 22 months ago. ( permalink )

view profile

GustavoG  Pro User  says:

How do the size-is-everything groups fit in?

I just added a note (towards the lower-left corner) indicating the location of some of the "anything goes" groups.
Interestingly they are connected to the main graph via the coffee subcluster and a more gadget-oriented region.
Posted 22 months ago. ( permalink )

view profile

j david  Pro User  says:

awesome work, gustavo

thanks!
Posted 22 months ago. ( permalink )

view profile

mtnrockdhh  Pro User  says:

Very interesting. I expected to see Camera Toss in the upper right along with some of the other light streaks types of groups, but didn't. Any ideas where it might be?
Posted 22 months ago. ( permalink )

view profile

GustavoG  Pro User  says:

I'm afraid Camera Toss is strongly linked only to Kinetic Photography. They make a two-group minicluster, which got filtered out.

(The next link would be to light movement, but it's way below cutoff.)
Posted 22 months ago. ( permalink )

view profile

GustavoG  Pro User  says:

Incidentally, I just updated the Groups Browser to use the new data.

See Camera Toss in the browser.
Posted 22 months ago. ( permalink )

view profile

ColleenM  Pro User  says:

Gustavo, would this fit in the Emergence group? Seems like it's on target.
Posted 22 months ago. ( permalink )

view profile

Josh Thompson  Pro User  says:

I like the fact that music-related groups connect via a group about Cafes to coffee-related groups, which then connect to a group about addiction.

Anyway, it's an awesome plot. Me loves data. :-)

--
Seen in a discussion of Utata. (?)
Posted 22 months ago. ( permalink )

view profile

efo  Pro User  says:

Fantastic. B&W film surrounds New York City.
Posted 22 months ago. ( permalink )

view profile

GustavoG  Pro User  says:

Uh oh. NYC needs a colorful superhero to save the day!
Posted 22 months ago. ( permalink )

view profile

anakiwa_forever  Pro User  says:

Question... Linked by photos in multiple pools / similarity to other pools or people involved in multiple pools??
Fantastic, been watching for this to come out again!
--
Seen in a discussion of Utata. (?)
Posted 22 months ago. ( permalink )

view profile

GustavoG  Pro User  says:

The links are established by shared photos.

Moreover, a photo shared among many pools will contribute less weight to each link. A photo in only two groups gives the strongest contribution to linking them.
Posted 22 months ago. ( permalink )

view profile

Jeremy Sloan  Pro User  says:

This is really, really awesome.
Posted 22 months ago. ( permalink )

view profile

ancawonka  Pro User  says:

This is just really .... amazing...
Posted 22 months ago. ( permalink )

view profile

Eli the Bearded  Pro User  says:

"Moreover, a photo shared among many pools will contribute less weight..."

Maybe that explains why 10 Million Photos, etc, don't figure very prominently.
Posted 22 months ago. ( permalink )

view profile

schoschie  Pro User  says:

I just thought it would be cool to have a zoom lens/loupe function to zoom in on details in photos on Flickr. So one could look at the whole thing and easily zoom into the details without having to load the huge original size photo (and losing the overview)…
Posted 22 months ago. ( permalink )

view profile

GustavoG  Pro User  says:

that explains why 10 Million Photos, etc, don't figure very prominently

*smirks meaningfully*
Posted 22 months ago. ( permalink )

view profile

Jane_S  Pro User  says:

Really interesting! What metrics exactly are the X and Y axes?
Posted 21 months ago. ( permalink )

view profile

GustavoG  Pro User  says:

The axes don't have a specific meaning. It's a 2D layout of a higher level graph. It could be rotated and stretched without changing the meaning: what is important is the connections between the nodes, and the resulting local clusters.
Posted 21 months ago. ( permalink )

view profile

jan~n  Pro User  says:

This is great Gustavo. I'd love to understand it better. There are lines between groups and the lines all seem to have the same weight. They are of different lengths however. What exactly do the lines represent? Is there some threshold number of "links" needed to create a line? Does a longer line represent fewer links?

If this is how it works then meaningful dimensions should emerge from the picture (a great example of meaning as an emergent phenomenon!)

I had a quick look to see if there were any discernable patterns in two dimensions. Maybe there is a vague "domestic" vs "cosmopolitan" dimension bottom to top. Couldn't pick up anything left the right. Maybe you need more dimensions. But probably I need to take a closer look.

It's interesting that, at the size depicted above, blue areas of intense connectedness are discernable.

I wish I still had my plotter! I'd love to print it out as a chart.

Seems like you've done this before. Where are earlier versions to be found?

Thanks heaps
Jan~n
Posted 21 months ago. ( permalink )

view profile

jan~n  Pro User  says:

Aha! Just as I post my comment, your answer to the previous question pops into view. So how many dimensions are there in the original graph?
Posted 21 months ago. ( permalink )

view profile

jan~n  Pro User  says:

And furthermore, given the data you have, is it possible to position the dots in two dimensions on a pairwise "number of links" basis (a la multidimensional scaling) with the number of links being a measure of "similarity"? If you did that, socially or psychologically meaningful dimensions should emerge, just as I conjectured above.
Posted 21 months ago. ( permalink )

view profile

GustavoG  Pro User  says:

Jan - the first link in the description leads to the previous version of this specific analysis. Check also my Analyses collection.

Running a PCA or MDS might be interesting, indeed. I once tried discerning such patterns in a different network - linking images via favoriting events. It was quite complex, needed quite a bit more work, and I never got to post any of it...

The blue areas could be an artefact of the layout algorithm too, if it locally left wider gaps between the nodes. I'd trust link density to be meaningful if the node icons were smaller. :)
Posted 21 months ago. ( permalink )

view profile

jan~n  Pro User  says:

I see what you mean about the blue bits.

I thought I saw another interesting "hole" out where the Australian bit is but I discovered that we are linked to the rest of the Flickr world by birds and only by birds. The other end of the Australian isthmus (sunrises and sunsets) doesn't quite make a link to Texas, so I guess that means their proximity (Australia and Texas) is purely coincidental (so to speak).

The bird link is interesting. Makes sense in a way. We are looking at nature because other features of Australian life (such as food) are cosmopolitan and therefore in the central groups. And of the category nature, I guess it's birds (migratory or ubiquitous) that we share with the rest of the world.
Posted 21 months ago. ( permalink )

view profile

nels1  Pro User  says:

your network graphs are fascinating Gustavo!

have you tried to animated them as a time-lapse visualisation?
Posted 21 months ago. ( permalink )

view profile

GustavoG  Pro User  says:

I haven't tried. Obtaining some of these data sets is quite hard, and producing the network graph is a bit of a work of art. Successive data samples might look quite different, so a "time lapse" movie would be quite jarring.

On the other hand, I've thought of doing "time lapse" visualizations of data projections over graphs like this. I'm not sure what the best method might be. Animated gif? I don't know how to build one programmatically. Any hints? :)
Posted 21 months ago. ( permalink )

view profile

schoschie  Pro User  says:

Woah, that would be cool. Or have it visualized in real-time. I wonder what sort of machine that would need. Maybe DeepBlue is available. I guess it isn't doable because most of the time would be spent waiting for Flickr data to travel over the Net.

I don't know how to build one programmatically. Any hints?
I created an animation programmatically once using the QuickTime APIs. There is sample code over at Apple that puts together a movie from single frames. There is a function that draws each of the frames and it's easy to put your own drawing code there.
Posted 21 months ago. ( permalink )

view profile

schoschie  Pro User  says:

I'm just wondering... would it be possible to do a "live" 3D version of a static graph like the one above which would allow you to use 3 axes for possibly a more meaningful layout of the nodes. Have it rendered using OpenGL and allow the user to rotate, scale and move around. Each node is a vertex, connections are edges. Nodes are always labeled with text (group name), but the group icon can be toggled on and off for speed.
Posted 21 months ago. ( permalink )

view profile

nels1  Pro User  says:

i wouldn't know how to build one programmatically, but you may find some ideas below. i came across this a few years back and found the interactive elements of this model really interesting in relation to exploring social network graphs.

www.cs.berkeley.edu/~jheer/vizster/vizster.wm v

www.danah.org/papers/InfoViz2005.pdf
Posted 21 months ago. ( permalink )

view profile

GustavoG  Pro User  says:

Mmmkay, how cool is this?

Not 3D, but at least browsable!
Posted 21 months ago. ( permalink )

view profile

efo  Pro User  says:

THAT is so very cool!
Posted 21 months ago. ( permalink )

view profile

schoschie  Pro User  says:

Yes! Very cool.
Posted 21 months ago. ( permalink )

view profile

nels1  Pro User  says:

wow! very cool indeed:)
Posted 21 months ago. ( permalink )

view profile

nels1  Pro User  says:

Gustavo, i just came across this new facebook app these guys are developing which lets you navigate through your network in 3D...thought you might find it interesting.

fb.computerarts.ca/export/facebook.htm
Posted 21 months ago. ( permalink )

view profile

GustavoG  Pro User  says:

Thanks for the link! Done in Processing I see.

A good first step, but definitely not adding much insight so far. I'm thinking a more intuitive visualization in 3D would need to shift node locations as one moves, to keep the relevant locale "in sight" more than this does.
Posted 21 months ago. ( permalink )

view profile

nels1  Pro User  says:

pleasure:)

right. i agree...there should be a field of view where properties that are deemed relevant by the user are prioritised within that view space.

they could also use this wii hack and make it completely immersive:)

www.youtube.com/watch?v=Jd3-eiid-Uw
Posted 21 months ago. ( permalink )

view profile

GustavoG  Pro User  says:

Ooo, that's so well done! The illusion of the target floating outside the screen is perfect.
Posted 21 months ago. ( permalink )

view profile

nels1  Pro User  says:

yeah, i know! it's the first i've seen of such an immersive experience without the need for 3D glasses. looking forward to seeing some of the applications of this in future:)

...add this with a minority report glove and you can be physically navigating your way through your social networks...
Posted 21 months ago. ( permalink )

view profile

GustavoG  Pro User  says:

I just posted an updated version of this, this time filtering out highly-redundant groups. See the main cluster and the smaller clusters.
Posted 21 months ago. ( permalink )

view profile

violingirl77 says:

This is amazing! It must have taken you a long time to make.
Posted 20 months ago. ( permalink )

view profile

themysteryman  Pro User  says:

wow, it's like wikipedia - start at Pokemon and end up at Quantum Physics... Or something else...
Posted 18 months ago. ( permalink )

view profile

striatic  Pro User  says:

"wow, it's like wikipedia - start at Pokemon and end up at Quantum Physics..."

usually that's the other way around : )
Posted 18 months ago. ( permalink )

view profile

↕↓↑ ŅõẇἇḸ - ⱪṧἇ ↑↓↕ says:

very cute and sooo nice
thanks for that i liked
Posted 17 months ago. ( permalink )

view profile

game1980  Pro User  says:

very interesting... and a lot of hard work input I bet. Now Im just addicted to zooming in and moving around. It really does have an amazing geography (topology).
Posted 16 months ago. ( permalink )

Bobaloo Cookazoo [deleted] says:

wow. eye popping!
Posted 15 months ago. ( permalink )

view profile

Jayel Aheram  Pro User  says:

Apologies for just reading and lurking around your FlickrLand set. :} I really like these (I wonder why I missed it?).
Posted 13 months ago. ( permalink )

view profile

daveawac says:

could you run that by me one more time?
Posted 7 months ago. ( permalink )

view profile

Philipp Berndt!  Pro User  says:

Lovely, i just love this!

:)
Posted 4 months ago. ( permalink )

view profile

ColleenM  Pro User  says:

spam reported. If it's gone you can delete this comment.
Posted 4 months ago. ( permalink )

Would you like to comment?

Sign up for a free account, or sign in (if you're already a member).

[?]
view photos Uploaded on February 5, 2008
by GustavoG

GustavoG's photostream

FlickrLand analyses, 2008 (Set)

24
items
Part of: Analyses

This photo also belongs to:

Most favored (Set)

Most viewed (Set)

Most commented (Set)

Emergence (Pool)

Flickr API (Pool)

Group Therapy (Pool)

Flickr Hacks (Pool)

Tags

Click this icon to see all public photos and videos tagged with cgi cgi

Additional Information

All rights reserved Anyone can see this photo

Add to your map