|
And here it is:
What is Explore?
Explore is a Flickr feature with the intent of showing you "some of the most awesome photos on Flickr." Photos are automatically selected by computer according to a secret algorithm called Interestingness (see below for more about that).
Is Explore a showcase for the top Flickr photographers?
No. It's for photo viewers, not the photographers. It exists so that, at any moment, anyone who wants to view interesting photos can go to Explore and have a reasonable chance of seeing something interesting. Does that imply that photographs not in Explore are uninteresting? Of course not. There are many, many wonderful photos uploaded to Flickr each day that aren't selected for Explore. But to serve it's purpose, Explore only has to include a small sampling of all of the photos on Flickr (currently at 500 per day or about 0.1% of the daily upload volume). And Explore tries to show photos from as many different people as possible to create a diverse selection.
Explore is for the viewers. It's a way for Flickr to show the world a sampling of what is being shared there. It's there for those who are new to Flickr, who are lost in the vastness of it all and don't know where to begin. It is not a "best of" listing of photographers. It is not a popularity contest.
What is Interestingness?
Interestingness is what Flickr calls the criteria used for selecting which photos are shown in Explore. All photos are given an Interestingness "score" that can also be used to sort any image search on Flickr. The top 500 photos ranked by Interestingness are shown in Explore. Interestingness rankings are calculated automatically by a secret computer algorithm. The algorithm is often referred to by name as the Interestingness algorithm. Although the algorithm is secret, Flickr has stated that many factors go into calculating Interestingness including: a photo's tags, how many groups the photo is in, views, favorites, where click-throughs are coming from, who comments on a photo and when, and more. The velocity of any of those components is a key factor. For example, getting 20 comments in an hour counts much higher than getting 20 comments in a week.
Does the Interestingness algorithm ever change? Why?
Yes. The algorithm is under development and occasionally a new version is deployed. There are two main reasons for this: a) the new algorithm works better and b) it disrupts patterns that allow the same people to feature in Explore day after day. In other words, it shakes things up so that new people can get in and diversify Explore. It's gone through at least three major revisions. The original version only showed something like the top 50. It was later expanded to show the top 500 and the calendar view was added. There were two additional algorithm changes in February and June of 2006.
Why is the ranking changing for days in the past? Aren't the Explore rankings frozen each day?
No. The rankings in Explore for all dates change all the time even for dates in the past. Photos are uploaded to Flickr at a rate of around 400/minute and are constantly being viewed, faved, and commented by millions of members. Interestingness rankings are recalculated for all photos many times per day. Photos uploaded a day, a week, even a year ago, are still receiving activity in the form of views, comments, favorites, etc. And all of that activity affects each photo's Interestingness ranking, even for photos that were uploaded years ago. Explore is very dynamic. When you browse through Explore on any date, you are viewing what the Interestingness algorithm has selected as the highest ranked photos at that moment.
But my photo didn't have any activity. Why did the ranking change?
Rankings are relative to other photos uploaded on the same day. If everyone else moves up, you move down.
Why is my highest ranked photo not in Explore while my second highest ranked photo is in Explore?
Were they uploaded on different days? Remember, to get into Explore every photo has to "compete" against every other photo on Flickr; and every day is a different competition with different photographs. You can't compare rankings from day to day. That is, the #1 photo in Explore today might have been #497 (or might not even have made the cut) if it was uploaded yesterday—even though in your personal listing it is your highest ranked photo.
How can a photo in Explore go from #1 to dropping completely off the list?
It seems counter intuitive but it makes sense. Interestingness is not calculated in real-time, microsecond to microsecond. It is calculated en masse at intervals, perhaps once per hour. Imagine all of the activity that occurs in an hour—not just on your photo but all of the other photos in Explore and on the rest of Flickr. All of that activity goes into the Interestingness algorithm and every photo is re-ranked. The result of that activity is that many photos' Interestingness rankings may have changed drastically.
But isn't it just completely random?
No. If it were completely random then you'd never see any stability in a photo's ranking and there are many photos that have maintained the same position for months on end.
Why do my photos bounce in and out of Explore?
No one knows for sure except Flickr staff. Many people speculate that it is a random factor in Explore. That may be. I think it is an emergent behavior caused by two factors: the relative difference between Interestingness scores among the top photos and a little algorithmic instability. Imagine every photo gets an Interestingness score (IS) from 0 to 1 million. Now imagine that the top 1000 photos all have an IS between 999995 and 1000000. Only 5 points separate the top 1000 photos! When the top photos are separated by such a small margin, the smallest change in activity can change a photo's ranking dramatically. It's like the Olympics where the top competitors are only separated by a few hundredths of a second.
Algorithmic instability refers to a condition created when the ranking of one photo depends on the ranking of another photo. This might exist, for example, if there is a bias in place to prevent more than one photo from the same photographer from appearing on the same day (I strongly suspect there is such a bias). The algorithm will score both photos and then lower the score of one dramatically to kick it off the list. But how does it choose which one to drop? Especially if they are ranked very closely? The next time the algorithm runs, it might kick the other photo because it didn't receive as many comments since the last sweep. The result is that these two photos would appear to be randomly swapping positions every few hours when it's not really random at all.
What is Scout?
Scout is a third-party application that uses the Flickr API to retrieve the daily Explore data. It then uses that data to show any user all of his photos that are currently featured somewhere in Explore. Scout is not affiliated with Flickr. I am not a Flickr employee.
How does Scout work?
Scout updates its database incrementally throughout the day. Scout loads whole days at a time (all 500 photos) back to August 2004 until the entire database is refreshed. And then it starts over. In essence, it takes a snapshot of each day in Explore.
Why does Scout say my photo dropped?
If a photo is dropped, it's because it wasn't in Explore when Scout scanned that day.
Scout says my photo isn't in Explore but it actually is in Explore. What gives?
There are a lot of factors at work. Take this theoretical sequence of events:
1. Scout and Explore are synchronized.
2. Flickr updates Interestingness and the photo drops. At this point, Scout will still show the photo is in Explore when it is not.
3. Scout updates and marks the photo dropped. Now Scout and Interestingness are in sync again.
4. Interestingness updates and the photo comes back into Explore. At this point, Scout will show that the photo has dropped even though it is currently in Explore.
5. Scout updates and marks the photo added. And now Scout and Explore are back in sync again.
If you check Scout and Explore before step 1 and again at Step 4 or 5 you may get the impression that the photo has never left the Explore pages when in reality it did for a brief period of time.
It's actually more complicated than that because there's a huge website caching mechanism at work. And Scout doesn't just update it's entire database every few hours. It updates recent days more frequently and updates the database incrementally rather than all at once.
The bottom line is this: if Scout says a photo dropped, then Flickr told Scout it wasn't in Explore at the exact moment that Scout asked.
Why is Scout showing an incorrect ranking for my photo?
Because Scout and Explore are updated at different intervals, the rankings may be slightly out of sync. See the above answer.
Why does Scout show a ranking for my recently dropped photos?
Since photos dropped from Explore don't have a ranking, Scout shows the last known ranking at the time it dropped.
How can I find the highest ranking a photo has ever achieved?
Scout keeps a 7 day history of rankings and also tracks the highest ranking achieved for all time. Click the position change indicators (red and green arrows or black dots next to the rank) to view the history for a photo.
When does Scout stop tracking a photo?
Scout removes all information about a photo from its database if the photo is dropped from Explore for three consecutive days.
If Scout drops all tracking information from a photo that has been dropped for 3 consecutive days, how could it ever pick up a photo that was in Explore in 2005?
Remember that photos are in Explore because their Interestingness is high enough now, today, at this moment. Explore shows photos that currently have a high Interestingness score and Interestingness is recalculated constantly for all photos regardless of when they were uploaded. The date a photo was uploaded determines the box it occupies on the calendar. A photo uploaded in 2005 could have been Interesting enough to be in Explore in 2005 but later dropped. Months, even years later, new activity on that photo could drive it's Interestingness up enough to show it in Explore again.
How far back does Scout look?
Scout tracks every day back to August 2004. This is every date that Explore tracks.
Why are some of my photos with more views and faves less interesting than some of my other photos with fewer views and faves?
Views and faves are only part of the Interestingness ranking. The speed at which those views/faves occurred and many other factors go into calculating Interestingness.
Is it possible to make a Scout poster of my dropped photos/my #1 photos/all of my photos with their highest ranking/etc?
No. You can make a Scout poster of all of your photos that are currently in Explore. I'm not planning on adding other options.\
Is it true that adding my photo to many groups will reduce its Interestingness?
Yes, that's true.
Why does my photo show in Explore on a different day than when I uploaded it?
Explore always counts days in Pacific Time for the purpose of displaying photos on the Explore calendar. That is, the start of each day as counted in Explore is at midnight Pacific time or GMT-8.
Is there any way to remove my photos from Explore?
There are several ways. You could delete it. Another way is to make the photo private. Only public photos are featured in Explore. You can also click the "May offend" button on one of your own photos. When you do that, it tells Flickr that you don't want that photo shown in public areas.
I'm really [insert emotion here] about Explore. Can you help?
No, not really. I am not affiliated with or employed by Flickr. If you're upset that your photos aren't in Explore, the best advice I can give you is this: convince yourself that it doesn't matter. Because it doesn't.
[Edited to create spaces between questions and answers.]
Originally posted 72 months ago.
(permalink)
mimbrava edited this topic 72 months ago.
|