The Networked Bird Observatory Blog

I’ve mentioned before how impressed I’ve been by the way identification consensus emerged around some of the trickier shots in the game; by and large I can’t think of any significant miscarriages of justice.

The only real regret I have about the identifications made during the game were these two species, neither of which ever got enough votes to qualify for the ID that I think the images deserved. (The Yellow-rumped Warbler would have been on the list, too, except that one of the handful of shots we got of that bird made it to an ID.)

First up are these two shots, taken at 11:06 a.m. on October 26 by petemokazfi and robin54, respectively:

I’ve written about them before, and the more I look at them the more convinced I get that they really do show an Orange-crowned Warbler. Sadly, we never got the 2/3 majority we needed to get the ID. For the first image, the vote count we ended up with was:

7 Orange-crowned Warbler
3 Lesser Goldfinch
1 Warbling Vireo
1 Wilson's Warbler

For the second image, the final tally was:

8 Orange-crowned Warbler
3 Lesser Goldfinch
1 Warbling Vireo
1 Hooded Oriole

So, we would have needed 3 more votes to flip the first one, and 2 more votes to get the second one. But with voting closed with the end of the game, that will have to remain an unrealized promise.

Likewise with this image, which was taken way back on May 7 at 1:58 p.m. by bluebean:

I wrote about this image before on the blog (see Well, Hello Little Lady), and again, the more I look at the image the more likely I think it is that that was a female Western Tanager. The final vote tally for this image was:

14 Western Tanager
4 Lesser Goldfinch
3 Bullock's Oriole
1 American Goldfinch
1 Summer Tanager
1 House Wren
1 Pygmy Nuthatch

So we would have needed 8 more votes to flip that one.

Oh well. Better luck next time.

Several times I tried to get 10 distinct identified species in my 10 shots in a day; it was always a lot of fun, even when I didn’t quite make it. Now that I can play with the metadata, here’s the record of the top “Little Big Days” on the system, ranked (first) by the number of species identified, and (second) by the time of the last shot of the day. That is, if two users both got the same number of species, the “winner” was the user who got their last shot earlier in the day.

Anyway, here’s the top 20 performances on the system judged by those criteria:

+----------------+---------------------+---------------------+-------+
| user           | begin               | end                 | count |
+----------------+---------------------+---------------------+-------+
| noho_bird_club | 2007-05-18 05:51:10 | 2007-05-18 12:06:25 |    10 |
| elanus         | 2007-05-12 05:53:19 | 2007-05-12 16:06:32 |    10 |
| elanus         | 2007-05-05 06:03:41 | 2007-05-05 16:55:51 |    10 |
| kitcat         | 2007-08-27 08:09:52 | 2007-08-27 17:00:01 |    10 |
| vireo          | 2007-10-19 09:12:31 | 2007-10-19 17:43:39 |    10 |
| elanus         | 2007-08-12 09:11:08 | 2007-08-12 19:32:43 |    10 |
| noho_bird_club | 2007-05-25 06:23:56 | 2007-05-25 12:18:10 |     9 |
| robin54        | 2007-10-26 07:18:31 | 2007-10-26 13:15:46 |     9 |
| elanus         | 2007-10-19 07:38:19 | 2007-10-19 16:08:34 |     9 |
| vireo          | 2007-10-26 16:25:52 | 2007-10-26 17:14:26 |     9 |
| kitcat         | 2007-10-21 11:54:49 | 2007-10-21 17:52:17 |     9 |
| vireo          | 2007-10-17 13:26:50 | 2007-10-17 18:16:40 |     9 |
| noho_bird_club | 2007-05-15 06:38:32 | 2007-05-15 19:27:54 |     9 |
| elanus         | 2007-10-17 07:35:23 | 2007-10-17 08:46:13 |     8 |
| noho_bird_club | 2007-06-01 05:51:48 | 2007-06-01 11:20:14 |     8 |
| spurdin        | 2007-06-12 08:59:27 | 2007-06-12 15:11:12 |     8 |
| elanus         | 2007-11-07 13:35:32 | 2007-11-07 16:07:46 |     8 |
| robin54        | 2007-10-20 07:58:33 | 2007-10-20 16:35:22 |     8 |
| birdbrain      | 2007-10-11 09:41:26 | 2007-10-11 18:03:16 |     8 |
| birdbrain      | 2007-08-10 13:44:09 | 2007-08-10 18:45:09 |     8 |
+----------------+---------------------+---------------------+-------+
20 rows in set (0.22 sec)

As you can see, there were 6 times that a user went 10 for 10; I’m proud that 3 of those were mine. (It probably helped that I was the only person trying to do this 10-for-10 thing most of the time.)

But noho_bird_club is the champion, hands down, in terms of earliest completion of a perfect-10 day: On May 18 he got his 10th shot of a distinct species at 12:06:25 p.m., more than 4 hours earlier in the day than my next-place finish.

Here are the 10 shots he got that day, in order:

American Robin at 5:51:

House Finch at 6:29:

House Sparrow at 7:35:

Pygmy Nuthatch at 8:36:

Chestnut-backed Chickadee (small, but clearly identifiable) at 8:43:

Western Scrub-Jay at 8:48:

Anna’s Hummingbird (a little fuzzy, but again, definitely identifiable) at 8:52:

Mourning Dove, shyly preening but no doubt on the ID, at 10:56:

Several Rock Pigeons on the distant roofline; probably the sketchiest photo of the bunch, but again, for birdcam regulars there’s no question that’s what they are, at 11:42:

And finally, this cute shot of the Dark-eyed Junco looking at us in its reflection in the thistle-seed feeder:

Congratulations, noho_bird_club!

The seesaw battle for the top of the leaderboard continues, with noho_bird_club taking the top spot back from fingerlakes. Here are the standings as of a few minutes ago:

Congratulations, noho_bird_club!

I spoke over-broadly about noho_bird_club kicking all our butts in scoring. He’s kicking all our butts except one: fingerlakes’. Because fingerlakes, as of this evening, is the new top-scoring user in the system:

Congratulations, fingerlakes!

I mentioned in an update to a previous item that I no longer think the system has been intentionally nerfed. From some email correspondence I’ve had with the CONE SF system’s creators, I now believe that all the slowdowns I’ve been perceiving as intentional actions are in fact just garden-variety slowness resulting from performance issues with the site’s database.

In an email I got early this morning from Bryce Lee, who is listed on the site’s credits page as being responsible for “Database and Website Design and Engineering”, he mentioned that “tomorrow, we are rolling out the classification fix and will be addressing the my gallery shortly.” So I popped into the system just now (at 6:30 a.m. Pacific time) and entered a couple of classifications, and the result page popped right up within a second or two. That’s awesome!

Go, Bryce!

The game has a new leader as of this afternoon. wyoming built a big lead weeks ago by being really zealous about watching the site all day and entering new IDs very quickly, winning the race to be one of the first three to enter an ID. He (or she) got to 5001 points and basically quit; I haven’t seen him (or her) on the game since then. It’s been a steady slog of people working their way up to that score, and today sunbird finally passed it.

Congratulations, sunbird!

That makes me wonder if wyoming will be back now. I’m guessing not, but we’ll see.

As regular players are too-painfully aware, there are a couple of ways in which the CONE SF system has been “nerfed” (gamer slang for a system that has intentionally been made less-capable in some area).

One disability that the system has had from the beginning is the way the camera will automatically zoom to a fairly zoomed-out position (not the maximum zoomed-out position, but pretty far) if you try to point it in the area of the buildings in the upper lefthand corner of the panorama. As the FAQ explains, that has been done for privacy reasons, and while it’s kind of a pain when you’re trying to get a shot of the Rock Pigeons on the rooftops, I think it’s probably necessary.

The second disability is one that the game acquired on May 7. I talked about it some in System Changes. Basically, since that time, certain operations take a lot longer than they used to. In particular, loading the My Gallery page, and entering an ID on an individual photo page, can sometimes take a very long time.

My assumption has always been that this represents an intentional act of nerfing, rather than an unintended performance problem. (Update: Actually, as of a couple of days after I originally posted this, I no longer think this. I’m now thinking it’s an unintended performance problem. I’ll post more on that when I’ve got more specifics.) I’ve mentioned it a few times in emails to the site’s operators, and although I’ve received some feedback from Professor Ken Goldberg (the project’s co-director) and from Bryce Lee (one of the students who developed the system) to other comments I’ve made, they’ve never said anything specifically about this issue. Which is pretty much what I’d expect. There’s a complex dynamic that controls what information you do and don’t give out when you’re developing an online multiplayer game, and as someone who’s been on both sides of that issue I understand, and sympathize with, the CONE SF creators’ hesitation to share too many details about what they’re doing.

So, given that I don’t really know what the intention behind this was, or the specifics of how it has been implemented, it’s hard for me to be sure of what I’m about to say. But I’ll say it anyway: I think this particular act of nerfing isn’t very effective. It doesn’t appear to me that it’s accomplishing much beyond annoying a lot of us to the point that we’ll probably end up using the system less than we otherwise would.

In preparation for writing this item, I ran some tests to try to get a better idea of how the nerfing actually behaves. I turned off image loading in my browser (to better monitor the connections I was making to the server), loaded the My Gallery page multiple times in new browser tabs by Command-clicking in Firefox, and noted how long it took for the individual requests to complete.

Here’s the first test I ran, in which I submitted five requests in quick succession (spanning two to three seconds, probably, from first to last). For each request (numbered in order), I give the number of seconds until the server’s response completed:

Requests submitted at 08:30:00:

1: 47s
2: 54s
3: 1m 00s
4: 1m 08s
5: 1m 15s

I suspected that that test might have been influenced by the clicking around on the site I’d been doing just prior to that, so I waited several minutes, then tried again, this time only making two requests. The results:

Requests submitted at 08:35:00:

1. 8s
2. 16s

Then I ran a test with three near-simultaneous My Gallery page loads:

Requests submitted at 08:37:00:

1. 8s
2. 15s
3. 22s

Next I did a test with four:

Requests submitted at 08:39:00:

1. 8s
2. 16s
3. 21s
4. 28s

And then with five:

Requests submitted at 08:41:00:

1. 8s
2. 16s
3. 24s
4. 35s
5. 1m 35s

That one was interesting. Between the fourth and fifth request returning I suddenly got a huge jump of an additional minute of time. Two and a half minutes later I ran another test with five requests; here are the results from that:

Requests submitted at 08:45:00:

1. 49s
2. 1m 45s
3. 2m 45s
4. 3m 00s
5. 3m 05s

Again, there’s lots of extra time being injected into several of those responses. And then I tried 10 simultaneous requests:

Requests submitted at 08:49:00:

1. 8s
2. 16s
3. 24s
4. 30s
5. 35s
6. 43s
7. 50s
8. 56s
9. 1m 05s
10. 1m 10s

Now it seems to be back to “normal”, with about 7 or 8 additional seconds being tacked onto each request. And then, just now, after not using the system for an hour or so, I loaded the My Gallery page once, waited two minutes, and then loaded the page 10 times in quick succession. The response times were as follows:

Requests submitted at 10:11:00:

1. 8s
2. 15s
3. 22s
4. 29s
5. 34s
6. 40s
7. 47s
8. 54s
9. 1m 00s
10. 1m 08s

Again, all the responses look “normal”, with about 7 additional seconds (on average) for each additional request.

So, summarizing what I’ve seen, the nerfing system seems to work like this: requests for the My Gallery page are queued up, and responded to with one response every 7 seconds (or so). There’s also something that occasionally injects a large (and variable) amount of extra time, on the order of 45 seconds to a minute. I can think of a couple of explanations for that:

1. It could be that the nerfing is being done on a per-user-account (or per IP address, maybe) basis. In that scenario, the occasional injections of big blocks of additional time could be the result of some kind of longterm effect of my previous testing. Maybe the nerfing algorithm is integrating requests across a longer span of time than the minute or two of inactivity I was leaving between requests?

2. It could be that nerfing is being done on a server-wide basis. In this scenario, the injections of extra time could be the result of other users’ requests slipping into the queue ahead of mine.

I can think of a couple of ways to figure this out. One way would be to create a “sock puppet” account and run two tests simultaneously (from different IP addresses, I guess, to be sure I was isolating the tests from the server’s perspective). But I haven’t used sock puppets to try to figure out the system up until now, and don’t think it’s really kosher, even though I haven’t been able to find any language explicitly forbidding it on the system.

An easier way to test the “one big queue, across all users” theory would be to repeat my tests late at night, when I can be reasonably sure I’m the only person interacting with the system. Maybe I’ll try that.

In the meantime, I hope the good people on the CONE SF development team will get rid of the response-time nerfing. Especially when one is trying to snap a good picture of a rarity, taking lots of photos and then trying to delete the rejects in order to get another one before the bird disappears, the nerfing is very annoying. (That annoyance is multiplied many times over if you only have one or two shots left in your roll for the day.) If it’s true that all the users entering nerfable requests at any given time are competing with each other for a place in the queue, this gets even worse, since when a rarity is on-camera everyone will be trying to delete their rejected shots at the same time. In effect, the system will become cumbersome and unusable at the precise moment that players are most sensitive to its performance.

That’s not fun. And games are supposed to be fun.

Okay; done ranting for now.

kryptonkay got this interesting shot at 4:05 p.m. today:

It’s pretty clear, after some study, that it’s a female House Sparrow. But the posture and the camera angle are deceptive; it looks like a pretty unusual bird. This led to a number of wrong guesses being entered, such that by the time I came along and entered my own guess, it had been placed in status ‘Disputed’.

My ID of House Sparrow was enough to flip it to that ID, which is handy, because I’ve been wondering just what it takes to go from disputed to ID’d.

Before my vote the tally was like this:

Dark-eyed Junco: 1
Pygmy Nuthatch: 2
House Sparrow: 5

After my vote, it was:

Dark-eyed Junco: 1
Pygmy Nuthatch: 2
House Sparrow: 6

As most of us have probably noticed, two votes to one is sufficient to get a bird with only three votes classified as whatever got the two votes. And the evidence of this photo seems to indicate that the same principle works with larger numbers, too, leading me to believe that this is the general rule: A bird is given an ID if at least 2/3 of the votes cast agree on a particular species.

I took a look at some of the more notorious shots currently in ‘Disputed’ status, to see what it will take to get them classified “properly” (according to my personal definition). For instance, there’s this photo by bluebean, which I believe (for reasons I explained in more detail in Well, Hello Little Lady) to be a female Western Tanager:

Currently the vote tally for this one is:

Western Tanager: 10
Lesser Goldfinch: 4
Bullock’s Oriole: 3
American Goldfinch: 1

So, to get the image classified as Western Tanager would require six more votes for that, with no dissenting votes (because there currently are eight non-tanager votes, and we need to double that). I guess I won’t hold my breath for that; there’s probably a better chance of getting another, clearer shot of the bird if we want Western Tanager to be officially in the game. (Wouldn’t a shot of a male be awesome?)

Then there’s this photo by harpsichordgal, which I talked about in Is That a Hooded Oriole?

Currently its vote total is like this:

Hooded Oriole: 4
Black-headed Grosbeak: 4
Evening Grosbeak: 1

So to get that officially ID’d as the game’s first Hooded Oriole would require (again) six more votes for that, with no dissenting votes. Sigh. Probably not going to happen anytime soon.

Next up are these two shots, from the first (and so far only) appearance of the Lazuli Bunting, back on the morning of May 9. Both of these were by kryptonkay:

The vote tally on the first one is:

Lazuli Bunting: 5
Black-headed Grosbeak: 4

That means to switch that ID to Lazuli Bunting would require three more votes for that, with no dissenting votes.

The vote tally on the second image is currently:

Lazuli Bunting: 6
Black-headed Grosbeak: 3
Blue-headed Vireo: 1

That means to switch that ID to Lazuli Bunting would require two more votes for that, with no dissenting votes.

I really hope we can get one or both of those switched to Lazuli Bunting, for the following reasons:

1. That first shot was the first appearance of the bird in the system. It would be nice to have it properly classified.
2. The second shot is arguably the clearest one taken of the bird during his appearance.
3. Most importantly, of the other seven shots of the bird that were taken that day, and that were successfully ID’d as Lazuli Bunting, none were taken by kryptonkay. That’s not fair. She seriously deserves to have that bird in her list of photographed species.

If you haven’t entered a vote yet for one of these disputed photos, I encourage you to do so now. Well, as long as you’re willing to vote the right way. Otherwise, I encourage you not to bother. Thanks!

Update: And now, thanks to some help from users lal and vireo, the second of those has been flipped to Lazuli Bunting. Yay! All is right with the world.

I hereby enter this shot, which I snapped at 05:38 today, into the competition for “earliest identifiable image”:

I haven’t actually checked yet, but I’d have to think that what with the days only slowly lengthening on their way to the summer solstice, and with Robins being notoriously early risers, that this photo is going to be tough to beat, at least for a while.

I thought I’d set myself a challenge today, to see if I could get ten photos featuring ten different species. Sort of a “mini big day.”

Here are the birds I got, and the times at which I got them:

1. 06:03 - House Finch
2. 06:46 - Chestnut-backed Chickadee
3. 08:04 - Rock Pigeon
4. 08:06 - Dark-eyed Junco
5. 08:20 - Pygmy Nuthatch
6. 08:34 - House Sparrow
7. 10:27 - American Robin
8. 12:00 - Anna’s Hummingbird
9. 13:21 - Mourning Dove
10. 16:55 - Western Scrub-Jay

I actually was on track to complete the ten birds much earlier; a Scrub Jay that would have been my 10th species visited the ball feeder at 13:48, and over the next three minutes other players snapped 10 different pictures of it. But I got an important phonecall during that time, and my back was to the computer, and I didn’t notice it. When the call ended and I saw what I’d missed, I mentally kicked myself, then decided that I needed to get a life, and went out to watch some real birds. I didn’t get back to the computer until late in the afternoon, so I also missed all the fun today when someone found a Mourning Dove perched on what I think of as the “Upper Limb”, that big tree branch in the middle of the forest that is up above that other big branch (which I think of as just “The Limb”) where I’m always hoping to see something big and impressive perched. A Red-shouldered or a Cooper’s Hawk, maybe; either one of those would do nicely.

Anyway, there you go: ten species in ten photos, completed as of 16:55. Consider the gauntlet thrown down, fellow players. Let’s see you beat it.