My Mechanical Turk

December 30, 2008

This week’s storm in the blogosphere focused on the question of “authority” on twitter and other social networks. It all began when welebrity Loïc Le Meur suggested that twitter searches should be filtered by a measure of authority. This immediately elicited critical responses from other high profile members of the online world, such as Robert Scoble and Dave Winer, only to have Mike Arrington leap to Loïc’s defence.

So what is the kerfuffle all about? I’ll start at the beginning, with twitter. I’ve written about twitter many times before, but there may be a few readers who still don’t know what it is. Twitter is microblog. It is one of many, but currently the most popular. A microblog allows users to post very short messages and links to all of their “followers” (also known as “subscribers” or “friends”, depending on the site). While it is possible to make these message private on twitter, most people keep their messages public. As with anything publically published online, this means that these messages are visible to anyone, not just followers. In particular, they are amenable to searching. A twitter search is a powerful tool. A good example is using twitter to keep track of rapidly unfolding current events. Over the last few days, many twitter users have been posting photos, news links and opinions about the bombings in Gaza, tagging them with label “#gaza” which makes them easy to find on twitter. In amongst the predictably partisan rhetoric from both sides, it is possible to stay a step ahead of reporting in the mainstream media and gain some genuine insight into the crisis. Not so long ago, a search for #mumbai provide a similar window the Mumbai terrorist attack.

As valuable as these searches are, Twitter’s strength is also its weakness. The number of twitter users worldwide is now estimated to be approaching 6 million, which means that the amount of information flowing around in “tweets” (as twitter messages are commonly known) is enormous. However, as twitter grows the signal-to-noise ratio is likely to drop and more and more tweets are likely to be spam, inflammatory bile or just nonsense. So from this perspective, having an ability to filter search results to the most “relevant” tweets (in some sense) is appealing. The problem, however, arose with Loïc’s suggestion that filtering should be based on a notion of “authority”, possibly defined in terms of the number of followers each user has. Not unreasonbly, many took issue with this measure of authority. As Robert Scoble (@scobleizer) argued:

Here’s why it’s a stupid idea: everyone is gaming the number of followers. And, even if everyone weren’t, popularity on Twitter isn’t a good way to measure whether a Tweet is any good or not.

From there discussions moved on to the distinction between the number of followers and the quality of the people you follow.

The ensuing debate leapt from blogs to twitter to FriendFeed, but to my mind part of the reason for the controversy is that a number of different issues were being conflated:

  1. Is there merit in being able to filter search results based on characteristics of the user posting the tweet?
  2. Is the number of followers you have a good measure of the quality of your tweets?
  3. Is it valuable to have a large number of followers?

Most people debating the issue combined the first two questions, only allowing answers “yes and yes” (the Loïc/Arrington perspective) or “no and no” (the Winer/Scoble view). My own answers are, respectively, “yes”, for the reasons outlined above, and “no”, as I agree with Scoble on that mere follower count is a poor measure of “authority”. And the conflation doesn’t end there. Most people answering “no” to question two means that attempts to cultivate a large number of followers are misguided. But I don’t agree with that either.

While having a large number of followers may not give any indication of your authority, it does give you access to an extremely powerful mechanical Turk. The original mechanical Turk was an 18th century machine that purported to be able to play chess. It was, however, a hoax as a human hidden inside the machine was actually doing the thinking. The term has had a new lease of life online to refer to the practice of crowdsourcing, which involves harnessing the power of large numbers of networked humans. Now that I have over 850 followers (a very modest count by twitter standards) I have begun to sense the crowdsourcing power of twitter. If I post a question to my followers (aka my “tweeps”), the responses are impressive. Over the last couple of days I used twitter for two different pieces of use for friends. The first was to seek advice on the best wireless broadband providers in Sydney. The responses were immediate. Here is an example:

Broadband Tweet

My next task was to find out about fertilizer for azaleas and camelias. This was a more obscure question, so I was less optimistic. Yet, here is the response I received.

Flower Tweet

Later I had to clarify what the numbers meant (amounts of Nitrogen, Phosphorus and Potassium, if you were wondering), but was extremely happy with the effectiveness of my own personal mechanical Turk. Of course, quality is as important here as well as quality. If I had not been following @pazaq, my question would still be unanswered. Nevertheless, as my follower count increases, I expect my Turk to become more and more useful.

So while growing your follower count certainly comes behind developing a community inside twitter and engaging in thought-provoking conversation and debate, there is no doubt that there is strength in numbers.


End of the Age of the Gatekeepers

December 19, 2008

Homer & Bart 2Mark Pesce describes himself as “an inventor, writer, theorist, very minor TV personality” (he’s a regular on the ABC’s New Inventors). He is also a major personality in Australian twitter circles. Yesterday Pesce penned an excellent opinion piece connecting two recent Australian court cases. In one a judge ruled that tasteless sexual depictions of Simpsons cartoon characters should be considered child pornography. In the other case, a man was found guilty of distributing child-abuse materials. What he had actually done was pass on a link to a video of a man swinging a baby. He had nothing to do with the creation of the video, but simply shared a link to a video that thousands around the world had already seen.

Now each of these cases in isolation may well be legitimate interpretations of Australian law, but taken together the implications are rather ridiculous. As Pesce observes:

[It] means that viewing a clip of The Simpsons on YouTube will soon be as illegal as watching it on television. In particular, videos showing the various times Homer has strangled Bart - which exist - would be very illegal, the equivalent of the most severe child abuse materials. And God help you if you should flip a link of that video to one of your friends. That’d be “distributing” child-abuse materials, because, where we are now, distribution has expanded to include link-sharing.

Another Australian twitter luminary, Stilgherrian, is fond of seeking out modern day inheritors of King Canute (not Stil’s preferred spelling) who try to turn back the tide. So it seems that Australian courts are joining the RIAA, television stations and the Australian Government in vying for the Canute mantle and attempting to put Pandora’s internet back in the box. They should face reality and give up. As Pesce says, we have reached the end of the age of the gatekeepers.


Rudd, Carbon and the Price of Petrol

December 19, 2008

Power StackAustralia’s Prime Minister, Kevin Rudd, triggered waves of protests from environmentalists this week when he annouced that Australia’s target for emissions for 2020 would be a mere 5% reduction from the levels in 2000. With substantial commitments to emission reductions from other countries around the world, this target would be increased to 15%. While the Government was at pains to point out that Australia’s population growth makes this target more ambitious than it sounds. However, by world standards Australia’s emissions are very high, whether measure per capita or by gross domestic product. This means that Australia’s should have more scope for relatively inexpensive emissions reductions than many other countries.

So 5% does seem to be a very unsatisfactory target. If you are a climate-change skeptic, even a 5% target is a needless waste of time and money, while if you take forecasts of climate-change seriously it seems woefully inadequate. However, rather than focusing on the target itself, in this post I will look at the implications that the Government’s plan will have where consumers will see it most directly, on the price of petrol.

In their White Paper on the carbon reduction scheme, the Government proposes a cap on the price of carbon of $40 per tonne for the next 5 years while, for their financial impact modelling, a price of $25 per tonne has been assumed. In an earlier post I calculated the impact of the price of carbon on the price of petrol. Here are the results for a range of carbon prices.

Cost of
Emissions

($/tonne)
Petrol Price
Increase
(cents/litre)
10 2.4
20 4.8
25 6.0
30 7.2
40 9.6

So, if the Government’s assumption is correct that the price of carbon will initially be around $25 per tonne, we can expect an increase in petrol prices of 6 cents per litre. Even if the price of carbon reaches the $40 cap, the impact on petrol prices will only be around 10 cents per litre. I say “only” because that 10 cents is a small compared to extraordinary moves in petrol prices seen over the last year due to movements in the price of crude oil. From July to November, price of petrol in Sydney fell by almost 40 cents per litre, according to prices published by the Australian Automobile Association, and based on my observations has fallen another 20 cents since then. Even compared to the 38 cents per litre fuel excise, 10 cents seems a modest figure. The chart below shows the dramatic moves in petrol prices along with projected prices based on the daily price of Singapore 95 refined oil, based on a regression model I have used in a number of posts in the past.

Petrol - Dec 2008

Introducing an emissions trading scheme for carbon will eventually affect a wide range of consumer prices, but based the relatively small increase petrol prices that it will produce, the scheme is not likely to have a significant impact on consumer behaviour. The scheme will do all its work on the behaviour of businesses and, given the dire financial straits we find ourselves in today, this is presumably why the Government has been so unambitious with their target. But this does also highlight that there is a lot more that the Government could be doing to reduce consumer carbon emissions beyond the trading scheme itself.

Photo Source: Foto43 on flickr (Creative Commons).


RIAA Continues to Stifle Innovation

December 18, 2008

Back in August, muxtape, a popular music playlist site, was forced to close by the Recording Industry Association of America (RIAA). Now mixwit have announced that is is closing too. The only explanation offered was as follows:

We’ve put a year of work into Mixwit so this choice wasn’t taken lightly. I won’t go into the details of our situation but state simply that we boldly marched into in a position best described as “between a rock and a hard place.”

Reading between the line, it looks as though they too have fallen at the hands of the RIAA. Under the cover of claims to be protecting artists, claims that do not bear close scrutiny, the RIAA is building an impressive track-record of stifling innovation. While it is possible to take comfort from the fact that attempts to stem the tide of progress always fail in the end, it is neverthless frustrating to see the suffering of victims of this pernicious organisation in the meantime, whether those victims are single mothers sued for file-sharing or the creators of sites like muxtape and mixwit.

Read the rest of this entry »


Auction Approaching

December 12, 2008

Recently I bought a new house at auction and now I am in the process of selling the old house, which will also be by auction. As a result, I have spent a lot of time of late pondering the best way to approach an auction, both as a buyer and a seller.

There are a lot of different types of auction. In a Dutch auction, popular at wholesale fish markets and also known more prosaically as a descending price auction, the auctioneer starts with a high price, which is then reduced in increments until a buyer is prepared to pay that price for the fish (or whatever is being sold). Bond market tenders are closely related to Dutch auctions.

Read the rest of this entry »


Pownce and Sandy: RIP

December 2, 2008

As is probably evident from past posts about twitter or identica, I am something of a Web 2.0 junkie. Over the last few years I have signed up for countless services and I am sure I have forgotten about far more of them than I actually use. And therein lies a problem. The rate innovation online of late has been extraordinary, but the result is a proliferation of services that is not sustainable. With the Global FInancial Crisis progressing outside the financial sector to the broader economy, venture capitalists will be tightening their purse-strings and this will inevitably lead to a period of consolidation in the online landscape.

Early signs of this phenomenon appeared today with announcements that the social networking site Pownce, to-do list manager I Want Sandy and virtual Post-It note site Stikkit  will all be closing down.

Twitter is a common theme behind these closures. Despite the backing of welebrity Kevin Rose and rich media sharing features, Pownce ultimately failed to grow at the same rate as twitter. When initially launched, the mystique generated by the invitation-only private beta version of the site attracted attention for a while, but interest seemed to wane after the site went public. Personally, I have been using twitter more and more and pownce less and less over the last year, but I will miss the friendly alien (pictured above) who appeared on pownce pages when something went awry. Somehow he is more endearing than twitter’s “fail whale”.

Read the rest of this entry »


Blog Comment Spam

December 1, 2008

What with buying a new house, going on holiday and now trying to sell the old house, it has been a while since my last post. Here is a quick reflection on blog comment spam to ease myself back into my blogging regimen.

Those who have never written a blog may not be away of the phenomenon of blog comment spam. The basic idea is the same as email spam: to drive traffic to websites featuring pornography, viagra or worse. Fortunately, spam filtering software works as well, if not better, for blog comment spam as it does for email spam.

Read the rest of this entry »