Posts tagged twitter

Google Buzz: a serious new fixture in the social web?

Not everyone is all that impressed by Google Buzz so far, but I am. Yes, questions are being raised about privacy – but such questions are a given in any modern discussions about social technology. And some have been quick to point out limitations in terms of interface (“I quickly found the Buzz user interface… visually uninviting“) and features (“Google Buzz: The Missing Features“) – but imperfection is inevitable when a service is only two days old.

For what it’s worth, there are things about Buzz I’d like to change. Conversations shouldn’t be treated so much like emails, for example, with “read” and “unread” states – this brings “inbox anxiety” into the equation, something Twitter was wise to discard. And users could benefit from more fine-grained control over privacy settings.

Inbox anxiety with Buzz

Inbox anxiety with Google Buzz – I'm not looking forward to having hundreds of unread "Buzzes"

But I’m happy to put these thoughts to one side: at the moment I’m more interested in the response it’s provoked among my own contacts, many of whom are tech-savvy but not really social web junkies. So far, it’s making me think that Buzz has an appeal for people who are active online but always disliked Twitter and had never heard of Friendfeed.

Buzz has definitely been a conversation-starter in a way that Wave wasn’t. In the first few hours, many posts were as you’d expect – “what is this for?”, “can anyone see this post?”, that sort of thing. Today is day two for Buzz, however, and the conversations have started to move away from these meta topics. In fact they’re slowly starting to resemble the sorts of conversations these people have in real life.

This is very different from Wave, which prompted a few discussions of the “what’s this all about?” variety before being largely abandoned even by early adopter types like myself. Obviously this might happen with Buzz as well – as I said above, today is only day two – but the acceptance trajectory so far seems very different. For example, the risk of being flooded with too much Buzz data seems much greater than that of Buzz falling into disuse.

In many ways I’m tempted to think that Wave has been a kind of public beta for Buzz. MG Seigler at TechCrunch is thinking along similar lines in this post, If Google Wave Is The Future, Google Buzz Is The Present. Buzz certainly explains why Wave had no Gmail integration, something I wondered about at the time.

Once again, it’s early days with Buzz. But my own anecdotal experiences so far make me suspect that – despite the contrary opinions of various mavens and competitors – it’s going to be a fixture in the social media landscape for some time to come.

How to post your Last.fm loved tracks to Twitter

I remember when Twitter was still quite new. Back then, a lot of people were still trying to think of uses for it and one thing that was fairly common was to plug it into your Last.fm account.

In retrospect I can see why that was seen as a good idea. Twitter was supposed to be about broadcasting minor ephemeral details, and the music you were currently listening to definitely fell into that category. But there was a downside. People listen to a lot of music and, with a Twitter post for each track played, that added up to a lot of useless information on Twitter. Thankfully, the practise of scrobbling directly to Twitter soon faded out.

Today there are some more useful and less irritating ways of posting information from Last.fm (or, indeed, its open source alternative Libre.fm to your Twitter account. One of them, Tweekly.fm, produces an automated weekly tweet of your top three artists. Another one, which I’m going to explain here, involves posting tracks that you “love” on Last.fm to your Twitter account.

Here’s how it works:

  1. If you don’t have a Last.f account, create one here
  2. Get the URL of your “Loved tracks” RSS feed. This is easy: just change “USERNAME” in the URL below for your Last.fm username.

    http://ws.audioscrobbler.com/2.0/user/USERNAME/lovedtracks.rss

  3. Test the URL by opening it in a browser. You should see something that looks a bit like this:
    Last.fm RSS feed browser output
  4. If it works, go to Twitterfeed.com and create an account if necessary
  5. Once logged in to Twitterfeed, click on the “Create new feed” button to the top-right of the screen
  6. In “Step 1: Send Feed To”, select Twitter. Click on the large “Authenticate Twitter” button and enter your Twitter account details. You’ll then be directed back to Twitterfeed.com
  7. In “Step 2: Name feed & source URL”, enter a name for the feed – this can be anything you like. In the “RSS Feed URL” field, paste the URL of your RSS feed
    Twitterfeed screenshot 1
  8. Click on the “test feed” button to make sure the feed is valid
  9. Click “Advanced settings”. A bunch of new options will appear underneath. Here’s a screenshot with the things you need to check circled in red:
    Twitterfeed's advanced settings

  10. In “Post content”, select “Title Only”. This will ensure that the posts to your Twitter account only contain the artist, title and shortened URL to the track you loved
  11. Make sure “Post link” is checked and a URL shortening service is selected
  12. You might also want to enter some text in the “Post Prefix” or “Post Suffix” fields, otherwise your tweets might be slightly baffling
  13. You’re done – just click “Create feed” and that’s it set up.

Now whenever you “love” a track on Last.fm, your Twitter account will post a link to it. This makes Last.fm’s “love” feature a bit more useful when it comes to recommending music to other people – especially people who don’t use Last.fm. And as long as you don’t love everything you listen to you won’t be clogging up your Twitter feed.

Using Google Spreadsheets to extract Twitter data

Last weekend I was looking for ways to extract Twitter search data in a structured, easily manageable format. The two APIs I was using (Twitter Search and Backtweets) were giving good results – but as a non-developer I couldn’t do much with the raw data they returned. Instead, I needed to get the data into a format like CSV or XLS.

Some extensive googling led me to this extremely useful post on Labnol, where I learnt about how to use the ImportXML function in Google Spreadsheets. Before too long I’d cracked my problem. In this post I’m going to explain how you can do it too.

Data you can extract from Twitter

This walkthrough will teach you how to extract two types of Twitter data using Google Spreadsheets – tweets and links.

Tweets are extracted using the Twitter Search API in conjunction with ImportFeed. This allows Twitter search results to be extracted into a spreadsheet format.

Links are extracted using the Backtweets API in conjunction with ImportXML. The Backtweets API allows you to find any links posted on Twitter even if they’ve been shortened using services like bit.ly or tinyurl.

I’m in a hurry, can I just do this right now?

If you just want to do it – instead of learn how to do it – just open this Google spreadsheet I’ve created.  You’ll need to make your own local copy so you can edit it. Instructions can be found in the spreadsheet itself.

How to extract tweets containing links

The instructions below will help you create a Google Spreadsheet that pulls in and displays the time, username and text of all tweets containing links to a specified page. Because it uses Backtweets, these tweets will be retrieved even if they used shortened URLs from services like bit.ly or tinyurl.

  1. Create a new spreadsheet in Google Documents.
  2. Enter column labels in this order: “Search criteria”, “Timestamp”, “Username” and “Tweet text” in cells A1 to D1.
  3. In cell B2, underneath Timestamp, insert the following formula:

    =ImportXML(“http://backtweets.com/search.xml?itemsperpage=100&since_id=1255588696&key=key&q=”&A2,”//tweet_created_at”)

  4. In cell C2, underneath Username, insert the following formula:

    =ImportXML(“http://backtweets.com/search.xml?itemsperpage=100&since_id=1255588696&key=key&q=”&A2,”//tweet_from_user”)

  5. In cell D2, underneath Tweet Text, insert the following formula:

    =ImportXML(“http://backtweets.com/search.xml?itemsperpage=100&since_id=1255588696&key=key&q=”&A2,”//tweet_text”)

  6. Now paste a search query into cell A2 – say, http://www.google.com. After a few seconds, you should see columns B, C and D fill up with tweets, looking something like the image below:
  7. Google Spreadsheet showing Backtweets results

  8. The formulas pasted into cells B2, C2 and D2 all reference the URL in cell A2. This means that whenever you paste anything new into A2, the search results should refresh.
  9. Also, you can paste parts of URLs into A2 – not just entire ones. This is useful for seeing all links to a specific directory on your site, for example.

Finally, this tool can only extract 100 results at a time – but it is possible to set it up to retrieve more than that. Look at my sample Google Spreadsheet if you want to do this.

Extracting tweets from Twitter search results

The method for doing this is identical to the above, but uses the ImportFeed function instead of ImportXML.

  1. Create a new spreadsheet in Google Documents.
  2. Enter column labels in this order: “Search criteria”, “Timestamp”, “Username” and “Tweet text”. For the rest of this walkthrough, I’m going to assume that these labels are in cells A1 to D1, but in reality you can put them wherever you like
  3. In cell B2, underneath Timestamp, insert the following formula:

    =ImportFeed(“http://search.twitter.com/search.atom?rpp=20&page=1&q=”&A2, “items created”)

  4. In cell C2, underneath Username, insert the following formula:

    =ImportFeed(“http://search.twitter.com/search.atom?rpp=20&page=1&q=”&A2, “items author”)

  5. In cell D2, underneath Tweet Text, insert the following formula:

    =ImportFeed(“http://search.twitter.com/search.atom?rpp=20&page=1&q=”&A2, “items title”)

  6. Type a search query into cell A2 – say, “Hoth.” Hit enter and the results will load. It should look something like this:
  7. Google Spreadsheets with data from Twitter searchThings will go wrong if you insert characters like # or @ into the search query. To get around this, type %23 instead of # and %40 instead of @. This will allow you to search for hash tags and usernames.

I haven’t been successful in generating more than 20 search results per request, but you can get around this using the page number parameter in the ImportFeed query string. See my own Google spreadsheet to find out how to do this.

I hope these instructions are useful – if you have any comments, questions or feedback, please let me know in the comments.

Charging companies for Twitter – what could it involve?

You’re probably aware that Biz Stone, one of Twitter’s co-founders, told Marketing magazine on February 10th that:

“We are noticing more companies using Twitter and individuals following them. We can identify ways to make this experience even more valuable and charge for commercial accounts”

How to decode this quote? It’s fairly vague, but I can think of a few possible charging models that Twitter might adopt. I’ve listed three of them here:


1) “Twitter tax”

Twitter will try to identify accounts that are run by companies rather than individuals. It will then attempt to extract money from the owners of these accounts. Failure to pay will result in closure of the account.

I don’t think this is very likely, however:

  • Distinguishing companies from individuals would be extremely difficult. A lot of anger come from those who felt they’d been unfairly classified (e.g. if you’re a consultant and you discuss professional topics on Twitter, are you a “company”?)
  • No value would be added for those who pay
  • A lot of genuinely handy and non-revenue-generating information services would vanish from Twitter, diminishing the value of Twitter as an information utility
  • This diminishing of Twitter’s usefulness would lead many people to desert the service.

2) “Singling out the marketers”

Like the first option, Twitter will identify accounts that are run by companies. However, it will draw a line between companies that use it for information services and those who use it as a sales channel. Companies who use it as a sales channel will be penalised while those who use it for information services will not.

This is a bit more viable than option 1:

  • Distinguishing sales from servicing would be easier than distinguishing companies from individuals. Rules could be defined, e.g. if you are seen to link to product pages or talk about offers or sales then you’ll be penalised
  • It would allow services that people find useful to continue – e.g. getting news updates from the BBC
  • It would encourage companies to use the service in an “ethical” way while heavily penalising spammers
  • As a result, there would be a lower risk of people leaving the service.

3) “The enhanced service”

Twitter will not try to distinguish companies from individuals. However, it will create an “enhanced” account which will provide additional features at a cost. Companies will be free to keep using the “basic” service if they want to.

This is the most likely option, I’d say:

  • The challenge would be to come up with features that would make a paid account compelling
  • These could include things like offering brand protection (the account is marked as ‘official’), ecommerce features (people being able to pay over Twitter), advanced analytics (see reports on your followers and their behaviour etc), tracking abilities (find out how many people clicked the link in the last message you sent, etc)…
  • This would add value for people who chose to pay
  • There would be no need on Twitter’s part to pay people to detect and penalise companies
  • Things like news feeds and so on would continue to operate, meaning that the usefulness of Twitter wouldn’t be too diminished.

Most of the commentary I’ve read so far seems to assume that something akin to the first option, the “Twitter tax”, would be introduced. But Twitter surely realise that it would be costly to implement and would seriously impact their growth rate. An enhanced service for which companies or individuals could pay is far more likely.

In particular, keep an eye out for commerce features. Pay-by-Twitter might seem far-fetched at the moment but as the service becomes ever more pervasive a compelling user need for that service will begin to emerge.

Another Twitter visualisation

I promise I’ll stop posting links to these one day. Anyway, this is from a series of Superbowl-related interactive visualisations produced by the New York Times:

Screenshot of NYT Twitter visualisation

Unlike the visualisation of #inauguration posts I linked to recently, this isn’t based on hash tags but instead uses moving tag clouds to illustrate the volume of Twitter posts on various subjects during the Super Bowl.

Examples include “Cardinals vs Steelers” (I know the Steelers are from Pittsburgh but from this animation I’d guess the Cardinals are from… Las Vegas? San Diego?), “talking about ads” (it’s vaguely depressing to see how much conversation the ads inspire) and player names (a guy called Fitzgerald obviously does something notable in the fourth quarter).

This is maybe the most effective use of Twitter data I’ve seen so far, as it is centred around a single event but tracks various subjects of conversation related to that event. A far simpler and less interesting animation would have simply flagged every post with the hash tag #superbowl.

Presidential inauguration – Twitter visualisation

This animated map from FlowingData shows the global location of each Twitter post tagged as #inauguration between Monday and Wednesday this week.

Twitter visualisation from FlowingData

Although the world map isn’t shown, over time the US and the UK become almost perfectly defined by the density of Twitter post markers. You can also see outlines of south America and western Europe.

http://projects.flowingdata.com/inauguration/

The big flurry happens when the US wakes up on Tuesday morning…

Brands that suck on Twitter

Here in the UK, Twitter has yet to seriously catch on although many organisations are attempting to make use of it. But the marketing and communications departments of large US companies are becoming increasingly aware of the need to establish a brand presence in Twitter.

The case of Janet, who masqueraded as an ExxonMobil spokesperson on Twitter before being unmasked as a fraud, demonsrates how even doing nothing can be damaging. Your brand can get hijacked and dragged through the mud while you’re busy formulating your micro-blogging communications strategy.

Here’s a list of brands that suck on, or simply don’t get, Twitter. It’s an evolving list – Starbucks, for example, got removed after responding to the blog post, showing that their Twitter account wasn’t merely “parked”.

Better commentary than my own can be found at Jeremiah Owyang’s web strategy blog.

My picks from “On the Bus”

I posted recently about Tweets on the bus, a little site that aggregates all Twitter posts containing the phrase “on the bus”.

Since that post, I’ve been following the “on the bus” posts using Google Reader. Every now and again there’s one that makes me laugh. Here’s a digest of my favourite “on the bus” tweets from the last few weeks:

Tweeting on the bus

Earlier this afternoon, as I was passing Angel station on a bus, I posted to Twitter. I’ve subsequently discovered my ‘tweet’ turning up at this site – Tweets on the bus.

The concept is simple – it collects Twitter posts containing the term “on the bus”, and presents them all on one web page. It’s got an RSS feed, and provides automatic links to possibly related tweets.

OK, so it’s not going to change the world. But if you’re as keen an observer of the banal as I am, it’s as good an answer as any to the important question of what’s currently on the minds of random strangers on the bus.

Wealth of Networks – a semi-account

Yesterday I went along to the Wealth of Networks conference at Imperial College. I was only able to attend the morning sessions, but it was a valuable chance to hear the thoughts of various individuals with diverse backgrounds but a shared understanding of the power of networks (in the broader sense of the word).

The Twitter Experiment

One of the things that I was planning on doing at the conference was to have a go at using Twitter as a means of realtime communication with other attendees, so I used my phone’s browser to run a Twitter Search for the event’s hash tag. I saw a tweet from someone else who was wondering if he’d “still be awake by 10am” and felt a bit excited at the idea of sharing a ‘back-channel’ of conversation during the sessions.

As it turned out, however, there was some confusion around the hash tags. Most people turned out to have been using #wealthofnetworks rather than the #won tag listed in an email I’d received the day before. Also, I didn’t charge my phone adequately and it died within a couple of hours. Still, I think I’ve got a good understanding of how Twitter can make these sorts of events much more useful from a networking point of view, and I’m looking forward to my next chance to try it out in real time.

John Varney’s Keynote Address

John Varney was formerly Chief Technology Officer at the BBC and now runs Maximum Clarity, a consultancy. The earlier part of his talk set out to contextualise recent developments in social media & networks by looking at five key figures who have played a part in their development:

  • David Sarnoff – Founder of NBC, saw television’s potential as a community medium
  • Gordon Moore – Co-founder of Intel, laid foundations for the evolution of the devices we use today
  • Bob Metcalfe – Inventor of Ethernet, founder of 3Com
  • David Reed – Forecast the exponential scalability and utility of social and computer networks (Reed’s Law
  • Ross Mayfield – cited as the ‘father of the social network’ in the modern sense of the term

Having given an overview of where we are, he then outlined where he felt we were going. Referencing Yoklai Benker’s book, “The Wealth of Networks” (from which the conference took its name), Varney argued that the wealth-creating potential of networks was now being realised to a significant extent. Benkler had identified three manifestations of the wealth of networks:

  • Social Wealth – for example, Facebook (I’m a bit of a Facebook cynic myself but was hardly going to argue with its prevalence)
  • Monetary Wealth – for example, eBay
  • Creative Wealth – for example, Metacafé (Varney said that he’d considered listing Youtube as the example, but doesn’t really like it)

Also, we’re currently moving towards a state of ‘information symmetry’, in which powerful, monolithic arbiters of information (he heavily implied that the BBC could be thought of as one of these) are seeing their influence subside as individuals start becoming sources in their own right.
The examples Varney cited to illustrate this principle were September 11th 2001 attacks in the US, the 2004 Boxing Day Tsunami and the 7th July 2005 tube bombings in London.

  • September 11th – this event was covered by the broadcast networks, who were on the scene immediately and were the main source of information (although you could go into more detail here about how forums and mailing lists on the internet became a crucial news source as the BBC, Sky and CNN websites crashed under the strain…)
  • The Asian Tsunami – the broadcast networks weren’t there and didn’t arrive until two days later. The event was covered by people who were at the scene, but these people handed their footage to the networks and relied on them to disseminate it
  • 7th July – in this case, the people who took pictures and filmed video at the scene also published their material themselves via sites like Flickr and Youtube, demonstrating the obsolescence of the broadcast media.

So given the above observations about wealth-generation and information symmetry, Varney concluded his talk with a number of assertions, among which were:

  • The death of the organisation and rise of the ‘collaboration’ – in a few years we won’t be talking about organisations but instead about more fluid and diffuse ‘collaborations’ (he intentionally used the word as a noun). This will require a “new breed” of management and leadership (I wanted to ask more about this but there wasn’t time)
  • Open source innovation – not limited to software development. Through being open to ideas from people outside one’s organisation or discipline, utilising the power of one’s networks, genuine innovation becomes easier
  • Computing-free enterprise – “if your company still has an IT department by 2015, you’re in trouble.” Cloud computing will cause companies to abandon their own technology infrastructure and move to remotely-served
    applications
    .

Panel Discussion Moderated by Gareth Mitchell

After a 20-minute break a large panel assembled for the second session, a panel discussion moderated by Gareth Mitchell (lecturer at Imperial as well as presenter of the BBC’s Digital Planet). It’s worth noting here that I heard about this event via a Twitter post from Gareth, which may or may not be of interest to the event’s organisers!

File-sharing in the UK

The first subject under discussion was the morning’s story on file-sharing. In short, ISPs are going to send nasty letters to people who use P2P file-sharing applications. A straw poll of the panel & audience revealed that the vast majority of those present used these tools, and the whole initiative was treated with some levity.

The discussion focused on record labels and their flawed business models, the consensus being that these, rather than rampant criminality, were the real root of the problem. I furrowed my brow at the idea that Led Zeppelin or Bob Dylan could be thought of as being in the “long tail”, and wrote in my notebook, “do these people know how long that tail really is???”. To be fair though I’m an embittered ex-owner of a tiny independent record label so have a bit of a skewed perspective on what music can be seen as obscure…

One attendee with a Canadian accent mentioned Live Nation’s deal with Madonna and their focus on music at the point of consumption – specifically, concerts – rather than on ownership. Would this model trickle along the “tail” to the point that lesser-known artists would make money this way?

The panel broadly thought so, but I didn’t – I feel that physical events will remain the domain of either very large or intensely localised acts, and the most interesting thing the internet has done for music has been to decouple fan-bases from geography. You need a critical mass of fans in a certain area to be able to make money through performance, and if your music appeals to people with more specialised tastes, this will always be elusive.

Internet Blackout

The second topic was one of “internet blackout” and how the UK would cope with it. One question was, is there a commercial motive for ISPs and telcos to continually upgrade their infrastructure to accomodate the constantly-rising demand? In short – there is, and previous predictions of internet meltdown have come to nothing. John Varney noted that newspapers in particular tend to pick up on these stories as they’re innately attracted to the idea of the internet going away. It’s going to happen though.

I wanted to ask about a more realistic “internet blackout” scenario than global meltdown, namely the suspected Russian attack on Estonia’s internet infrastructure in 2007. Events like that are likely to become more common in the future, and if botnets continue to grow in size it won’t just be states that are behind them – however, a lot of people raised their arms before I got a chance to pipe up.

Net Neutrality

The final topic was net neutrality and the question of whether or not multiple tiers of internet access were emerging. This issue is a very complex one and the panel didn’t have too much time to discuss it in real detail – one interesting question that came up, however, was Nick Leon’s assertion that ISPs should look for ways to provide additonal services to their customers and avoid being ‘dumb pipe carriers’, destined to suffer as US telcos had done in the 1990s.

John Varney seemed to disagree with this view, though, and so do I – surely that’s AOL’s model? There may be a market for that sort of ISP but I feel that consumers have largley become able to navigate the open internet without difficulty, and are therefore unlikely to be attracted back to the “walled garden” regardless of how much proprietary content is offered to them. You never know though.

In Summary

I’d like to have been able to stay for the afternoon and join in one of the breakout panels, but as one of the few wage-slaves in attendance (in a show-of-hands most attendees identified themselves as scientists or entrepeneurs) I had to head back to the office. It was annoying that I’d forgotten to charge my phone too, as it would have been good to carry on the Twitter experiment a bit further and see if I could seek out the flesh-forms of people who’d been tweeting.