1. How The Wire can help you be a better design researcher

    Posted May 22, 2015 in research, user centred design  |  No Comments so far

    I liked this post on Medium by Sam Ladner about how design researchers need to think fast and slow. If you work in design or UX or whatever, you should read it.

    Taken from the Medium article

    Taken from the Medium article

     

    The general gist is that problems can be approached with two different styles of thinking: “fast” thinking, in which the components of an idea are allowed to form in rapid succession without being challenged or tested too much, and “slow” thinking, where the opposite rule applies and ideas come into being via a more rigorous and methodical process. Design research will be more successful if you combine both ways of thinking, says the article, before going on to explain at what stages in a design process “fast” or “slow” thinking would be most appropriate.

    When I read the piece, however, I found myself thinking of The Wire (as I often do) and specifically a scene where Baltimore detective Kima Greggs arrives at her first murder scene with her partner, Bunk Moreland. Here’s the discussion they have about “soft eyes”.

    Bunk: You know what you need at a crime scene?
    Kima: Rubber gloves?
    Bunk: Soft eyes.
    Kima: Like I’m suppose to cry and shit?
    Bunk: If you got soft eyes, you can see the whole thing. If you got hard eyes — you staring at the same tree missing the forest.
    Kima: Ah, zen shit.
    Bunk: Soft eyes, grasshopper.

    Kima and Bunk

    When I’ve approached design research projects in the past I’ve often thought about them in terms of “soft eyes” and “hard eyes”. There are various points along the way where you need to defocus—take a step back from everything you’ve put up on the wall or into your spreadsheets, stop yourself from staring at individual data points or considering specific questions, and allow the whole thing, everything you’ve learned or accumulated, just permeate your consciousness. Then you’re more likely to grasp overarching themes and patterns, those elusive things that lurk behind the data. This is how I interpret “soft eyes”.

    “Hard eyes”, on the other hand, are needed at other times: when you do need to solve a very specific problem, to optimise something in your design, to understand why something isn’t working. This is when you step forward to focus on individual data points and questions, or apply checklists or other pre-defined analytical processes to solve your problem.

    Knowing when you need “soft eyes” and when you need “hard eyes” is important. You can’t get by with one and not the other. And I think this applies just as much to “fast” versus “slow” thinking, as defined in the Medium post.

    Postscript: Quora has a thread about Bunk and Kima’s “soft eyes” discussion if you want to read other people’s thoughts about what it means


  2. Google launches Google Correlate, a new tool to support search trend analysis

    Posted May 25, 2011 in research  |  1 Comment so far

    Yesterday I wrote about this Twitter-based hedge fund, and connected it to the broader area of large-scale online analytics being used to anticipate real-world events. And today Google has announced a new tool, Google Correlate, which has been built to do just that.

    When I was dabbling in this area with search data and unemployment statistics I was using Google Insights, which made the process pretty long-winded – it produced a lot of messy data which only became useful after a few hours of macro-writing in Excel. So it was encouraging to read, in Google’s official post about Correlate, that:

    [T]ools… such as Google Trends or Google Insights for Search weren’t designed with this type of research in mind. Those systems allow you to enter a search term and see the trend; but researchers told us they want to enter the trend of some real world activity and see which search terms best match that trend… This is now possible with Google Correlate, which we’re launching today on Google Labs.

    I’m looking forward to giving Google Correlate a try, from what I’ve read it seems like it still only represents the tip of a very big iceberg, a glimpse through a keyhole into a big world of data that only Google is allowed to explore. Hopefully I’m wrong and it does go deeper than that though. I’ll post more about it when I’ve had a chance to look around…


  3. UK unemployment drops… unexpectedly?

    Posted January 21, 2010 in research, strategy  |  No Comments so far

    The UK Office for National Statistics announced yesterday that unemployment had dropped for the first time in 18 months. BBC News reported this as a “surprise”:

    The number of people unemployed in the UK has fallen unexpectedly for the first time in 18 months… George Buckley [of Deutsche Bank] admitted previous predictions of the unemployment rate reaching 10% now looked unrealistic… [The figures] came as a surprise to many analysts.

    But to regular readers of this blog, this news is anything but unexpected: in December 2009, my analysis of unemployment-related search trends clearly indicated that the unemployment rate was about to fall.

    So could this be an example of search trends providing early insight into economic data? Possibly, but it’s only one month’s figures we’re talking about. A sustained track record of successful projection is needed to demonstrate that search analysis can yield valuable insights.

    Over 2010 I’ll be keeping an eye on the data to see what happens. In the meantime, if you can think of other real-world metrics that might be suitable subjects for search trends analysis, get in touch.


  4. Can search predict the future?

    Posted December 23, 2009 in research, strategy  |  2 Comments so far

    Today, we often  search for information about upcoming major events in our lives – both good and bad – before we experience them. When facing financial difficulty or unemployment, many of us will go online at the earliest opportunity to look for help and guidance. And when we’re considering major financial decisions such as buying a house, search engines are usually consulted before estate agents are called.

    Traditional economic reports, on the other hand, look at events that have taken place. Unemployment figures tell us how many people are claiming benefits rather than how many people have been put at risk of redundancy. Average house prices are based on completed transactions, not how many people are currently looking to buy. So while we can be fairly confident of these reports, they don’t provide us with particularly current insights.

    This trade-off between confidence and currency was, in the past, largely academic as analysing current data was almost impossible. But in the age of the real-time web, this might be about to change: maybe patterns in search behaviour can give us a glimpse of future patterns in the economy.

    We first became interested in this topic back in spring 2009, so we analysed search patterns for two sets of keywords as the UK economy went into recession. We looked for relationships between these search patterns and related economic indicators, and listed some tentative predictions based on what we observed.

    House prices

    In April 2009, we looked at volumes for 23 keywords that homebuyers might use, including buying a home, cheap mortgage and mortgage providers. UK search volumes for these keywords were then compared to house prices.

    House prices charted against search volumes for 23 related keywords, from January 2004 to April 2009. Sources: Nationwide, Google Insights

    Searches typically decline as autumn ends before rebounding in January. But in 2008, the January rebound was lacklustre and the decline came in spring – much earlier than usual. This was in line with house prices, which peaked in late 2007 and dropped severely from spring 2008.

    In the first few months of 2009, however, search volumes enjoyed a far stronger January rebound than in the previous year – so we hypothesised that house prices would bottom out or even start to rise again in the middle of 2009. Let’s look at how accurate that hypothesis turned out to be.

    House price data to the present

    House prices charted against search volumes for 23 related keywords, from January 2004 to December 2009 Sources: Nationwide, Google Insights

    Sure enough, the search volume resurgence was accompanied by house price growth throughout 2009. But you’ll notice that search volumes soon tapered off, with a particularly steep fall after August. Our revised hypothesis, then, is that house prices will initially plateau and then drop again. We’ll revisit the statistics in spring 2010 to see how things turn out.

    Financial difficulties

    The second set of keywords we analysed was related to impending financial difficulties such as joblessness, debt and insolvency. They included signing on, mortgage arrears and debt problems, and were compared to the UK jobless rate.

    Financial problems searches versus unemployment

    UK unemployment rate charted against search volumes for 24 related keywords, from January 2004 to April 2009 Sources: Office for National Statistics, Google Insights

    These search volumes dip at the end of each year before rising in January – and the rise in early 2008 was more pronounced than in previous years. The jobless rate started climbing three months later, suggesting that in this case search patterns might anticipate economic statistics. We observed that search volumes had dropped significantly in the first few months of 2009, so our hypothesis was that the jobless rate would stabilise but not drop between April and July. The chart below shows what actually happened.

    Financial difficulties searches versus unemployment, until now

    UK unemployment rate charted against search volumes for 24 related keywords, from January 2004 to April 2009 Sources: Office for National Statistics, Google Insights

    The unemployment rate has indeed stabilised, wavering between 7.7% and 7.8% since early June, suggesting that our original hypothesis was valid. And search volumes have kept on dropping throughout 2009. If search trends do anticipate economic reports in this case, we should see the unemployment rate drop steadily between now and spring 2010. Again, we’ll revisit these figures in April to see if this happens.

    Conclusion

    Our hypotheses from April 2009 were largely borne out as the year progressed: the drop in house prices was reversed and unemployment rates stabilised. So maybe there is some truth to the notion that search patterns can shed some light on forthcoming economic change.

    But these hypotheses were in tune with the economic mood of the time. Many commentators were talking about green shoots and a V-shaped recession – there was a feeling that recovery was just around the corner. Today, we remain in what has become the longest-running recession in recorded history and there is considerable uncertainty about what 2010 will bring.

    Our new hypotheses are less likely to be tainted by current economic consensus, precisely because no real consensus seems to exist right now. For this reason, the idea of search predicting the future will be seriously tested as the year unfolds. Don’t forget to come back in April 2010 to see the results for yourself.


  5. Online behaviour and the economic downturn

    Posted October 1, 2008 in research, strategy  |  No Comments so far

    Online intelligence service Hitwise released a report last week claiming that UK internet usage patterns were changing in response to the current economic situation. The full press release is here.

    Hitwise gathers its data by looking at the traffic logs of its clients’ websites, which number around 1,500. These websites are divided up into a range of categories and sub-categories. Hitwise is therefore aware of traffic volumes to sites in different categories, and has attempted to draw conclusions from changing patterns in these.

    This methodology may be imperfect—1,500 websites may sound like a lot but is just a drop in the ocean—but the findings seem to be intuitively correct. For around a year now the subject of how a slowdown would affect online behaviour has been coming up more and more frequently, and the general consensus has been that online retail and price comparison sites are not going to be as exposed to the effects of a drop in consumer spending. Smaller household budgets lead to an increase in price-sensitivity, and price-sensitive consumers spend more time researching and planning purchases as opposed to buying on impulse.

    An example of this in the Hitwise research is that traffic to what it identifies as price comparison, voucher or cashback sites increased by 20% between July 2007 and July 2008, after a slight drop in traffic to such sites between 2005 and 2007. Voucher sites seem to be the biggest beneficiaries (to the uninitiated, voucher sites collate promotional codes & vouchers from various retailers, which can be redeemed at checkout for discounts – here’s an example).

    However, another contributor to this trend could also be quite simply that British people have become, on average, more sophisticated online shoppers. It’ll be interesting to look at how traffic to voucher and price comparison sites bears up when the growth phase of the next business cycle begins. Will those sites become the online equivalents of Poundstretcher, shunned by all but the most price-sensitive? Or will they remain the first port of call for the clued-up online shopper?


  6. The dregs of e-commerce

    Posted September 26, 2008 in research, web  |  1 Comment so far

    http://www.eioclothing.com/mens/t-shirts/till-death-do-us-party-white.htmlI’m currently carrying out some research into open-source e-commerce platforms. The research is at a pretty early stage and I’m still putting together the list of packages that we’ll then go on to assess in detail.

    While putting this short-list together I’m visiting quite a lot of ‘showcase’ sites for each package on my long-list. And sheesh, some of them are bad.

    I don’t mean “bad” in the sense of bad user experience design, even though it’s fair to say that many of them are guilty of that. I mean “bad” in that the products themselves are bad, some of them really bad.

    It’s a consequence, I suppose, of the barriers to entry for e-commerce being so low these days. In fact, my preliminary exploration of open source e-commerce options has established that they’re even lower than I’d assumed them to be.

    http://www.weirdo.com.au/media/catalog/product/cache/1/small_image/228x228/5e06319eda06f020e43594a9c230972d/W/e/Weirdo-T-Shirt-First-Rule-of-Kite-Club-Design_1.png

    For example, I’ve come across an Australian site that sells t-shirts saying “The first rule about Kite Club is never talk about Kite Club”. Erk. It reminds me of a t-shirt I saw in Paris once, which I still think of as the worst t-shirt I’ve ever seen. It said, “the first rule about computer club is that you don’t talk about computer club”.

    But aside from bad t-shirt slogans, of which there are plenty, the biggest culprits are the numerous arts’n’crafts retailers.

    Before the internet, a lot of this stuff – the results of amateur pottery classes and the like – would have just been given to relatives or left to accumulate in cupboards and boxes. But now, the arguments against creating an online retail site for these efforts get weaker all the time as e-commerce gets easier. And it seems as though there’s a market out there for a lot of this twee, throwaway kind of stuff. That’s the “long tail” for you, I guess!

    However critical I might sound in this post, though, I should point out that I’m not advocating the eradication of such sites from the internet. I’m just noting my vague fascination with this underbelly of online retail that I hadn’t really explored until today.


  7. Word clouds and silver linings

    Posted July 14, 2008 in projects, research  |  No Comments so far

    Recently I carried out some user testing on a late-beta website. At the end of each test session, participants were given a piece of paper listing over 100 adjectives – both positive and negative – and asked to tick the ones most applicable to the website they’d been using.

    As the week of testing came to a close, it was possible to flick through the responses and get a sense of what adjectives were the most popular. However, it was less easy to convey this to the client in summary form.

    Of the 100 options available, just over 30 had been chosen by at least one participant, meaning that rendering the results of the survey as a bar or pie chart would be at best inelegant and at worst unintelligible. And I couldn’t chop the least popular choices just to present a simple overview, as this would skew the data and paint an artificially positive picture of how the participants had responded to the site.

    In the end I drew the results of the survey using a “word cloud” model. If you’ve used, well, the internet in the last couple of years you’ll have seen these (although the term itself may not be so familiar!). Each adjective that had been chosen at least once was displayed in the ‘cloud’, and its text size was determined by how many participants had chosen it. This meant that the most popular options stood out clearly and the less popular options, although less visible, were still legible if the diagram was studied closely.

    The resulting cloud met with a positive reception when presented to the client and helped to provide a quick and effective summary of the test sessions, especially useful for people in senior management who didn’t have time to go through the detailed analysis of the tests.

    Although I used Visio to create the cloud, there are a number of tools online that can be used to quickly generate word clouds of your own. Wordle, at http://www.wordle.com, is the one I’d most recommend.

    I’m not convinced that they’re always useful but you never know when you’ll end up in a situation where a word cloud might come in handy.