Category Archives: UX

UX Cambridge: Caroline Jarrett, How to find out about the usability of your website using a survey

Caroline Jarrett is a usability consultant. She tweets at @cjforms.

  • Recommended book: Letting Go of the Words by Ginny Redish
  • “Can a usability test just use a questionnaire, no observation?” (Audience: you need to see what they do, not just what they say; observation gives us context, avoids bias)
  • Surveys have inherent bias – people will say what they think you want to hear
  • It’s not a usability test unless it’s got some observation in it
  • The more interesting question is: Can we use surveys to assess usability of our websites?
  • Survey data can aid by triangulating between survey data and data from elsewhere (e.g. user testing)
  • Surveys can assess: effectiveness at task completion; satisfaction; demographics (stuff that can’t be tracked with analytics)
  • What is “the product” that we are assessing? Is it the website, a section, a page?
  • Net Promoter Score (NPS) — “Would you recommend us to a friend” — expands ‘the product’ up a level to be ‘the brand’, but can be horribly muddied if you try to fudge the question
  • Survey Tip: Ask one question at a time
  • Best thing you can do with surveys is looking at goals: “what did you come to this website to do today?”
  • Survey Tip: Find out about users’ goals
  • There are other goals to consider: What the organisation wants to achieve, What are our aims in doing a survey
  • Establish your goals for the survey (what are the questions you need answers to)
  • Types of survey goals: Exploratory (don’t know what is out there, so we send and hope or use a website popup. If you don’t know anything, any answers are better than no answers, as long as you don’t try using them as descriptive statistics with them); Comparative (explore trends, compare before and after – great for looking at trends, but you have to use the same questions every time, therefore you have to get the questions right first time); Descriptive (you know what is out there, go and count them — e.g. national census — got to do this properly with balanced sampling to avoid bias and measuring error); Modelling (find factors that show cause and effect – you’re seeing behaviours, trying to find out why)
  • You can combine types of survey – e.g. cohort studies use comparative, descriptive and modelling together
  • Examples of poor survey questions: poor defaults, double questions (two questions stuffed into one), options that we should already know the answer to via tracking, use of jargon, grid of radio buttons (contributes to user dropout)
  • Bad surveys can have a negative effect on brand
  • Survey Tip: Interview first (talk to your users – good surveys always start with interviews, so you can understand how people want to respond to your questions)
  • Survey Tip: A successful survey is a process that involves loads of testing

UX Cambridge: Richard Caddick, The Power of the Imagination

Richard Caddick is a founder of Bristol’s CX Partners, and author of Communicating the User Experience. He tweets at @richardcaddick.

  • Don’t focus on the idea, but the process of imagination/problem solving
  • Imagination can be thought of as a Venn diagram: What has been, What is, What could be — in UX, this maps to Insight, Empathy, Creativity
  • Creativity. Compare Turner’s paintings from the start and end of his life; what happened in between to change him? He was apprenticed (learned from experts), thought about colour theory, using new technology (new colours became available, tubes of paint were invented), travelled (UK, Italy, France, Switzerland) to learn about differences in light/location, produced over 19,000 works.
  • The baker Christina Tosi: started with lots of experimentation and lack of constraints.
  • Showed a picture by Felix Baumgartner aged 5 of himself falling from the sky; he had a focus, having a vision is powerful.
  • Becoming imaginative isn’t passive, it’s something we can consciously do. We can practice what we do to build up our skills. Teaching helps us learn how to communicate our ideas to other people. Observation shows us what is going on in the world/people around me. The ability to Experiment/prototype; asking questions/debating and reflection – what can i learn from what i’ve done so far. Vision – know the direction in which you are heading.
  • Insight + Empathy = Deep understanding, which comes from better research. It’s very easy to get into the habit of doing a little bit of regular research, which then just sits there. You’re not getting any value or understanding out of research.
  • is a project investigating how we can keep the elderly population more active/mobile in their own environment. Involves a robot that interacts with a person. Researchers used disposable cameras, 2 per person, with a sad and happy face drawn on them. Users were asked to use the cameras to take photos of things that made them happy or sad. These photos (and the explanations behind them) increased designers’ empathy towards their users. Interviews are important to reduce assumptions about users’ feelings.
  • How about our own experiences? Richard talks about having testicular cancer. Moved from basic empathy to deep understanding of what it feels like to have that kind of illness. Sometimes we forget users in research have multi-faceted lives. Imagination draws on your own experiences to heighten feelings of empathy and decisions you make.
  • As designers we create and think we can solve problems.
  • Arthur Fry worked for 3M and sang in his church choir, but he often lost his place in his hymn book. He wanted to invent something to keep his place, and the Post-It note was born.
  • As humans we have the incredible ability to feel for people we don’t know. Need our stakeholders to have empathy for their users. Case study: a local council site with problems. It would have been easy to just make the buttons and text clearer; instead used empathy mapping techniques to go through planning application process. Natural empathy makes people build more detailed picture of user than just listing facts.
  • In the 90s, a virtual reality experience was used to give doctors an experience to encourage empathy for patients suffering from fatigue. 60% of doctors said they would change how they would treat their patients.
  • What about our projects? Treat projects as several periods of open imagination closing in on solutions/answers. Consider the dynamics of projects, the context/level of detail, and activities to stimulate creativity.
  • Someone to encourage, someone to challenge – we need people that fulfil these roles for us.
  • Constraints vs freedom. As designers, constraints are more useful – they make us more innovative (e.g. car design has improved within the constraints of legislation around emissions).
  • New and familiar – the temptation is to be really creative, but sometimes customers need familiarity. You need both.
  • Play. The people we are designing for are also imaginative and playful people. They want freedom. If we try to constrain people when they’re in their decision-making process (when all the things affecting their decision are jumbled up as if in a washing machine) it feels unnatural.  There is a massive experience gap between what people are trying to do and what technology is letting them do. Computation doesn’t fit with people’s imagination/individuality. We want people to think and imagine.
  • An example of a dull product put across in imaginative way: an old Union Carbide ad.
  • User research involving mobile devices gets much better/truer responses when users can use their own device instead of being given one.
  • Book recommendation: Computers as Theatre by Brenda Laurel
  • Story of the invention of the Brooks bike saddle. John Brooks was a leather manufacturer. His horse died, he couldn’t afford a new one, so he borrowed a friend’s bicycle, which back then didn’t have saddles (instead they had wooden planks). So Brooks patented the leather bike saddle. Bike saddles are interesting technology, because they get better with time (becoming more comfortable). How can we create stuff like this?
  • “Be yourself, everyone else is already taken.” – Oscar Wilde

Sketchnotes of the session by Jenny Willatt:

Sketchnote of Richard Caddick talk at UX Cambridge 2012