SEEK

SUPR-Q 2: SUPR-Q Harder

SUPR-Q 2: SUPR-Q Harder

At SEEK we’ve been experimenting with the SUPR-Q. We had a few hypotheses from our first study that we’ve explored through our second SUPR-Q Study. These are:

  1. Tool limitations may negatively impact scores 

  2. Drop off could be addressed by improving the survey design

  3. Even with addressing 1) and 2) the NPS would likely still be lower when measured as part of the SUPR-Q than an individual NPS rating, and skew towards aesthetic feedback given the questions asked.

Understanding how the SUPR-Q impacts the NPS

Understanding how the SUPR-Q impacts the NPS

At SEEK we’ve been experimenting with the SUPR-Q. We first ran it as part of a usability test in face to face research (n=5) to trial, and then went full scale using an on site Hotjar poll (n=1,811) to get a more representative sample for our first benchmark.  The SUPR-Q (Standardized User Experience Percentile Rank Questionnaire) is an 8 item questionnaire developed by MeasuringU that is used to measure the quality of the user experience. What actually impacts users likelihood to recommend?

Ghost Buttons — Not as bad as we thought? 

Ghost Buttons — Not as bad as we thought? 

Are ghost buttons really as bad as they've been made out to be? Ghost buttons are often touted as low-affordance, and it’s true of many of the examples we see  — buttons with poor contrast placed over images making them difficult to use and confounds A/B tests. We say we are comparing ghost buttons and ‘normal’ buttons but we are really testing accessible vs inaccessible buttons, high vs low contrast designs, high affordance vs low affordance designs (and it’s not a surprise that ghost buttons lose). What happens when we test an accessible ghost button against an accessible solid button?

Online & Search Behaviours of Blind Users

Online & Search Behaviours of Blind Users

We often make assumptions about blind users, however blind users are not homogenous. They differ as much as sighted users in terms of technical ability and search strategies. Just as not every sighted person is tech savvy, not every blind person knows how to use a screen reader well, or utilizes all the power features. This literature review explains the online and search behaviours of blind individuals

Press the pink button — Designing for colour blind users

Press the pink button — Designing for colour blind users

We use colour as a signifier for people, places and things all the time. Probably more than you realise. About 8% of Australian males and 0.4% of females are colour blind.  Like all people with ‘disabilities’, there are certain things colour blind people can’t do. Design can help make the world more accessible to ensure they can do everything those with ‘normal’ vision can. I explore ways to deign for colour blind users, which often improves the experience for everyone. 

Does the NPS tell us what users really mean?

We’ve trained users with the five or seven point Likert scale survey questions, where the middle point means “neither likely nor unlikely”. Yet on the NPS a 5 does not mean "neither" it means the users is a detractor. Does the NPS tell us what users really mean?