Tags Posts tagged with "Interview"


0 64

Interview with Dave Garr, Co-founder of UserTesting.com

Dave Garr photo, co-founder of usertesting.com
Dave Garr, co-founder of Usertesting.com

My friend Dave Garr is probably one of the most non-famous Famous usability and UX thought-leaders around. If you’ve never heard his name, you very well may have heard of his creation: UserTesting.com. As a co-founder of UserTesting.com way back in the dark days of 2007, Dave and his team have made a major impact for all usability practitioners; a fast, low-cost and useful usability testing service that provides results in a day versus what used to take weeks. When he’s not re-inventing usability testing, Dave loves writing and performing song parodies. While at Apple, he recorded these videos: “I Think We’re a Clone Now” and “Killing My Software with Windows

If not busy enough completely re-creating remote unmoderated usability testing for the entire world, Dave won a Webby for his marriage proposal.

What’s your background?

My first brush with technology came during a summer job in college with a software company who developed EasyWriter, the first word processor for IBM’s PC. Fortunately, when I went through the interview process, no one asked me if I’d ever used a computer before.

I graduated from Cal Berkeley in Marketing, and I’ve overseen websites for several companies, such as Intuit, HP, and Apple.

I live in Palo Alto, California with my wife Elizabeth who encouraged me to pursue my startup dream, and my two young daughters who don’t seem to be even remotely interested in usability testing.

How did you get into the usability field?

I was managing Apple.com and I found myself drawn to watching Apple’s user experience labs. I was fascinated with how hard they worked to improve the out-of-box experience, or to decide on the use of color in the Mac OS, for example.

Then I read Steve Krug’s “Don’t Make Me Think.” It’s fantastic, particularly his chapter “Usability testing on 10 cents a day.” He makes it so simple: “Watch some people while they try to use [your site] and note where they run into trouble. Then fix it, and test it again.” That resonated with me. Since then, Steve has been kind enough to be a mentor to me.

What is it about your job that you most enjoy, or find most rewarding?

That’s easy. It’s when we release a new capability on UserTesting.com and a customer tweets or blogs about how it’s improved their life. Like one guy tweeted: “I nominate usertesting.com for a Nobel Peace Prize for preventing warfare between designers and developers. Don’t fight, test it and see.”

What is UserTesting.com and why should someone use it?

We like to think of it as usability testing without the hassle. You create the test, and we handle everything else, including getting the testers. We record the testers using your site, so you can virtually peek over their shoulders to discover your site’s problems. It’s $39 per tester and you get the results in about an hour.

Companies commonly test:

  • Their own website and landing pages
  • Competitors’ sites
  • Semi-functional prototypes and staging sites
  • Facebook games
  • Mobile apps

What was your motivation for creating UserTesting.com?

I’ve spent an unhealthy amount of time in usability labs, and I was frustrated with how expensive and time-consuming it was. So I started doing a lot of quick and dirty usability testing with my family, coworkers, friends, neighbors, and — in those rare times that I could get up the guts–captive audiences at train stations.

So UserTesting.com solved a pain point that I had. And fortunately it’s a pain point that others have.

What have you learned while running UserTesting.com?

We launched our minimum viable product (MVP) four years ago. After every order, we emailed customers asking them “What can we improve?” We’ve received a lot of feedback because — believe me –our MVP had a lot of room for improvement. The request that we heard most often was this: “I want the participants to be my exact target market and not people on your panel.” So that’s the area we dedicated the most resources to build. Now participants don’t just have to come from our panel — they can also come from any of these places:

  • Live visitors on your website who’ve been intercepted
  • Your own customer list
  • Participants from third-party panels

Another thing we’ve learned: website owners care a lot about their competitors’ websites. As Steve Krug says, “Someone has gone to the trouble of building a full-scale working prototype of a design approach to the same problems you’re trying to solve, and then they’ve left it lying around for you to use.” In particular, our clients want to know what their competitors are doing right, so they can “borrow” it.

What advice do you have for other start-ups that wish to create an online service, whether usability related or otherwise?

If you only take away one thing from this interview, then by far and away, my biggest recommendation is: come work for us! We’re growing and want to hire more people who are passionate about rescuing the world from hard to use products.

But if you insist on doing your own thing, then here are some thoughts…

Do what you love. Since I’ve had to immerse myself in the topic of usability testing for four years, it was good that I was very interested in that topic. It would be hard for me to spend so much time every day thinking about a topic that I wasn’t passionate about.

Work with people you love. I cannot overemphasize how important it is to work with someone that you really enjoy. My co-founder, Darrell Benatar, had previously been a friend and co-worker, so I knew how well we got along.

Love your customers, even if a few take advantage of you. I’ve learned that providing great customer support is crucial. We’re trying to mimic Zappos on this one. We’ll give customers a refund, no matter what. Even if they ran tests years ago, combined the best clips into a highlight reel, and shared that highlight reel with hundreds of people; if they ask for a refund, we give it. Our customers don’t abuse our return policy–less than 1% of our customers request a refund. Best of all, by having great phone, chat, and email support, we get tons of feedback from customers about how we can improve our product.

What’s in the future for UserTesting.com? What changes or improvements are you working on?

Okay, I’ll tell you…as long as you promise to keep it a secret (laughs).

Probably my hardest job is deciding which feature to add next. We’ve learned from ConversionRateExperts.com to rate each feature (on a scale of 1-10) according to “How easy is it to implement?” and “How important is it to customers?” We multiply these two figures together to give an estimated return on investment. Next we build the feature that has the highest estimated ROI and then A/B test it.

Our DNA is about listening to customers. When a lot of customers ask for the same thing, we usually do it. The biggest things they’re asking for now are:

  • Improve our user testing of mobile devices. We’ve developed a mobile version of our platform, and making it better is a key focus of our product development for the foreseeable future.
  • Expand globally beyond the US, Canada, and UK.
  • UserTesting.com has made it easy for you to get feedback on your live website. However, as you know, the earlier in the development cycle you test, the easier it is to make changes. But we haven’t made it easy to test concepts. Shame on me for not doing a better job on that. So we’re going to try to make it easier to use UserTesting.com to get feedback in the ideation phase of the dev process.
  • Consulting services for our enterprise customers. We create the test plan, make clips of the places where testers got stuck, and recommend how to fix the biggest problems found.

What do you think the next few years will bring for usability?

Computing is moving from one screen — a computer accessing the web — to four screens: a computer, a tablet, a phone, and a smart TV.

Let me quote a usability expert named Craig Tomlin! You’ve talked about the next big UX trend is understanding that “user experience” does not mean just “web site experience” or “mobile experience” or “phone experience” or “store experience. ”

Companies will stop designing each experience in a vacuum. They’ll start putting together the holistic understanding of the entire “user experience.”

You used the example of how someone buys a car. She may go to several websites to evaluate car brands. She may use her mobile phone to schedule test drives. She may ask friends on Facebook or other social sites about their opinions. She may build and configure her ideal car on her iPad. Eventually she goes to the car lot and negotiates with the dealer. Given that she has interactions that transcend any single experience, why would car companies design the user experience she has with the website without considering the other critical interactions she’ll have during the car buying process?

What’s next for you and your career in the next year or two, what would you like to focus on?

Sentiment analysis. Sentiment analysis is software that mines text for meaning and insight. It’s often used to extract opinions and emotions from social media to help companies determine how people feel about their products.

Sentiment analysis is an extremely difficult problem, but it’s a problem that will eventually be solved. When the problem is solved, it’ll cull through a massive amount of text and automatically call attention to the biggest, most frequently mentioned issues. This will increase the value of qualitative tools like open-ended survey questions and transcripts of user testing.

Thank you Dave!


0 33

Interview with Mads Soegaard, Founder of Interaction-Design.org

My friend Mads Soegaard is a man possessed. Possessed by the feeling that information, especially information about usability, should be readily available to all. To that end he’s literally poured his full devotion, time and energy (and money!) into Interaction-Design.org. What would turn a mild-mannered programmer and all around good guy into a fanatical devotee of web-based education for all? Well, read on!

Q1. What’s your background? Where did you go to school, what subjects interested you?

Mads Soegaard
Mads Soegaard, founder of Interaction-Design.org


I’ve taken the majority of my education here in Denmark. I have a master’s in “Information Studies” and studied a PhD in computer science, which I never finished.  I love anything that’s highly theoretical and highly practical at the same time. I get bored when I do too much of one or the other: After going to an academic conference and reading a lot of academic papers, my fingers begin to itch and I want to do practical programming and design wireframes. But after a while I begin to long for the theoretical stuff again.

Q2. How did you get into interaction design and usability field?

It seems I’ve always been here. I started a web development company way back in 1997 and our quickly made usability our hallmark. Since then, it has stuck with me. I think it’s because I have a love-hate relationship to technology. Some days I really hate technology, swear at it, and find it so frustrating, time-consuming and nerdy. On other days, I love it and appreciate how much it helps me.

Q3. What is it about interaction design and usability that you most enjoy, or find most rewarding?

Making cool stuff that works well and makes other people happy. It’s really as simple as that.

Q4. You founded the interaction-design.org site.  What is interaction-design.org and why should someone use it?

It’s a new model for publishing. Instead of our community producing books that are read by only a few thousand people in the Western intellectual hemisphere, we want to teach millions of people about usability and interaction design. Not just the paying ones but everybody. From New York to New Delhi.

Q5. As founder of interaction-design.org, what was your motivation for creating this tool – why did you believe interaction-design was needed?

Because I‘ve read so many fantastic books by fantastic authors. I believe these authors have the minds to change the world. However, they are not going to – as long as their works are only read by a few thousand people. We need top-grade educational materials to be accessible online for the whole world to enjoy and learn.

Q6. From your experiences with how people use your website, what content or key learnings seem to be the most popular, and why do you think that is?

The encyclopedia and our calendar are the most popular sections. They get about 3,000 unique readers a day.

Q7. What advice do you have for other start-ups that wish to create an online education service, whether interaction-design related or otherwise?

My advice is to:

  • Save up a lot of money – and be willing to spend it all during your startup process
  • Be able to live on oatmeal for several years
  • Be willing to sell your car, remortgage your house, and let go of your fancy title
  • Have a determination like few other people
  • Put almost everything on the line

Q8. What’s in the future for interaction-design.org, what changes or improvements are you working on?

Well…that’s a secret but it will be revealed August 1st, I hope. If we’re not late J

Q9. What do you think the next year to two years will bring for interaction design and usability?  Do you see it growing, if so by how much?

I see it growing a lot. Our everyday lives are getting packed with technology and every little shop on every street corner has a website. So whether you’re designing websites or mobile phones or household object, you’ll be needed more and more in the coming years.  People get frustrated with technology every day and we’re like doctors in that sense. We cure frustrating and time-consuming technology.

Q10. What’s next for you and your career in the next year or two, what would you like to focus on?

Well…that’s a secret but I’ll be happy to share the news with you on August 1st

Thank you Mads!

0 19

An Interview with Whitney Quesenbery

Whitney Quesenbery
Whitney Quesenbery

This is an interview with Whitney Quesenbery, one in a series of interviews with people in our industry who have made a difference in the usability field.

Whitney Quesenbery has a distinguished career in usability. She’s a noted author of two books, Storytelling for User Experience: Crafting stories for better design, with Kevin Brooks and Global UX: Design and research in a connected world, with Daniel Szuc.

Among other things, Whitney has given of her time by leading our industry as President of the Usability Professional’s Assocation, serving on two U.S. government advisory committees and by leading the Usability in Civic Life project, which aims to improve civic design projects such as voting improvement on ballots and related election materials.

Q1. What’s your background? Where did you go to school, what subjects interested you?

I started out as a theatrical designer in New York. What I loved about working in theatre was that it was live performance, which means that the audience is part of the event, and the show is never exactly the same from night to night. There’s a lot of technology in theatre lighting, and I was in the first generation of designers to learn on computer boards. The combination of technology and art was a great preparation for UX, where we are always trying to understand how other people react to things we create.

Q2. How did you get into usability field?

It was serendipity, really. I started by writing documentation for Hyperties 2.3 and I ended up working with Cognetics for 12 years on a wonderful variety of projects. All of our projects focused on making information usable – from large knowledge bases to complex data – so I got introduced to what was then called “usability engineering.” The terminology has changed over time, and we have a more varied toolkit these days, but the biggest difference between then and now is how much more common and  routine user research and usability testing is today.

Q3. What is it about usability that you most enjoy, or find most rewarding?

I love the sense of discovery. Every project is a chance to learn something new. Most rewarding? That would have to be the opportunity to work on projects that can make a difference in people’s lives.

Q4. You recently wrote the book “Storytelling for User Experience,” what was the inspiration for writing it?

I’d been talking about stories in our work for several years, and wrote a chapter for Tamara Adlin and John Pruitt’s book on narrative and personas. Lou Rosenfeld nudged me into thinking about how this could become a book. I’d met Kevin Brooks at a UPA conference. With my user research perspective and his design innovation perspective, we brought together two important aspects of storytelling in UX.

Q5. As a frequent user researcher and information architect, what do you find are common issues or misunderstandings clients have about UX and IA?

Everyone struggles to figure out how the pieces fit together. It leads to silos, even within UX. Lou Rosenfeld talks about this in his plea for us to bring together all of the data and insights from both quantitative sources like analytics and qualitative sources like user research.

The other common misunderstanding, is that UX is a single process, one-size-fits-all. From my experience, it’s not.  Every project is different, so the specific activities need to be adjusted, within an overall approach, to answer the questions each project poses. As a consultant, I work with companies with different situations, so I’m often figuring it out with them, looking for the best solution for their teams and how a new way of looking at a problem can help them.

Q6. From your experiences with how people use Personas and storytelling for UX projects, what key aspects seem to be the most useful, and why do you think that is?

The real value of both personas and storytelling is the way they give us a clear, human picture of the people we design for. It’s so easy to get caught up in all the mechanics of creating technology and forget that there are real people out there. The other really important value of personas is in helping us empathize with people who are not just like us. They let us understanding people from different cultures, professional backgrounds, with different beliefs or attitudes about our products. That ability to get outside of our own perspectives is critical to user experience. It’s why we do user research and usability testing.

Q7. You’ve been active with the Usability Professional’s Association for some time.  What do you think are issues or opportunities with the UPA in relation to usability and UX today and in the future?

Every professional organization that I know of is struggling to find its place in a networked society. They used to be the way you met other people in your field for professional contacts, advocacy and education. Those monthly newsletters were a way to keep up with the field. But what’s the unique value a  formal organization offers now? And how do they keep up with a field that is growing and evolving so rapidly? I don’t have the answers, but I know that a walled garden doesn’t work well in the face of so much competition. There are so many great online options and excellent local conferences that are no longer under the umbrella of a professional association.

Q8. What do you think the next year to two years will bring for usability and information architecture?  Do you see them growing or changing, if so why?

There’s now so much in the business press about the importance of user experience and I see basic UX techniques like personas, card sorting, and usability testing being taught in so many courses that it’s starting to feel like we’ve passed a tipping point of some kind. So yes, I see it continuing to grow. But, I also think they will keep evolving. For example, we’re learning how to integrate usability into the agile development approaches. And I’m seeing a wider range of methods for usability testing to meet the needs of global and mobile projects. The world doesn’t sit still: we can’t either.

The other big trend is related to how fast the field is growing, because it’s growing everywhere. So we will have to learn how to collaborate with colleagues around the world. I learned a lot about the issues working with Dan Szuc on Global UX: Design and research in a connected world. As a small example from my current work, one of my projects focuses on accessible voting. We collaborated with OpenIDEO on a challenge to develop new ideas for how to design an accessible voting experience. The designers who participated were from Great Britain, Turkey, Cambodia, Australia, India, just to name a few.

Q9. What’s next for you and your career in the next year or two, what would you like to focus on?

I’m interested in how we create technology that is inclusive, so that we don’t continue to create digital divides that leave some people behind.  I’ve been working on a book with Sarah Horton about how to design for accessibility.  It won’t be a technical book – there are already lots of great resources out there for that. Instead, we’re trying to articulate how we can think about design in a way that leads naturally to more accessible products.  Like the concept of “mobile first,” if we also think about “accessibility first,” we’ll end up with websites and apps that work better for everyone, because they are more focused and simpler.

Thank you Whitney!

3 55

Interview with Paul Veugen, founder of the remote usability testing tool Usabilla

Paul Veugen is a fresh out of university entrepreneur and founder of the remote automated usability testing tool Usabilla.

Customers of Usabilla include some pretty big names like; The Discovery Channel, HowStuffWorks, Thomas Cook and the World Wildlife Fund, just to name a few.

Paul is a rare and gifted person; he’s a young and successful start-up founder and business person, he’s trained in Communications and Digital Media, and he’s a knowledgeable practitioner of usability and user experience.  Studying Paul and learning about what he thinks is the next Big thing could be very useful information for anyone interested in the future of usability and UX.

Paul Veugen, founder of Usabilla
Paul Veugen

Q1. What’s your background? Where did you go to school, what subjects interested you?

My background is in Communication sciences. I studied Corporate Communication & Digital Media at Tilburg University (The Netherlands) and graduated just recently. I really enjoyed my time at Tilburg University and spent most of my time working, race-rowing, (including acting as the race-rowing Board member), and even some studying!  I definitely learned the most about working for and with various people (clients) while running a large rowing club for a year as President of the board.

At the age of 15 I started working for a local web design firm, mainly focusing on design for SME’s in the southern part of Holland. I’ve worked for this company for almost ten years and choose my studies based on my early working experiences.

It didn’t take very long before I got a more leading role in the company and specialized more and more in strategy, user experience, and social media.  The more I learned by practice, the more interested I became in research about entrepreneurship, user experience and usability.  That’s when the business ideas for a new type of usability business started popping up in my head, and became more and more frequent.

Q2. How did you get into the usability field?

I started working as web designer at an early age and learned to design with the client and client’s customer in mind. When I just started I was spending most of my time on various tutorial sites to work on my technical skills in Photoshop and Illustrator.  I quickly discovered that to successfully design a webpage you don’t need all the eye candy in Photoshop. With some very basic technical skills, for example using Photoshop or Illustrator, anyone could in theory design a webpage.

However, building beautiful and easy-to-use websites is completely in a different league.

When I realized my creativity and technical skills were not the most important limiting factor to a successful user experience, I started to focus more on topics like interaction design, usability, and user experience. I really enjoyed scanning and reading hundreds of blog posts a week on these and other interesting topics.

Q3. What is it about usability that you most enjoy, or find most rewarding?

Good usability is so complex and simple at the same time.

I prefer to put usability in the bigger picture of user experience. I think usability is a more technical approach, where user experience expands the scope with aesthetics and attitude. If you only focus on usability and basic task performance, you could probably just simply build black and white, functional webpages with blue underlined text links.

I like the more complex relationships between desirability, usability, accessibility, value, credibility, and findability.

User Experience Graphic
User Experience

Q4. You founded the online usability testing tool Usabilla.  What is Usabilla and why should someone use it?


Usabilla is a simple tool to collect valuable real-user feedback on any sketch, mockup, website, or image.

Participants perform simple tasks on your webpage or concept and can add points and notes. For example, You can ask participants;

“Click on the things that are the most important for you” or “Where would you click to find information about rates?”

Participants can answer these tasks by clicking anywhere on the screen to add a point and can add notes (‘Post-its’) to leave additional feedback.

You can use our tool to set up task orientated tests (example, “Where do you click if you’re interested in usability resources?”) and to collect feedback (example, “What’s important on this page and why?”).  You can then analyze the test results with plots, heatmaps, and time per task.

Usabilla provides a really simple way to collect feedback from large numbers of users and can be used in any stage of the design process to test task performance.

Q5. As founder of Usabilla, what was your motivation for creating this tool – why did you believe Usabilla was needed?

Usability research is booming. There’s a large group of innovators and experts sharing their ideas and knowledge about testing.

In the past 15 years academic researchers wrote hundreds of interesting papers on usability testing and the pros and cons of different testing methods. There are many verified testing methods available, but most of us only focus on (lab based) best practices from just a handful of experts.

At the university I searched for a quick and dirty method to test my mockups. That’s when I first found out about the Plus-minus method for document evaluation. The idea for Usabilla is based on this method.

The Plus-minus method is a simple yet effective tool to collect feedback on a document. You ask participants to draw pluses and minuses on the document for the things they like and / or dislike. Afterwards you ask your participants why they added a plus or a minus. About ten years ago a researcher made a first attempt to adapt this method to the screen in a lab setting. We’ve used the method and translated it to a flexible remote tool.

We try to make it as simple as possible to test your (early) ideas, without slowing down your development cycles.

Most of our clients are usability experts, designers & developers, and online companies who made Usabilla part of their usability toolbox and combine our data with other tools to create a more complete picture of their users.

Q6. Usabilla is now out of Beta and a full-fledged paid service.  What were some of the key learnings from your Beta days you believe made a difference to your current success?

We launched a first beta release of Usabilla less than a year ago (2009). Our first version was buggy, but it clearly showed our ideas about usability testing and what we were aiming at. We received very interesting Beta user feedback. This feedback and interesting use cases helped us to improve our product and fine-tune our ideas.

We received great suggestions for interesting tasks to use in a test.  Using this feedback, we implemented new features, improved our test interface bit by bit, and made our platform scalable.

Our early Beta users turned out to be great ambassadors of our product. Our Beta period helped us to proof our concept and gain traction in the marketplace with their word of mouth and advocacy.

We’ve removed the Beta label by the end of December 2009 and launched our paid plans at the same time.  This was just a formality.  The months before our public launch we were already running interesting cases from a variety of users. Once we were (almost) sure that everything worked as planned and our service could deliver real value, we kicked off the public release.

We’re now still developing at the same pace. We try to push out new releases every two weeks. Many of the features and improvements we’re working on are based on the input of our users. Practice what you preach!

Q7. What advice do you have for other start-ups that wish to create an online service, whether usability related or otherwise?

I often meet other entrepreneurs working on what they call an exciting new business concept, who are afraid to share their genius idea with others. They spent months in their home offices with closed curtains and disconnected laptop to build their awesome concept into a wonderful company at least 1% of the world is craving for.

Only a few true geniuses are able to build a company like this, who have the network to plug their product or service.  Everybody else is probably more likely to succeed if they start an open conversation and not hide their ideas.

Developing a company is about iteration.  Trial and error.  Listening to the eco-system you’re trying to become part of.

There’s a striking parallel between building a company and designing a website.  Sure, some of us can close our eyes and ears and build a great website, but most of us could benefit greatly from a conversation with our potential users. A conversation helps you to understand your user and can give meaning to behavior. Building a company or a website is a combination of your vision and goals PLUS valuable input (both attitude and behavior) from your users.

Q8. What’s in the future for Usabilla, what changes or improvements are you working on?

We’re going to expand our development team and make an exciting roadmap for the upcoming months.  Besides general improvements in the flow of our back-end we’re currently working on an API.  This API allows you to retrieve all your test data and use it for example to create custom reports in Google Spreadsheets or import it into other usability tools.

The first version of our API will be ready by the end of April 2009. That’s just the beginning.

We plan to integrate Usabilla in large content management systems and combine our tests with other usability tools. Other features that have our attention at the moment are improving reports, testing user flows, and small performance improvements.

Q9. What do you think the next year to two years will bring for remote usability testing?  Do you see it growing, if so by how much?

In 2009 a large number of remote usability testing services popped up. It’s interesting to see how these services all take their own approach to usability testing.

In my opinion there is no such thing as THE usability test. We’re data junkies combining multiple sources to learn from our users.

I expect an enormous growth of the entire usability market and remote research in particular. Innovators like the guys from Bolt|Peters (read their book ‘Remote Research‘ or get it with your Usabilla account) are paving the way and sharing their best practices with the world.

Usabilla currently works with researchers, designers and marketeers. They all share the same hunger for information to learn, improve, and optimize.  Usability and user experience is hot.

I expect that remote usability research is going to show the same sort of growth as the analytics market showed a few years ago. Everybody can use Google Analytics and dive into the data to learn some basics about visitors. Remote testing services are the new analytics, providing additional insights in the behavior and/or attitude of users. These tools could be used by everyone for basic information, and become powerful new data sources for the usability professional.

Q10. What’s next for you and your career in the next year or two, what would you like to focus on?

Every morning I wake up full of energy.  I get really excited by working on Usabilla.

My focus for the upcoming two years will be Usabilla.  I want to spent my time building something that provides value to our users and their customers. I want to expand our eco-system. One of the most stimulating things for me is meeting new people, both online and face-to-face, and learning from them on a daily basis.

I plan to attend some great events in Europe (be sure to check out UX-LX in Portugal) and the U.S. in the upcoming months to meet people and share ideas on usability & user experience. And you can always feel free to connect with me (Twitter, Facebook, LinkedIN) if you would like to share your ideas about user experience, usability, and business.

Thank you Paul!

For more information about Usabilla, or to try the service out, be sure to check out their free test.

Let's Connect