JARVIS

JARVIS is an interactive tabletop for households that combines touch and speech interaction and is designed for the shared space in the house

Project domain

Shared media surfaces

Stakeholder

Informaat, University of Amsterdam

My role

UX designer

Team

UX designers, UI designers, developer

Tools

Sketch, Invision, HTML, Javascript, PHP, Google APIs, Photoshop

Duration

4 months

The challenge: competing for users' attention

Our goal was to design a shared media surface for household members. Identifying the problem that this media surface is going to solve was a necessary step, to avoid designing an extra device competing for users' attention. Also, as it is a shared device, particular attention had to be paid to users' privacy.

Sketch of Jarvis
Sketch of Jarvis

Market trends and interviews

Smart home devices

We started by looking into the current trends. According to Forbes, 2017 was the year of the smart home and the market will continue growing in the coming years. Sony and Microsoft already have prototypes of interactive tabletops.

Online survey

To gain insight into our users' needs and problems, we conducted an online survey. In total, 227 participants responded. We were interested in understanding how household members organize their daily tasks, how they share information with each other, and also, what kind of problems they encounter in doing so. According to the results, household members mostly share information about their appointments and location.

Information shared by household members

Information shared by household members

Information shared by household members

Information shared by household members

Results showed that 1) miscommunication, 2) too many communication channels and 3) lack of synchronization are the biggest challenges when it comes to sharing information. From all the respondents, young people sharing a house were the group with most communication problems.

Problems encountered by household members

Problems encountered by household members

Problems encountered by household members

Problems encountered by household members

Empathizing with the users: designing personas

We constructed detailed personas that allowed us to empathize with the users. Alberto, Sanne and Jeroen are young, they all work and/or study, and share a house in Amsterdam.

Persona Alberto
Photo Alberto
Demographics 22 years old
Italian
Business student
In a relation
Personality Romantic, fashionable, ambitious
Likes Fashion, cooking
Goals He would rather spend less time doing housework. He would like to have some more quality time at home, he is always too busy!
Frustrations He does not get Dutch food culture. His flatmates never sit down for dinner.
Persona Sanne
Photo Sanne
Demographics 23 years old
Dutch
Art student
Single
Personality Social, messy, artistic, free-spirit
Likes Partying, Yoga
Goals She would like to get to know her flatmates better. They seem nice but not very social.
Frustrations She is not a big fan of rules and schedules. If something is not dirty, why cleaning it?
Persona Jeroen
Photo Jeroen
Demographics 25 years old
Dutch
Cargo manager at Schipol airport
Single
Personality Serious, responsible, introverted
Likes Routine, watching Dutch TV shows
Goals He would like his flatmates to help at home. It seems he is the only one doing the cleaning
Frustrations He is shy and does not know how to share how he feels with his flatmates.

Constructing the user journey

We defined several scenarios involving our personas.

Scenario 1: Sanne and Alberto are planning a surprise party for Jeroen's birthday. They need to check Jeroen's agenda without him knowing. They also want to keep him distracted while they organize the party, maybe sending him to buy groceries, so he doesn't find out.

Use case

Scenario: surprise birthday party preparation

Use case

Scenario: surprise birthday party preparation

Iterative design approach

We started prototyping JARVIS in an iterative manner and testing every prototype. JARVIS is an interactive tabletop that integrates four main features: a shared calendar, a news feed, digital notes, and a weather widget. On top of that, JARVIS has an activity recommender system. Users can interact with JARVIS using touch and speech.

Privacy

To solve the issue of users' privacy we designed three different modes:

  • open (registered and non-registered users);
  • collective (shared between registered users);
  • private (exclusive to individual users).

Users can access each mode through voice commands, as JARVIS uses speech to authenticate users.

Interaction

Interaction with the different modes

Interaction

Interaction with the different modes

Users can access different modes using voice commands

Calendar

JARVIS offers an activity recommender system based on users' preferences, location, weather...

Calendar

The I am bored feature on JARVIS shared calendar provides recommendations based on user preferences, location, weather...

Usability testing and acceptance

We conducted two tests rounds to asses the usability, user experience and acceptance of JARVIS. We were interested in understanding:

  1. Is JARVIS usable and is it easy to use?
  2. Can users achieve their goals?
  3. Are users willing to use JARVIS?
User testing
User testing
User testing
User testing
Participant Task 1 Task 2 Task 3 Task 4
1 - -
2
3 - - -
4
5
6 - -
7 - -

Task Completion Rates

Participant Task 1 Task 2 Task 3 Task 4
1 - -
2
3 - - -
4
5
6 - -
7 - -

Task Completion Rates

Most participants agreed that it was easy to find their way to the information. Also, most participants were willing to use the system at home.