Usability is everything. Tech people has their fingertips pretty integrated with the machines, but to a general user it’s a different story. Starting from private release 2, we’ll rely on usability tests rather than the intuition of developers to lead our product design.
Today, there were 4 subjects, sitting in front of the computer one after another to perform a simple register / create sheet / logout test case under no external intervention. That’s how we get started our first lesson.
EditGrid Usability Test Report 1, 2006-03-11
System
EditGrid, Private Release 2 (as of 2006-03-10)
Subjects
A law firm’s account clerk, a civil engineering undergraduate student, a garment trader’s manager, a fashion designer
Observations on Spreadsheet View
- All subjects failed to handcraft a formula correctly - They get used to building formula by mouse clicks.
- Not awared of the save sheet notice - Even it is red in color!
- Save sheet sequence is unexpected to user - This includes requiring to login, and getting out of the spreadsheet view.
- Failed to distinguish between functions provided by browser and the system - Using browser’s right-click context menu to manipulate cells, searching for functions in the browser’s menu bar, pressing CTRL-S to save a sheet on the destop!
- To save or not to save - User is very unexpected to find no save button, but is also unexpected when requiring to save a newly created / imported sheet. Also, we are unable to tell users clearly that whether a sheet shall be saved prior to closing, because in our implementation, that depends!
- Some users misunderstood that there is no copy & paste - Because there’s no visual effect after doing a copy or cut.
- Some are unfamilar with import and export - Feel confused when presented with a file input box, and even would types in it. Also feel confused when presented with a download window after clicking the export link. The file formats in the export links are mostly unfamilar, and that cause distractions.
- Confused of the terms private and public - They have no idea what sheet sharing is, not to mention the access control mechanism behind it.
- Not awared of the Permlink feature - Have no way to know about it. Have no idea what the chain icon means.
- Problem with delayed cell updates after actions - If nothing happens immediately after, e.g. pasting on a cell, users may feel they have not performed the action. Some loading visual effect can help a lot here.
Observations on Website
- Failed to comprehend product vision from cover page - Only know its a spreadsheet software.
- Can’t get started - Can’t locate the register combo box and quick start link. Perhaps two new tabs could help: sign-in and register.
- Decide slowly on quick start - The options in the quick start page is confusing, and nobody clicks the “start new blank sheet” at the first place.
- Unexpected ordering of search results - Currently, username matches come before sheet name matches.
- Links are too subtle - Perhaps links should be underlined, more bold, more colorful. How about replacing some with buttons?
- Can’t back home - The “home” button is now the EditGrid logo. A bad idea.
- Forget to logout - The logout link is, yes, too subtle.
Feature Requested by the Subjects
- Graphing
- Manipulate cell data by mouse dragging
- Currency and thousands mark (,)
- Multiple cell selection by SHIFT+ARROW
- Cell borders
- Inserting symbols
- Auto-logout on closing browser
- Printing
- Pasting single cell data to multiple cells
Self-Evaluation
First, nobody really talks about the speed.
Second, many compares features and UI with common desktop spreadsheet apps in a very strict sense. Perceptions are totally that we’re making another desktop spreadsheet app. So the feature must be more comprehensive in order to make any sense. We failed to convey our objective as a collaborative app. Perhaps, the look and feel of our app is too close to a desktop app, and many don’t even aware that our app is running inside a browser.
END OF REPORT
