Tuesday, November 18, 2008

Sketch Recognition User Interfaces: Guidelines for Design and Development

Author: Christine Alvarado

Comment:
1. Daniel's blog

Summary:

This paper discusses Sketch Recognition user interfaces (SkRUI) and an application developed using this concept, MS Power point .
Online Edit mode - user needs to hold the pen down fro sometime and the system changes the mode to Edit mode automatically. User can then select the sketches. A pen up then results in switching back to sketch mode while the selected items are highlighted.
A switching between unrecognized / recognized sketch was provided by a checkbox at the top of the window.

Evaluation of the system was done to understand the perception of the user about the tool and what they wanted from the tool.
3 scenarios - Creating new diagrams/ slides with the tool
- Labeling the diagrams with keyboard since the system did not support handwriting recognition
- editing and sketching using pen

Design guidelines - this paper provides some design guidelines to design a SkRUI systems.
- Display recognition results only when the user is done sketching
- Provide obvious indications to distinguish free sketching from recognition
- Restrict recognition to a single domain until automatic domain detection becomes feasible
- Incorporate pen-based editing.
- Sketching and editing should use distinct pen motions
- SkRUIs require large buttons
- The pen must always respond in real time

Discussion:
These design guidelines may not be ideal for all the cases. There can be lot variability in designing SkRUIs. For instance, sketch recognition can be done while drawing the stroke. Its cannot be a rule.

This throws up lot of open questions:
- When to recognise ?
- When to show the results?
- How to switch modes in an unambiguous way?
- How to show recognition results?

1 comment:

Daniel said...

Yeah, on re-reading my post, I had some typos that lead to the statement not making sense. I was thinking aloud on a way to assume editing mode based on when and how long the pen moved and held, but I could see it now just being annoying...