User Interfaces have defined our interaction with almost any device, not just an electronic gadget. This post is just to look at user interfaces for evolving electronic gadgets towards the near future and beyond. I should have more appropriately called this post Human Interface Devices for the future, but that gets me thinking of a specific class of USB devices.
The most common interface for every day usage of gadgets are Keyboards or Keypads. If one is frequently working on a laptop or Desktop PC, a mouse or a touchpad is the second most used interface. Touchscreen enabled PDAs and phones are also available and rank next in terms of usage. Douglas Engelbart invented the most used interface device for the PC, the "Mouse."
The Gaming Industry launched a revolution in User Interface Gadgets by creating multiple versions of the Gaming Controller, The Wheel, The Joystick and User Interface Variations to use gestures (which appeared very early in Video Games like Mortal Kombat.) I am not forgetting Voice recognition and Text to Speech which are strong user interfaces which are also useful for the disabled.
Much of our productivity in work, and at leisure depends on the ease of use and responsiveness of these User Interfaces and User Interface Gadgets. With the gadgets are the screens and the LEDs that guide us through the usage giving us responses to each of our keypresses or requests or gestures.
Touchscreen technology has evolved to take on the Desktop, except that there are few takers right now as the technology is a drastic change from the traditional keyboard/mouse and has an immediate productivity hit when you try to get used to it. (If you switched from a phone with keys to one without any like the iPhone, you would have a good understanding of what I am talking about.)
I feel there are a lot of gaps in today's User Interface Gadgets and the User Interfaces themselves. What exactly is lacking in the modern user interface and the user interface gadget?
I first start with the User Interface Gadget, because they define the method of our communication with machines (if you could put it that way.)
- Speech Recognition started out big, but hasn't yet become available in a form that is easy to use. Today there are some speech recognition solutions that can be language and slang specific, but are heavily constrained. Most of them require to be trained and can be used only in low noise environments. This is an area where we need change which could be brought forth with better technology. Telephony solutions need to use speech recognition more and this has to be friendly. No more "Dial 1 to continue", "The Pound symbol to exit" messages. Those are slow and many a time irritating.
- Computer Speech or Text to Speech is primitive. There are phonetic languages, Voice Fonts and other technology available, yet they haven't reached end users. I really hate having an operator manning a PBX or a reception today because we have enough technology to replace a mundane job with the right technology.
- Cameras are abundantly available today. Webcams are the easiest. Cameras can act as input devices if they could catch gestures or follow the focus of a person. With Digital Image Processing technology having matured a lot, this is a huge gap that can be bridged. We do see PCs slowly bringing in Biometric authentication based on face recognition which is dependent on this technology.
- The Tactile nature of the traditional keyboard is still retained. This essentially means that people doing extensive text-writing will have the risk of RSI (Repetitive Stress Injury.) We have new technology like Capacitive Sensing. If you have experienced the iPod, you probably know what Capacitive sensing interfaces are. You spend the least amount of pressure to actuate an interface, so less energy, less stress, better feedback or expected output from the device. Capacitive sensors with Glass and superimposing LCDs can act as reconfigurable tactile input devices taking the primitive keyboard into a whole new space. You just need to have as few keys as required for a specific application or task.
the iPod's touch wheel. Read this if you are interested.
- Text Entry can also be powered by touch interfaces combined with specialized user interfaces. Most people would not like to keep talking to a Machine for creating a text document that is visually readable. There are light powered keyboards that can be deployed on any surface. This technology has to mature a lot more to become usable.
- Optical Sensor based User Interfaces. These are typically ones which help opening and closing doors based on proximity, protecting people operating heavy machinery. They have not been brought into day-to-day usage except for certain embedded applications. Imagine how simple it would be if your computer woke up or switched on, the moment you sat in front of it. The "Power Button" is redundant. Doors which open automatically after sensing the presence of someone who is to pass through (controlled through some authentifcation mechanism), Car Doors that can automatically open when you are about to enter are all possible, but missing.
- Heads up Displays for Automobiles are missing big time. Having an In-Car telematics system deployed with an extra display is always asking for more effort to use. Many of these devices survive because legacy usage involved reading the speedometer and watching other controls or readings while driving. However the HUD could easily make driving much more easier and free up much needed dash-board space on cars. They could be also be deployed at museums with exhibits. Our visual sense is very powerful and can filter information very easily. Our limbic system is closely coupled with our motor senses making audio a bad idea when you are actually driving a car.
Engineers would lecture for hours on all the barriers in getting these technologies to daily usage, that is exactly opportunity to make things easier for everyone.
The Unusable User interfaces of devices today are fundamentally of two kinds
- Crammed with so many options that you don't want to choose any of them or end up confused
- Have too few options and not the one you are looking for
Here is where a lot of work can go in while building a User interface for Minimum User Intervention and better Usability.
There are key areas where User Interfaces need improvement
- Text Prompting and Text Entry at much faster speeds. Text prompting today is possible. Mobile phones already use some prompting technology to make text entry easy with fewer keys. However the Business and Work Terminals where we spend time keying in a lot of text simply forget this must-have.
- There are enough rules that have been laid out about layout of Graphic User Interfaces (GUI.) They are based on Left-to-Right, Top-to-Bottom scanning that our mind uses. However each User Interface ends up being defined differently. Today this is changing with the help of renderin engines which can decide placement, while controls are merely defined by the "Software Application" or "Firmware." Yet, these haven't yet made it to our desks. Imagine changing the theme of your computer to suit your needs and simultaneously selecting the best type of "Button", "Dialog" and "Tab" Layout.
- The Use of colors to communicate has been a part of human communication. There are even cultural significances for colors. But seldom do we see a laptop display going red when the battery is dangerously low. Colors and Auras on displays and On-Screen-Displays (OSDs) are easy to implement, yet seldom used.
- The use of beeps in computers, phones and many gadgets is probably the most annoying thing in an office. An office environment typically has multiple computers in proximity and everything going "beep" once in a while is certainly undesired. There are better ways to communicate or "pop-up" or "buzz" with all the technology available today. Yet everyone is hoping to "live with" legacy "beeps." With 5.1 Surround Sound technology and a lot of capable devices, one can use sound as a better way to communicate with the user without annoying them.
I have a much longer "I want" list for User Interfaces, but much lesser time to type it in. But there is so much you could think of that is just passed on from one generation of gadgets to the other because no one really thought about usability. So the stronger message is to focus on usability for all devices and gadgets requiring human interaction. Reconfigurability of User interfaces and a more meaningful use of colors and theming should hopefully come in the near future.
There is much talk about Ergonomics and Ergonomic input devices. However the fundamental "Use case" is sometimes lost in trying to make an input device "Ergonomic." While some devices have to head in this direction, they sometimes lose the usability along the way creating a barrier for devices that really wanted to help assist in health issues that arised due to pizza boxed input gadgets.