LOGO

Switch Via Cam: Head Tracking for Faster Typing on Windows

September 13, 2012
Switch Via Cam: Head Tracking for Faster Typing on Windows

The Potential of Hands-Free Computer Control

Imagine a future where operating your computer is as natural as a simple head movement or a blink of an eye. Could you control your system by utilizing facial and head gestures? For instance, blinking could simulate pressing the enter key, while a nod could function as the space bar.

The concept of mouse gestures for computer control is already familiar. However, what if we extended this idea to incorporate head or facial movements? We at MUO have previously explored webcam-based special effects.

Exploring Switch Viacam for Gesture Control

This article focuses on investigating the capabilities of a software program named Switch Viacam. The goal is to determine if it can effectively map head movements to control essential computer functions.

Specifically, we will examine its ability to control the left and right arrow keys. This functionality could be beneficial in various applications, such as writing documents, managing spreadsheets, and designing flowcharts.

Benefits of Hands-Free Navigation

The primary advantage of this system lies in its potential to streamline workflow. Instead of interrupting typing to reposition the cursor, users could navigate using head gestures.

This allows users to maintain focus and efficiency by keeping their fingers on the keyboard at all times. A simple head nod to the left or right could move the cursor without requiring manual intervention.

The central question remains: is this a viable and practical method for computer interaction, or simply a fascinating concept?

Leveraging Switch Viacam for Webcam-Based Control

The core function of Switch Viacam is to transform a standard webcam into a functional "switch" device. This essentially means that defined movements within the webcam's field of view can trigger actions, activating the switch upon motion detection and deactivating it when stillness is present.

The intention of this exploration is to configure two distinct conditions, the maximum allowed by Switch Viacam. The first will involve a head movement to the left, simulating a left-arrow key press. Conversely, a head movement to the right will emulate a right-arrow key press. This offers a novel approach to computer interaction.

Below is a view of the Switch Viacam interface immediately after launch, with the webcam positioned above the monitor.

speed-tasks-head-switch-via-cam-1.jpg

Initially, the "Enable sensor" option is selected for Sensor 1, which introduces a configurable square onto the webcam video feed. This square can be positioned and resized to focus on a specific area of the screen. In this instance, a small square has been positioned to the left of the user’s head, designated as a "Left" event trigger.

speed-tasks-head-switch-via-cam-2.jpg

Each sensor incorporates several adjustable settings. It is recommended to fine-tune the sensors by moving your head within the designated "sensor zone" and observing the "Motion detection" value. The "Motion Detection threshold" should be adjusted to ensure sensitivity to movement while minimizing false positives.

speed-tasks-head-switch-via-cam-3.jpg

The right sensor was then enabled, and a red box was drawn to the right side of the user’s head within the webcam display. Observing the image, the setup resembles a robotic configuration with the colored boxes flanking the head.

speed-tasks-head-switch-via-cam-4.jpg

To evaluate the software’s practicality, a typing test was conducted. Notepad was opened, a couple of sentences were typed, and the cursor was placed at the beginning of the second sentence.

speed-tasks-head-switch-via-cam-5.jpg

A slight nod to the left resulted in the cursor moving one space to the left, confirming functionality. The system responded as expected.

speed-tasks-head-switch-via-cam-6.jpg

Adjusting the threshold to reduce sensor sensitivity proved beneficial. This prevented unintended cursor movements triggered by minor, inconsequential movements within the sensor box. The optimal threshold ensures the "switch" activates only with deliberate motion.

Beyond basic writing tasks, the software was tested with a graphical diagram – a mind map created in FreeMind. Since FreeMind utilizes arrow keys for navigation, it was hypothesized that head movements could facilitate faster editing of nodes and connections.

Indeed, with the central "Main Page" bubble highlighted, a head movement to the right successfully highlighted the adjacent node. This demonstrated the potential for hands-free mind map manipulation.

speed-tasks-head-switch-via-cam-7.jpg

Expanding the control scheme to include up and down movements would be advantageous; however, Switch ViaCam currently limits users to two sensors. A workaround involves repurposing one sensor as a "tab" function, allowing head gestures to cycle through screen elements.

A final test involved navigating a spreadsheet using the Switch ViaCam tool. As anticipated, the system performed flawlessly.

speed-tasks-head-switch-via-cam-8.jpg

The software’s versatility extends beyond arrow keys. Sensors can be programmed to trigger a wide range of actions, including enter, tab, escape, space, shift, and numerous others.

speed-tasks-head-switch-via-cam-9.jpg

The primary limitation encountered was the inability to control games, such as steering a race car with head movements. While conceptually appealing – akin to a Wii-like experience – this functionality was not achievable. However, as a productivity enhancement, the software proves highly effective and is envisioned as a tool for accelerating tasks in applications like Word and Excel.

The extensive range of actions assignable to each sensor encourages creative application. What tasks would you accomplish with this tool? Share your innovative ideas in the comments below!

Image Credit: Web Camera via Shutterstock

#switch via cam#head tracking#windows#typing#computer control#accessibility