parente.dev

My iPad Is My Copilot

June 05, 2011

For the past month, I've been running an eyes-busy, mobile computing experiment: I've been using VoiceOver on my iPad to listen to saved Instapaper articles during my 15 minute work commute. My hypothesis is that I can enjoy reading during my drive without sacrificing safety.

For the purposes of this experiment, I consider my reading enjoyable if I don't want to give up and use the screen later out of frustration with mispronunciations, poor prosody, and interruptions. At the same time, I consider my driving safe if I do not look at, touch, or think about my iPad any more than I would the car radio. These requirements might sound quite difficult to satisfy. But, as I've suggested before and have once again found, you can get quite a bit of utility out of a combined audio display plus simple touch interface.

Training

To save life and limb, I first practiced using Instapaper via VoiceOver at home until I felt I had mastered the basic gestures. I don't remember exactly how long I spent on this training, but I'm sure it was significantly less than an hour.

Daily Setup

When time permits at home and work, I load up my Instapaper account with articles I want to read. Before I leave home or the office, I open the Instapaper app on my iPad and let it cache my articles for offline viewing. It usually finishes in a matter of seconds, long before I head out the door.

In my car, I pick the first article I want to read before I put the key in the ignition. (I might as well use the display when I can.) I prop my iPad up in locked landscape mode between the stick shift and the emergency brake handle on the center arm rest. I tap the home button three times to enable VoiceOver (a shortcut enabled in the Accessibility settings). Then I start the car, put it in gear, and start my drive.

Reading

Using Instapaper with VoiceOver requires very few gestures. A few one-finger swipes to the right skips me through the minimal UI at the top of the article. When I hear the title, a two-finger swipe down the screen starts VoiceOver reading the article continuously.

Screenshot of an article in the Instapaper iPad app

If I find my attention wandering, a one-finger swipe to the left backs VoiceOver up. If I hit a particularly dull section, a one-finger swipe to the right skips to the next paragraph. Another two-finger swipe down the screen starts VoiceOver reading continuously again from the new location.

Sometimes my commute is long or the article is short. If I finish reading the first article, I select another by doing the following:

Screenshot of the Instapaper iPad home screen

As complicated as any of these sequences sound, I learned them with minimal practice. I can now perform them all without a single glance at the screen.

Discovered Settings

I did encounter a few gotchas along the way related to my default iPad settings.

Max-out the volume

I can hear VoiceOver well as long as the windows are up and I set my iPad volume at the maximum. Granted, my Civic's engine is a mouse compared to your V8 or Hemi. But the Civic's soundproofing isn't top-of-the-line either.

Lock the screen rotation

My commute in RTP is bumpy enough to cause the iPad's rotation to change if left unlocked. (I kid you not.) VoiceOver considers the switch so important that it stops reading, announces the change, and then often forgets what it was doing beforehand. Locking the rotation avoids this hassle.

Disable WiFi finding

With WiFi network finding enabled, my iPad manages to find quite a few networks during my drive. The network connection popup interrupts VoiceOver's reading when it appears and requires quite a few finger gymnastics to dismiss. After it's gone, I find that VoiceOver often forgets its place in the article. Disabling the "Use available networks" option sidesteps this problem entirely.

Curtain the screen

The iPad screen is an undesirable distraction and battery drain while driving. VoiceOver has a nice feature to counter it: the screen curtain. Triple-tapping with three fingers turns the screen black, saving both precious battery and human life.

Possible Improvements

My commute system is definitely not perfect. Here are couple thoughts on how it could be improved.

Skip the chrome

It would be great if a two-finger swipe down the screen started VoiceOver reading the article text immediately. Having the ability to hide the Instapaper chrome via a preference or to skip it using VoiceOver would add a little more "insta" to my setup.

Continue to the next article

A "Next" button at the end of an article would save me the complex gesture sequence required to pick another article. Such a button would be a useful shortcut during screen use of Instapaper as well, avoiding the out-and-in navigation to the articles list required today.

Outcome (So Far)

My continued use of VoiceOver plus Instapaper for over a month without a driving incident or foolish look at the screen is the best evidence I have in support of my hypothesis. I am finding the commute time quite convenient for attending to my Instapaper queue and my reading has been enjoyable.

Because of the success of the system during short commutes, I attempted something similar during two recent car trips lasting over 10 hours each. During both trips, I used VoiceOver to read many chapters of The Night's Dawn in iBooks. I found myself enjoying the reading for well over 6 hours each time as I drove through the night (10 PM to 9 AM). Surprisingly, the reading voice helped keep me awake rather than lulled me to sleep.

Doing More with Structured Navigation

With a little code, I think I could use VoiceOver plus Safari to go beyond reading simple, saved text articles. Imagine pre-processing your email, feed reader headlines, Twitter timeline, and so on into a single HTML document marked with simple structural elements like headings. Visit this page in Mobile Safari before leaving home or the office. Enable VoiceOver and set its Rotor Control to skip by headings. Start reading and use single-finger up / down flicks to navigate among the various sections.

I've also thought about tossing some JavaScript on the resulting page. Consider a section containing only email titles: a summary view of your morning inbox. A double-tap while VoiceOver reads the current title activates the standard "onclick" handler on the title's HTML element. Perhaps that click moves the focus to the body of the email stored somewhere else on the page. Maybe a double-tap on the body returns the focus back to the title.

I think I've only scratched the surface of what's possible. I intend to explore more.

No Liability Clause

I sadly think I have to say the following.

I accept no liability for any damages or losses suffered as a result of actions taken based on information contained herein. If you're dumb enough to read, compose email, play games, browse the web, etc. using your mobile device while driving, you cannot blame me when you crash and burn.

Another Read: Introducing the OpenCoweb Project »

I've been part of a project at IBM since 2007, exploring what our team calls cooperative web concepts: multi-user interaction and audio/video conferencing within web applications. In January, IBM approved our team's proposal to release a portion of this work as the Open Cooperative Web Framework, or OpenCoweb for short. This release features a JavaScript API for adding lock-free, concurrent editing to new or existing web applications. The keystone in the framework is an operational transformation (OT) algorithm that guarantees all users converge to the same shared state.