Pointing at the TV

By now it’s generally agreed that iTV is coming on Wednesday and is likely to be iOS-​​based.

Many folks have assumed that “running iOS” means “running iPad apps” directly, or iPad-​​style apps via another App Store. This raises a lot of ques­tions about the inter­action model; how do you manip­ulate an app that’s beyond your reach? If we expect any new iOS device will run existing apps from smaller screens, we run into the “focus” problem: if you can’t touch directly, you have to have context for the “noun” you are about to “verb” with the next tap.

There are a few ways to address focus.

A direc­tional controller (d-​​pad or gestural touch surface) can navigate a straight­forward, recti­linear menu interface as most TV inter­faces (including Apple TV) do today. Or that same controller could move focus between more arbi­trary active regions, as with many DVD menus. Jon Bell and Dan Wineman are excited about gestural touch surfaces and their potential here. After all, the Remote app for controlling your Apple TV from an iPhone has a similar touch surface approach for navi­gating menus.

I’m not convinced. Even though it is common to confound gestural touch surfaces and direct touch UI, this is still an indirect focus controller. I cannot imagine Apple adopting a discretely-​​shifting-​​focus UI akin to DVD menus, and the best alter­native seems to be intro­ducing a cursor for arbi­trary focus. Once you’re using a direc­tional controller (gestural or not) to control a cursor on a screen (decoupled from the controller surface)… well, that’s a pointer. You might as well have a mouse.

Meta