Skip to content Skip to sidebar Skip to footer

Interview with SF Author Rudy Rucker: Interfaces in Sci-Fi

Photo of Rudy
Rudy Rucker

Aaron Marcus: You and fellow cyberpunk sci-fi author Bruce Sterling were guest speakers at CHI 1992, “Sci-Fi at CHI.” You talked about computer-human-interface design ideas in science fiction. How has the sci-fi scene evolved over the twenty years since then?

Rudy Rucker: That was a “fun con”; Bruce and I shared a room. You guys had a reception in the Monterey Bay Aquarium. Bruce and I were so impressed by the tanks of jellyfish that we ended up co-authoring “Big Jelly,” a sci-fi story about giant flying jellyfish. You can find the story in my Complete Stories.

I see the eventual sci-fi default as being a future in which every kind of manufactured object has been replaced by a tweaked plant or animal.

“Big Jelly” was, in fact, a step towards that future, in that it’s about “biotweak tech” rather than about “silicon machinery.” Sci-fi writers ought to be writing a lot of stories about biotech these days, but that hasn’t fully kicked in. There’s an atavistic drift back to writing space operas with giant metal ships, chariots, wooden rockets, or giant cars.

A different trend is emerging. During the last decade we saw a heap of hype about the so-called Singularity [the moment at which machines achieve general intelligence equivalent to human beings], some of it with a weirdly religious fervor. The pitch is that pretty soon AI [artificial intelligence] will strike it rich, and computers will be as smart as human beings. Then we’ll beef up the smart computers with more memory and faster chips, and they’ll design even smarter computers—and we’ll get into one of these exponential growth surges. True-believing, overweight, mouse-potatoes will have their arteries cleaned out by nano-machines and they’ll upload their minds into robot bodies—which is actually an idea that dates back to my 1982 novel Software.

The rank-and-file sci-fi writers were baffled and uneasy about the Singularity, and for a while they were leery of writing about it. But then Charles Stross rose to the challenge in his trail-blazing novel Accelerando, and the rest of us piled on. I even wrote a novel called Postsingular, just to leapfrog over the whole thing. The Singularity is perfect for sci-fi. We’re telling plausible lies.

AM: How has your own work changed in terms of user-experience issues, that is, novel ways in which computer-based communication and interaction are imagined or described?

RR: For a number of years, I’ve been writing about a user-interface device that I call an “uvvy,” which is pronounced to rhyme with “lovey-dovey.” It’s made of piezoplastic, that is, a soft “computational plastic.” Thomas Pynchon had a substance like this in his novel Gravity’s Rainbow; he called it “imipolex,” and I use this word in, for instance, my novel Freeware, which is a part of the Ware Tetralogy.

An “uvvy” sits on the back of your neck and interfaces with your brain via electromagnetic waves interacting with the spinal cord. Most users will want to stay away from interface probes that stick into them with wires. The uvvy functions like a smartphone, but it’s activated by sub-vocal speech and mental commands. It sends sounds and images into your brain.

AM: What do you think about how sci-fi movies and television convey user-experience innovations?

RR: The hoariest media cliché for user interfaces is the “face on the wall,” that is, a TV screen-like image that’s talking to you…but even with Skype and FaceTime, people don’t really seem very interested in videophone communication.

A rich voice signal is more intimate and expresses more. Speaking of voice, I think the greatest weakness in the current digital smartphone standard is that digital voice isn’t anywhere nearly as rich as analog voice. Often, to save channel capacity, the signal drops when you’re not talking. I feel the digital audio channel needs to be made several bytes fatter, and it needs to be a continuous connection so that you hear the stage-setting buzz of the background noise and—also very important—the sound of the other person’s breath.

You often see three-dimensional displays being used in movie visualizations, and these can be fun, although they don’t tend to age well. My favorite media interface scenes are in the 1995 movie Johnny Mnemonic, based on a William Gibson story of the same name. Keanu Reeves does these wonderful Japanese-theater-type hand-jive moves when he’s manipulating his cyberspace interface. I never understood why this movie wasn’t more popular.

 

Painting with two people, each thinking of them as an intertwined couple
Figure 1. “Telepathy stands for the dream of being perfectly understood by your friends and lovers.”
The Lovers. Original art by Rudy Rucker.

AM:  Is there any particular aspect of current interface technology that you feel needs to be changed?

RR: It’s absurd to see people pecking at their tiny smartphone keyboards. This is so clearly a bad user interface. It’s unnatural, error-prone, isolating, and non-ergonomic.

If you’ve learned to touch type—and this should be a mandatory course in every middle school—then you can use a real keyboard without having to look at it. With a real keyboard, the words flow through your arms and onto the screen.

But there’s currently no good way to have a true keyboard on a smartphone. Sure, you can connect a portable full-size keyboard, but that’s kludgey. And you can, at least theoretically, have the device project a virtual keyboard onto your tabletop, but that’s going to have horrible ergonomics.

We need, I think, to take another step along the keyboard-virtualization route and get serious about having the device “see” the mock-keyboarding twitches of your fingers. At some point, a more ergonomic set of hand gestures could take hold. Along these lines, I think of the finger-squeezing interfaces that have been installed in the handle-grips of some experimental bicycles. Using your eight fingers gives you a byte per squeeze.

A different solution to the smartphone interface is to forget about hand gestures and go for voice recognition, and this technology seems to be maturing.
One problem here is that you’re making noise in public, announcing texts that you might want to keep private. I do a lot of my writing on laptops in coffee shops, and I can’t imagine dictating my stories aloud—including all the corrections. I’d seem like a madman. Not that the people having cellphone conversations with earphones and dangling mikes don’t already seem dangerously insane. I suppose the next step might be to have the device lip-read your sub-vocal speech, or pick up the vibrations from a throat mike.

I also need to say something about pointing devices—mice, track-balls, and touchpads. Over time, using any of these devices intensively is hideously damaging to your body—ask any author or programmer. It’s like a silent, unacknowledged industrial disease that attacks a relatively powerless underclass—like black lung used to be for miners. We’ve seen demos where a computer camera tracks your eye movements and lets you point by looking. I don’t understand why this feature isn’t being perfected and rushed to market for every desktop, laptop, tablet, and smartphone.

With all this said, I have a feeling that there are some as-yet-unimagined solutions that we’ll be using in twenty or thirty years. Possibly we’ll get to an uvvy-style direct brain interface. But for sure we won’t be pecking at smartphone keys and ruining our bodies with computer mice.

AM: What kind of user interface are you using in your latest novel Turing and Burroughs

RR: Telepathy. For me, that’s the gold standard, the interface that we’re really working towards. At a metaphorical level, telepathy stands for the dream of being perfectly understood by your friends and lovers. And we’re always getting closer.

Even though we tend to ignore this technology, even print is a first step towards telepathy, but time-delayed. You read this interview and you know what I’m thinking. The phone is another step; you’re speaking and listening to someone who’s far away. Speech is very intimate, very close to the roots of the mind.

An interesting aspect of full telepathy is that you can communicate info in a hyperlink style. When I have a big image to share, I don’t email the whole image, I simply send a hyperlink to the image’s location, and let the user find the image there. With telepathy, instead of wrestling some complicated thought pattern into words, you might simply send a trusted friend a “hyperlink” to the location of this thought within your brain—and possibly they can connect to you and experience the thought as if they’re having it themselves. Note, also, that with this style of communication, we no longer need to break down an image into RGB bytes, nor need to code a thought into words.

I’ve put telepathy into any number of my novels, using all sorts of sci-fi gimmicks to make it work. In Turing and Burroughs, my characters experience a communicable biological mutation that makes them sensitive to a certain type of brain-generated wave. Also, they can shapeshift into giant slugs and have great beatnik orgies.

AM: In the movie The Graduate (1967), the young hero is urged to focus on the future based on one word: “plastics.” If you were to guide newcomers to the world of the future, what would that one word be?

RR: One word? Telepathy. Or a reasonable facsimile thereof.

 采访者:Aaron Marcus

Rudy Rucker是一位作家、数学家,以前是计算机科学领域的教授和作家。他最著名的小说是《软件与湿件》。他谈论了当今的科技:“看到人们轻啄他们微小的智能手机键盘,这种感觉很荒谬。这是违背自然规律、易于出错、孤立自我且违反人类工效学原理的。”他对用户界面进行了深刻的思考,从语音识别、手势操作、眼动跟踪到他自己发明的 “uvvy”—由无声语言及意念命令来激活操作。

文章全文为英文版인터뷰 진행: Aaron Marcus

Rudy Rucker는 작가이자 수학자이며, 이전에 컴퓨터 과학 교수를 지낸 바 있습니다. 가장 유명한 소설로는 Software와 Wetware가 있습니다. 그는 오늘날의 과학기술에 대해 이렇게 말하고 있습니다. “사람들이 조그만 스마트폰 키보드를 두드려대는 것을 보면 우스꽝스러워요. 부자연스럽고, 오류투성이에다, 사람을 고립시키고, 인체공학적이지도 않아요.” 그리고 또 그는 음성인식, 손동작 인식, 시선추적부터 자신의 발명품으로서 정신적 명령(특히 신경시스템 사용)에 의해 활성화되는 ‘uvvy’에 이르기까지 사용자 인터페이스에 관해 이야기합니다.

전체 기사는 영어로만 제공됩니다.Entrevistado por Aaron Marcus

Rudy Rucker é escritor, matemático e ex-professor de ciência da computação. Suas obras de ficção mais conhecidas são Software e Wetware. Ele fala sobre a tecnologia de hoje: “É absurdo ver as pessoas “bicando” seus teclados minúsculos de seus smartphones. Não é natural, é susceptível a erros, isolador e não ergonômico”. E ele reflete sobre interfaces com o usuário desde reconhecimento por voz, gestos manuais, rastreamento do olhar, até sua própria invenção, o “uvvy”, que é ativado por fala subvocal e comandos da mente.

O artigo completo está disponível somente em inglês.Rudy Ruckerは、作家、数学者、コンピューターサイエンスの元教授である。彼の作品の中では、特にソフトウェアとウェットウェアに関する小説が著名である。インタビューの中でRuckerは、今日のテクノロジーについて、次のように語っている。「人々が小さなスマートフォンを突ついているのを見るとばからしいと思う。あれは、不自然で間違いの元になるし、人々の孤立化を招き、さらには非人間工学的でもある」。さらにRuckerは、音声認識、ハンドジェスチャー、アイトラッキング、そして心的発話とメンタルコマンドによって動作する彼自身の発明「uvvy」を通して、ユーザーインタフェースについての 思いを語っている。

原文は英語だけになりますEntrevistado por Aaron Marcus

Rudy Rucker es escritor, matemático y ex profesor de ciencias de la computación. Sus novelas más conocidas son Software y Wetware. Esto es lo que comenta acerca de la tecnología actual: “Es absurdo ver a las personas usando el diminuto teclado de su teléfono inteligente. No es natural, induce a errores, genera aislamiento, y no es ergonómico”. Reflexiona también sobre las interfaces de usuario: desde el reconocimiento de voz, gestos con las manos, seguimiento ocular (eye tracking), hasta su propio invento, la ‘uvvy’, que se activa a través de comandos mentales y habla subvocal.

La versión completa de este artículo está sólo disponible en inglés.