Saturday, May 04, 2019

[nbwxzynq] Human I/O

Humans have two pretty good input interfaces: vision and hearing.  High bandwidth and good sensitivity.

Humans have two pretty good output interfaces: voice and fingers.

A typical video game system uses vision and fingers (though they also use a lot of sound).  Create electronic games exploring the other 3 possibilities of choosing one from each interface.  (We can't say "video" game if it doesn't use video.)

Probably not to shun an interface entirely, but use it sparingly.  Perhaps it mostly uses sounds and voice, but there is a display and some buttons, which are used sparingly.  So it can't be a game purely on Amazon Alexa.

Karaoke uses mostly sound and voice, especially if you've already memorized the lyrics.  It is kind of the ultimate in exercising the full range of human hearing and voice.  Buttons to select a song.

Co-op multiplayer video games have players using voice and hearing in the natural way to communicate.  This could be a model for a single-player game: the other "player" you are cooperating with is an AI which talks and listens like a human.

I'm surprised game controllers don't have microphones built into them for some voice control.  Speech is useful (among other things) for selecting among a large number of items.  Push a button to speak to avoid the creepiness of an always-on microphone.  Inspired by how much time it takes (how many buttons you need to push) to change armor in Zelda BOTW.

Do we want AI measuring the tone of your voice?

No comments:

Post a Comment