Last week we hosted an Immersive Game + Simulations Technologies conference in my facility. This is an area in which I am only generally familiar so some of the speakers had some very interesting things to so. The keynote speech given by Simon Solotko provided me with an immediate vision of a likely intersection between live performance and technology.
Fair warning: Don’t read any further if you can’t tolerate the idea of cell phones and iPads being used in your arts facility.
Solotko addressed the idea of augmented reality where technology overlays some sort of information upon the “real world.” For example, if you pointed the camera on your cell phone down the street, an arrow might appear on the screen over the image of the street showing you which way to turn to get to a bakery.
Solotko’s thought was that you could use this technology to provide whatever information you wanted people to know about you, and only that information. If you were at a writers’ conference you might put information out on the Cloud that you were doing research on a book about the Civil War. When someone pointed their phone/iPad in your direction they would see that information, but know nothing more about you than that. So if they shared your interest or had some resources you were seeking, they might come over and speak with you.
Solotko noted that you wouldn’t want to use facial recognition to connect yourself to the information you put out there because it is far too permanent and identifiable to be able to retract. Not to mention that there would be problems in low light environments. (This has a lot of social utility and you might want to put some information out there while you are in a dance club, after all.)
According to Solotko, this is really what the Samsung Galaxy Gear is all about. Its utility is about more than just moving the functions of a phone to your wrist, but providing an platform to deliver the augmented reality experience Solotko envisions.
As he describes it, you would put some information out there on the Cloud then program your wristband with some distinctive pattern of color. When someone pointed their camera at you, it would pick up the pattern and provide whatever information you chose to share.
I immediately recognized live performances could use this to provide supplemental information about the artist performing; the character they are playing; provide stream a real time translation of Shakespearean speeches or Italian aria being delivered; and perhaps even offer another layer of characterization by revealing a character’s internal thoughts that belie their spoken sentiments. (Though if an actor is any good, they shouldn’t need a virtual thought bubble to communicate, but it could definitely have its uses.)
Of course, orchestras had this idea a long time ago with the ill-fated Concert Companion project.
As I noted earlier, this means actively encouraging people to hold up their phones or wear their Google Glasses and ceasing to worry that they are recording every moment on stage. Whether audiences and venues are ready to embrace this shift in the viewing environment is likely to depend on a number of factors.