CLOUD MIRROR

I met Eric Gradman at a meeting of the recently-formed Transmedia LA group; his enthusiasm and sense of humor are as infectious in person as they are in his work. Gradman’s “uncomfortably augmented reality” project, CLOUD MIRROR, is currently on show at the Sundance festival.

The CLOUD MIRROR is an interactive augmented reality art installation… Live video captured by a camera and is re-projected on the wall behind the camera, functioning like a “magic mirror.” But the CLOUD MIRROR software alters the images on the way to the screen. It runs an algorithm that tracks faces from frame to frame and also examines each frame for 2D barcodes printed on attendee badges. By pairing each face with a badge, and each badge id with a database row, the CLOUD MIRROR can identify by name whoever is standing in front of the installation.

The CLOUD MIRROR then augments each frame, adding a thought bubble to each face in the image. The contents of that thought bubble are selected from a set of “tags” associated with that person. Tags come from various sources, including Facebook, Twitter, and SMS data.

When registering for the event, attendees were asked to optionally provide their Twitter name, Facebook profile ID, and to answer the question “Where is your favorite place in LA?” In the weeks leading up to the event, the CLOUD MIRROR software sent a friend request to any attendee that provided that information. The poor trusting souls who accepted this request had their personal profile gently data-mined. Specifically, the information captured was “Facebook updates,” “Twitter updates,” and “Facebook relationship status.”

CLOUD MIRROR also capitalized on peoples’ innate desire to embarrass their friends by allowing anyone to anonymously “graffiti” in a thought bubble by sending an SMS message to a special number containing the target’s unique badge ID. (monkeys and robots)

Update: Eric’s documentation from Sundance and his reflections on some of the privacy implications of the project.