Alt.

An interactive simulation that explores the concept of déjà vu.

Date

Oct. 2018

Demo

Video Link

Focus

Creative Coding

Live Media

Interface Design

Arduino + P5.js

Laptop mockup centered on a black page showing a single line of dots arranged in a sine wave pattern with a footer that says 'Wave Interface'; Space: 0.1, Time: 0.1, Matter:01; and 'Reality 02'.

Introduction

A new interaction design challenge was to create a physical interface. This meant bringing together Arduino, electronic sensors, and artistic thinking.


To begin, I fancied concepts that are beyond the physical. Stretching my imagination, I wanted to interpret the concept of déjà vu using a sine wave, three sensors, and javascript.

Translating
Déjà vu

My interpretation of the strange déjà vu experience was inspired by Dr. Michio Kaku's explanation. I conceived it as a trigger that sets off when our reality is altered.


'Alt.' simulates an environment that uses a wave to represent our reality — space, time, and matter.



Animation showing the sine wave (single line of dots) in motion.
Browser window mockup with concept note pop-up overlaying the Wave Interface.

Connecting Sensors

We make sense of our reality primarily through what we see, hear and touch. The interface materialized these senses by using three electronic sensors.



Breadboard circuit with three sensors attached.
  • Infrared Sensor to sense hand gestures.

  • Rotary Encoder to make a ticking sound.

  • Touch Sensor to sense finger tap.

User Interaction

To enable interaction between the user and the reality wave, each sensor was coded to control one of the wave's three aspects — space, time, or matter.


The wave was designed to give three feedbacks-

  • Amplitude change, from 0.1 to 1.

Animation showing the sine wave increasing its amplitude with 'Space' in the footer changing from '0.1' to '1.0'.

  • Frequency change, from 0.1 to 1.

Animation showing the sine wave increasing its frequence with 'Time' in the footer changing from '0.1' to '1.0'.

  • Split, between 0.1 and 1.

Animation showing the sine wave 'splitting' into two duplicate waves with 'Matter' in the footer changing from '0.1' to '1.0'.

Interface Design

I imagined this work to breathe independently as an exhibit. Including a concept note was essential, but I was doubtful to add any user-invoked 'about' section.


My mentor, Saakshita Prabhakar, suggested a rather simple way to do this- make the concept note appear automatically if there is inactivity for 5 seconds or more.


As soon as the user starts interacting with the physical interface, this note would hide.

Browser window mockup with Wave Interface showing two sine waves with highest amplitude and frequency, and all footer values maxed out to 1.0.

Altering Reality

If the user peaks out (reach 1.0) the three aspects of reality collectively, a déjà vu event will be triggered.


The three sensors will interchange their functionality while the wave and the sensors remain the same — creating an eerie experience of déjà vu.



Animation showing the Wave Interface glitch (slightly) as soon as all values reach 1.0, with 'Reality 01' changing to 'Reality 06'.

Take-aways

  • Working with electronics in the library scares people.​

  • Make the story more relatable for the users.

  • P5.js is a great alternative to processing.

  • Users enjoy more output with less input.

  • Creative coding can turn into arrays pretty quickly.

View All Projects