Biofeedback Project

Final : From Dreams to Thought Bubbles – Julie Huynh

____________________________________________________________________________________________________

Sci-Fi Precedents:

Screen shot 2014-05-20 at 3.53.25 PM

____________________________________________________________________________________________________

Initial Project Statement:

Using a brainwave sensor as the next step in my immersive tools research to access the recesses of dreams because they can create the most enveloping environments in your mind tricking your body and senses to believe you are in another environment.

____________________________________________________________________________________________________

Precedents:

Science Fiction to Reality

Screen shot 2014-05-20 at 3.53.53 PM

Screen shot 2014-05-20 at 3.54.11 PM

____________________________________________________________________________________________________

Brainwave Sensor Options:

emotiv-headset imgres

Emotiv 14 Channel Sensor

aisen_joel

OpenBCI 8 Channel Sensor

Interaxon_Muse_Loic_003_610x386

MUSE 4 Channel Sensor

____________________________________________________________________________________________________

Chosen Sensor:

Screen shot 2014-05-20 at 3.54.47 PM

NeuroSky Mindwave

1 Contact Affordable Sensor

____________________________________________________________________________________________________

Audience:

Children and adults ages 13 and up because by approximately 13 years their Alpha and Theta waves are similar to adults, so at this age the code will work similarly for their brainwaves from 13 years and up.

(http://www.brainev.com/core/research-benefits/Brainwaves.aspx)

____________________________________________________________________________________________________

Sensor Shortcomings

  • Abstract data hard to map
  • Some technology is inaccessible, for example Conor Russomanno and Lisa Park expressed that Emotiv’s Epoc technology is hack-blocked
  • Needs more scientific research on the complex roles of the waves detected
  • Brainwaves can be detected and data received, but large gap in the interpretation of data

____________________________________________________________________________________________________

First Digital Data to Physical Device Connection Issues:

Using openFrameworks to Arduino, initially I used firmata to make the connection, but finding glitches in my connection I switched to serial communication.

However I was unable to send strings of serial data because I did not use a PWM pin to receive analog data output, so I tried using an LED to  to photoresistor, but that issue was solved by using a PWM pin and getting serial communication to work sending from openFrameworks and receiving serial data in Arduino.

Analog_Setup

____________________________________________________________________________________________________

Revised Project Statement/Concept:

To create the best translation of digital brainwave data to physical play.

Originally hoping to find a more accurate way to interpret the data read from the thinkgear and translating it to aiming a water gun and shooting it, I ran into technical limitations that led me to use a bubble gun instead to better interpret the brainwave readings. By using the the data and mounting the physical translating onto the user’s head, it aids in creating the illusion that they are making actual thought bubbles out of their own head with the use of the sensor worn underneath to track their attention level.  It becomes a play on words to create actual bubbles with their mind allowing the user to have a more immersive experience.  The project concept allows the user to believe that their attention can be measured based on the amount of bubbles emitted from the thought bubbler headgear.  Moving the physical interface to become an attachment of the user’s head creates a physical extension of the user’s head, and allows them to believe that it is an extension of their mind with the aid of the thinkgear sensor.  The thought bubbler headgear becomes an embodied experienced through its physical interface and brainwave sensing technology.

Screen shot 2014-05-20 at 3.55.35 PM

____________________________________________________________________________________________________

Project Objectives:

  • Digital data to physical play
  • Create a digital sketch to control physical device
  • Prototypes 1-3: Parse out different waves, connect with CV object, use CV object as trigger, connect CV trigger to air pump
  • Prototype 4: Blow-up balloon with detection of attention level measured by Mindwave sensor
  • Prospective Prototype 5: Control water gun aim and water pressure with different wave channels (CANCELED)
  • Final Prototype 5: Bubble gun best translation of brainwave data within hardware limitations to create bubbles based on thought rate

Prototype 1: Parse out Channels

Screen shot 2014-04-07 at 7.32.31 AM

Prototype 2: Draw a CV object and move with Attention and Meditation levels

Screen shot 2014-04-07 at 7.32.43 AM

Video showing jumpiness of data received from Thinkgear

Neurosky Experiments Documentation from Julie Huynh on Vimeo.

Prototype 3: Use Visualization to Trigger Air Pump

Serial Connection from openFrameworks to Arduino

Screen shot 2014-04-07 at 7.33.13 AM

20140404_175757

Working Pump Triggered by Serial Communication from Thinkgear

Air Pump Test from Julie Huynh on Vimeo

____________________________________________________________________________________________________

Testing Pictures:

DSC_0104

DSC_0047

DSC_0078

____________________________________________________________________________________________________

Playtech Testing:

Playtech Title: Don’t Think Too Hard

Kids will concentrate on openFrameworks sketch to start the signal connection, and try to reach an attention threshold to blow up the balloon connected to the air pump.

Screen shot 2014-05-20 at 3.58.14 PM

Github:

Thinkgear Experiments

____________________________________________________________________________________________________

New Physical Computing Challenges

Translating the new openFrameworks sketch and arduino sketch to the hacked motor of the bubblegun, and moving the h-bridge to a smaller board to mount onto headgear.

Screen shot 2014-05-20 at 3.55.39 PM

____________________________________________________________________________________________________

Thought Bubbler Headgear Diagram

Creating headgear to hold the thought bubbling device while also fitting the thinkgear sensor on the tester’s head.

Thought_Bubbler

____________________________________________________________________________________________________

Final Thought Bubbler Headgear:

IMG_2189

Front

IMG_2182

 

Back

IMG_2185

 

Back H-Bridge Detail

IMG_2187IMG_2188

Sideviews

bubblehelmet

Final Headgear Worn by Tester

Progression of the Thought Bubbler Video:

Thought Bubbler from Julie Huynh on Vimeo.

____________________________________________________________________________________________________

Github:

Thought Bubbler Code

Future Iterations:

  • Create 2 wireless Thought Bubblers and use 2 Mindwave sensors
  • Make wireless, using wifi or bluetooth to arduino
  • Connect with a game interface for users to compete with who can produce the most thought bubbles

Further Research:

  • Complete a digital to physical interaction to simulate an immersive environment
  • Explorations of other sensors that can simulate immersion
  • Other tools to access the change of embodiment created by dreams, possibly by sending in different brain wave patterns to users to recreate the visualizations stored in those patterns

Powerpoint Presentation:

PowerPoint Link

 

Leave a Reply