Here's a video showing our first test of projecting our visuals onto the screens.
The projector is currently positioned front and center of stage and projecting directly at the screens. We are still figuring out positioning of screen, Kinect, and projector. Today we just tested out the visuals on the screens and played with screen layout. We discovered that the Kinect was not reading Mimi when she went back stage. We will have to figure out side lighting to make sure the Kinect can read her.
Let me caveat this post by mentioning my lack of knowledge about circuits, Arduinos, accelerometers, and such. Now, 12 days later, I have successfully connected and constructed together 2 accelerometers, 1 LilyPad Arduino, 2 XBees, and a battery pack using red felt fabric, a red unitard, and a lot of conductive thread. Woohoo!!
I began the learning process with much frustration of trying to get started. It took me awhile to realize that I was missing the VCP drivers necessary to use with the Arduino program and was also not selecting the correct serial port and board in Arduino. I was so happy to finally get a simple Blink program (Arduino example) working. After that I went on to learn about accelerometers and soon XBees.
Experimenting and learning
Experimenting with Xbees
My overall goal was to read in Mimi's arm and leg movements to further move the visuals projected on the screen. Ideally it would have been great to have 4 accelerometers (one for each arm and leg) but for the sake of my sanity, I minimized it to 2 accelerometers (one for her right arm and one for her left leg). The purpose of the Xbee is to transmit the accelerometer data to Antoinette's computer (where her Processing program is running). Her Processing program will read in the data which will then be used to affect the surrounding wave forces. Getting the Xbees set up and communicating was another set of frustration. Luckily for this awesome tutorial, I was able to get things moving.
After much experimentation, I was finally ready to sketch out the circuit design...
Circuit Design
Circuit Design
Close up circuit design of fabric strips connecting to accelerometers on Mimi's ankle and wrist
And then begin the fabrication process...
And after lots and lots of sewing....
Antoinette and I worked quite a bit together to figure out the next few steps. First I had to figure out a way to interpret the accelerometer values before sending the accelerometer input to her laptop. This page was a great source of information that helped to convert the values to 0 to 360 degree values for X, Y, Z. If I needed to change the program, I could upload any new program to the LilyPad Arduino. Once that was done, we had to figure out a way to get her Processing program to receive the values from the XBee that would be on Mimi's costume. We were "easily" able to get the values read into CoolTerm running on her computer but it took more time figuring out how to get her Processing program to read in the values. After successfully getting the values read in for one accelerometer, I attached a second accelerometer to the costume and Antoinette adjusted her program to receive the values from both accelerometers. After that, Antoinette integrated the new incoming data from the accelerometer with her existing program. She was successfully able to get her program working with the new input from Mimi's movement. We will still have to work on tweaking the values and possibly adjusting the accelerometer positioning on the costume.
And here's our result...
Testing out sewn circuits with Kinect and laptop
Yahh I was soooo relieved that everything was working. After very tired eyes from LOTS of sewing and MUCH anxiety about the conductive thread connections, it all paid off.
Now time to test it out on the screens and add extra reinforcement to the stitches and any potential shortages.
For our stage design, we would like to project onto multiple scrim curtains. The biggest issue with using multiple curtains however is...cost. We didn't realize how expensive scrim material could be! It cost the department over $2000 for the scrim in Sketch 2. And because we want to use multiple scrim curtains, we would need to cut up the material (which essentially means cutting up $2000).
Our solution...fabric shopping!
We brought our own mini projector to test out projections onto material
Tiffany testing out projections onto material
Mimi's costume will be red...so testing out red fabric behind the potential curtain material
In the end we went with the black power mesh fabric. The 35 yards of fabric cost us a total of $203.75, saving us a lot of money!
And here's the costume we ordered for Mimi off of Amazon....
