Week 1 (Sept. 7 & 9)
-
Intro to Class
- Github – all code for class available here
- Tidalcycles
- Assignments:
- Install Tidalcycles AND Start Tidalcycles and Superdirt for the first time
- Video technical lessons:
- Exercise – due Mon., Sept. 14 (post documentation before class on Mon.): Make some music, create multiple lines in Tidal that can play together then record yourself doing a “live coding performance” changing code as you play.
- Reading – due Mon., Sept. 14:
- Required (post response on blog before class on Mon.): Interactive Art and Embodiment: Introduction, pg. 1 – 6
- Non-required: Inside Live Coding and Algorave
Week 2 (Sept. 14 & 16)
- Discussion of reading
- P5.js
- Intro
- Computer Vision
- frame differencing
- thresholding
- P5.js -> Tidalcycles communication
- Node.js
- Websockets
-
OSC (open sound control) communication
- Assignments:
- Video technical lessons:
- Exercise – due Mon., Sept. 21 (post documentation before class on Mon.): Play Tidal with body using frame differencing.
- Readings – due Mon, Sept. 21 (post response on blog before class on Mon.):
Week 3 ( Sept. 21 & 23)
- Discussion of readings
-
More computer vision:
- optical flow
- More Tidalcycles
- Assignments:
- Video technical lessons:
- Exercise – due Mon., Sept. 28th (post on blog before class on Mon.):
Explore sound made for the ear: “What kinds of interfaces to sound might we want for this model? What can we make? Will we be able to move our hands through the space around us, shaping the sounds as we listen, roughing them up here and smoothing them there, and pushing and pulling areas of sonic fabric up, down, toward and away, together and apart? What might be the variables with which we interact? In what dimensions might we move?” Using optical flow, create some tidal sketches to shape, push, and pull the sound with your body into something that “works” for your ear.
- Readings – due Mon, Sept. 28 (post response on blog before class on Mon.): Interactive Art and Embodiment: Chapter 3 – A Critical Framework for Interactive Art, pp 89-98.
Week 4 (Sept. 28 & 30)
- Discuss framework for critical analysis
- More Computer Vision:
-
background subtraction
-
blob detection
- posenet
-
- Other computer vision models
- Assignments:
- Video Technical Lessons:
- Download and install the Arduino desktop IDE on your computer: https://www.arduino.cc/en/main/software as well as Teensyduino: https://www.pjrc.com/teensy/td_download.html
- Exercises – due Mon., Oct. 5th (post on blog before class on Mon.): Combine blob detection and optical flow into the same sketch and further the exercise from last week of pushing and pulling the sound with your body into something that “works” for your ear. Try Posenet as well. What are the differences? Pluses? Minuses?
- Prepare Presentation (group one) due Mon Oct. 12:
- Choose a work from Lauren McCarthy
- analyze thoroughly using the expanded critical framework discussed in class
- prepare presentation to be done in class Monday Oct. 12th (10-15 minutes max)
- Group One is: Susanne N. and Robert (code used to generate student pairings and order)
Week 5 (Oct. 5 & 7)
-
Introduction to Teensy & Arduino
- Kit overview
- Teensy 3.2 & Teensy LC
- ***teensy pinout diagrams***
-
Touch Inputs:
- Tilt Switch
-
Force Sensitive Resistor
- Capacitive Touch – Teensy
- Capacitive Sensor Board
-
Human Body Switch
- Serial Communication
-
-
10 degrees of freedom sensors:
-
accelerometer
-
magnetometer
-
gyroscope
-
altimeter
-
temperature
-
-
plus! audio amp
-
plus! small storage for audio files
-
- Assignments:
- Video Technical Lessons:
- Exercise – due Mon., Oct. 12th (post on blog before class on Mon.): Using the prop shield and/or capacitive touch, use the entire body to control tidalcycles (make new tidal scripts). Focus on making the interaction and result of the interaction very clear to someone watching the video. Don’t just hold the prop shield. Attach it with cloth, a belt, rubberbands, or some other way to your body. Also, try to be consciously aware of the relationship between you, your body, your mind, the sounds, and the technology.
Week 6 (Oct. 12 & 14)
- Group 1 to share researched artwork
- Grideye thermal camera
-
Human presence sensor
- Assignments:
- Video Technical Lesson:
- Exercises – due Mon., Oct. 26 (post documentation on blog before class on Mon.): Use the grid eye thermal camera and layer up as many tidal scripts as you can, turning them on and off via the 64 squares frm the grid eye. Use your whole body. Try to make it clear (in the beginning at least), what you are triggering.
- Readings – due Mon, Oct. 26 (post response on blog before class on Mon.): What is Somatics?
Week 6.5 (Oct. 18, Sunday, Legislative day – classes meet on Wednesday schedule)
FALL BREAK-ISH
Week 7 (Oct. 26 & 28)
- Somatic workshop w/Kiori Kawai
- Creating Visuals
- Intro to Shaders!
- Assignments:
- Readings (NOTE: do these before you watch the videos) – no blog post necessary:
- P5js Shader Tutorial – Getting Started sections (they all go in order):
- Video Technical Lessons:
- Exercise – due Mon. Nov. 2nd (post documentation on blog before class on Mon.): Play around with creating visuals with shaders based on the methods we learned this week, mixing and matching your body with other footage/images. Focus on personal expression in how you’re manipulating your body image with the shaders and other footage you mix in.
- Prepare Presentation (group two – Alia & Omar): Rafael Lozano-Hemmer Due Nov. 9th
- Attend Lynn Hershman talk – Sunday Nov. 1st!
- Readings (NOTE: do these before you watch the videos) – no blog post necessary:
Week 8 (Nov. 2 & 4)
- Creating Visuals:
- Moving further – more Shaders!
- Assignments:
- Video Technical Lesson:
- Exercise – due Mon. Nov. 9th (post documentation on blog before class on Mon.): Simular to last week but more in depth: really focus on bringing your life INTO the visuals you make (incorporating your body), and thus bringing LIFE to the visuals. What connections, feelings, experiences, thoughts, etc. can breath and be expressed with and thru the visuals you make.
- Reading (listening) – due Mon, Nov. 9th (post response on blog before class on Mon.): Listen to A Brief History of Everything, Chap. 1, Ken Wilbur
- Prepare Presentation (group three – Suzan S. & Debbie) – Kimchi & Chips (Mimi Son & Elliot Woods) Due Nov. 16
Week 9 (Nov. 9 & 11)
- Group 2 (Alia and Omar) to share researched artwork
- More Shaders!
-
Assignments:
- Video Technical Lessons:
- Exercise – due Mon. Nov. 16th (post documentation on blog before class on Mon.): Write down as long a list of holons in your life as you can. Use this list as structure for creating. Holistically combine sounds and visuals together using Tidal and shaders. Be creative!
- Prepare Presentation (group three)
- Production – due Mon. Nov. 16th (post documentation on blog before class on Mon.): You may work on your own or in pairs for your final. Start work on the final, come up with a concept and direction to move forward with. You should have a detailed idea conceptually as well as concretely (what you will actually make), experimenting with creating things is a valid way of brainstorming.
- FINAL: It can be a performance, an interactive installation, and/or an interactive intervention in public space (or all of the above, as we have learned, these three are not necessarily separate from each other). The body should be central to what you create and the emphasis of the piece is on connection and expression through video streaming during Covid-19. Please limit your “event” to 3 minutes. It should use some sort of interactive technology, as well as tasteful and appropriate use of sounds and visuals. Build upon and utilize elements from all the sketches you have done this semester. The grading rubric will be:
- 25% Use of Body: demonstrates critical thought about the human form in the context of art and technology; centrally integrates body in art work
- 25% Clarity & Consistency: has clear, effective experiences for performers and audience members; works every time as planned; effectively uses computational algorithms to deal with unpredictable data to achieve reliable and consistent results
- 25% Creativity: expressively connects one’s own experience of life to others; includes tasteful and appropriate use of sounds and visuals; conceptually well thought out and relevant
- 25% Technology use: competently uses sensors with a micro controller and/or computer vision techniques to track the human body in various ways, makes successful use of visual and audio generation techniques, streams online
- FINAL: It can be a performance, an interactive installation, and/or an interactive intervention in public space (or all of the above, as we have learned, these three are not necessarily separate from each other). The body should be central to what you create and the emphasis of the piece is on connection and expression through video streaming during Covid-19. Please limit your “event” to 3 minutes. It should use some sort of interactive technology, as well as tasteful and appropriate use of sounds and visuals. Build upon and utilize elements from all the sketches you have done this semester. The grading rubric will be:
Week 10 (Nov. 16 & 18)
- Group 3 (Suzan S. & Debbie) to share researched artwork
- More Tidal
- Composing Multi-Part Patterns
- Transitions
- Creating Visuals:
- Bodypix
- Posenet w/ shaders
- Multiple shaders at the same time
- Assignments:
- Install the following before class next Monday:
- OBS: https://obsproject.com/
- ngrok: https://ngrok.com/ Create free account and then install
- Video Technical Lesson:
- Production – due Nov. 23 (post on blog before class starts on Mon.): Continue working on final
- Install the following before class next Monday:
Week 11 (Nov. 23 & 25)
- Streaming:
- OBS https://obsproject.com/welcome
- node media server
npm install node-media-server
- ngrok https://ngrok.com/
-
./ngrok http 7000
-
- Example: https://github.com/aaronsherwood/sensorsbodymotion/tree/master/browser/streaming
- https://livelab.app/
- Assignment:
- Production – due Mon. Nov. 30 (post on blog before class starts on Mon.): Continue working on final. Your project should be to a point where it is almost done. Be prepared to stream your events next week.
Week 12 (Nov. 30 only , NO CLASS on Dec. 2)
- Dress rehearsals: stream events
- Final Project is Due WED. DEC. 9!!
Week 13 (Dec. 7 & 9)
- Final project due!
- Event date/time TBD