Interaction Design WikiSonic Interaction Design

Sonic Interaction Design HS 2018


A design research workshop on the subject of sound and interaction

This workshop, which will take place in the HS 2018 from January 7 to 18, 2019, is about innovative sound design of interactions.The goal is the systematic, creative exploration of sound and its significance for the design of interactions, communication and affordances.

A special focus is on design methods that understand sound as a means and material of interaction design. Simple low-tech methods and live improvisation focus on sound and interaction, from concept to design to experience and functional protoype.

The projects will be implemented in an iterative process using so-called "Wizard-of-Oz" prototypes and on-demand sensor platforms, allowing for flexible development and dynamic interactive demonstration of insights. 

The central aspect is the continuous evaluation of design hypotheses with small "user studies" and field trials. Because there are only a few rules about Sonic Interaction Design, but a lot of space for experiments and design research that we want to explore.

The goal is therefore not primarily to build functional prototypes incl. Programming and sensors, but to work out details and variants of the sound design, as an experience prototype to experience and further develop by user tests.

Information about the project see Project description and deliveries HS 2018

Course documents, links etc. can be found at SID Kursmaterialien HS 2018

Further information and tutorials can be found at: Tutorials and How-To`s as well as here

Links to Projectblogs 2018

Also see video examples from the Audio Visual Basics course: Further Readings, Resources and Literature

Link zur ZHdK Sample Library: smb://zhdk;filer7/SFX

Note: The WIKI will be updated frequently! Please press "reset" regularly (bottom right).


Week 1
Inputs, design tools: conception and evaluation framework, semantic & narrative sound design, MIDI live controls.

Evoking emotion through sound. 

Concept work & development of the "electroacoustic Wizard-of-Oz prototype"

Week 2

Implementation of the sound experiments with functional prototypes and mockups, documented field trials, final demonstration.

MK = Matthias Kappeler

SP = Simon Pfaff

MS = Milestone.

Woche 1

Mo., 7.1. 4.K14

Di. 8.1. 4.K14

Mi 9.1. Atelier / 4.K14

Do. 10.1. Atelier / 4.K14

Fr. 11.1. Atelier & 4.K14


9:30 Einführung (MK / SP)

Warmup "Sonic Taboo"

  • Warmup 3x per category
  • all categories with dice (game)

11:00  Input:

  • Sonic Interaction Design
  • Methods & Designprocesses

independent work


9:30 Presentation of Exercise 1: Evoking Emotion Through Sound in Film

10:30  MuLab Tutorial

  • Hands-On: PushPullPowWow 2018 - how does a gesture affect a sound (and what does the sound communicate?)

9:00 Kickoff Exercise 2: Sonification 

independent work

  • Develop a basic idea
  • Create sonic moodboards

independent work


13:00 Pick up material at the Ausleihe

14:00 Hands-On: Semantic Foley Film Remake 

15:30  Life-Foley Performances 

16:15 Exercise 1: Evoking Emotion Through Sound in Film

(if there is a need:) 16:45 - ca 17:30 Introduction to Adobe Audition

independent work

14:00  Demo of PushPullPowWow Sounds

15:00 MuLab Tutorial part 2 (Multirack Setup, Wrapup)

14:00 – 15:30

Mentoring / Introducing Basic Idea MK and SP

independent work

Woche 2

Mo. 14.1. 4.K14

Di. 15.1. Atelier & 4.K14

Mi. 16.1. Atelier & 4.K14

Do. 17.1. Atelier & 4.K14

Fr. 18.1. 4.K14


9:30 Presentation "Wizard of Oz" 


Einführung / Übersicht Sensortechnologien 


independent work

(MK & SP)

independent work

9:00 – 11:00

Mentoring MK + SP

11:00 Final demonstration 

Presentation: concept and process

13:00 Break


Gruppengespräche (SP): Weiteres Vorgehen, Zielsetzung / Reality Check

Freies Arbeiten

15:00 – 17:00

Mentoring MK + SP

independent work

(start video documentation)

independent work

14:00 Course Feedback

14:30 Individual feedback to groups.

  • clean up
  • documentation
  • return materials

Booking plan recording rooms: (see

During the first week the Production Studio Audio 4.D05 is reserved during the daytime. In the second week you are responsible for the booking of audio rooms (4.D05, 3.D08, 3.F05) as needed.


Investigative Tools

Midi (extern)

OSC (extern)


Reaper (von AV Design Basics)