Interaction Design WikiSpatial Interaction

Bits & Atoms IV 2021

This seminar series covers spatial perception of machines. We focus on the role of computer vision and its relevance for design in contemporary contexts and in future scenarios.

The course is closely tied to Spatial Interaction.

Schedule

Date

Time

Topic

Lecturer

24.03.2021

15:00–17:00

Computer Vision Introduction

FB

31.03.2021

15:00–17:00

Processing & Media

FB

07.04.2021

15:00–17:00

Processing & OpenCV

FB

14.04.2021

15:00–17:00

Machine Learning

Deep Vision

(Depth Sensing)

FB

21.04.2021

15:00–17:00

Project

FB

28.04.2021

15:00–17:00

Project & Presentation

FB

Inputs

Watch the presentation and write down questions and thoughts that come to your mind.

Password: iad2021

📼 IAD-CV-Introduction Video (24.03.2021)

📼 IAD-CV-Processing & Media Video (31.03.2021)

📼IAD-CV-Processing & OpenCV Video (07.04.2021)

📼 IAD-CV-MachineLearning Video (14.04.2021)

Tasks

Task 0 - Introduction

Task 1 - Find the Moon

Create a new processing sketch which loads this image and displays it. How can we find the position of the moon?

Task 2 - Webcam

Install the Video Library 2.0 and display the webcam image!

Task 3 Interactive Paint

a)

Combine brightest point tracking with the webcam capture to track the brightest point in your webcam video.

b)

Create an own drawing software that is controlled by the light of your smartphone flashlight.

Task 4 Brightest Spot Tracking OpenCV

Use OpenCV to track the brightest spot in the image (interactive paint with OpenCV).

Task 5 Detecting Apples

Use the provided image and mark the green apples in the image. Check out the example code to extract hue values.

Additional: Implement a color picker that directly adapts to the sensed range.

Task 6 Locate Apples

Locate the position of the extracted apples with the contour detection. Try to indicate the position with a circle or directly draw the area.

Additional: Use the apples as input device for the interactive drawing or another application (a game?)

Task 7 Deep Vision

Download and install the Deep Vision library. Try out the examples and get an overview how the framework works by reading the readme.

Task 8 Project

Think about a simple project you could implement with the tools you already know (and Deep Vision).

Deliverables

Documentation of your work in the provided template together with your code. This should be placed on the server in smb://fileredu.ad.zhdk.ch/DDE/BDE_VIAD/01_ABGABEN/21_FS/Sem4_BitsAtomsIV/

80% Attendance during lessons