Draw the Beat!

Draw the Beat! is an interactive digital art project that blends music and visual design. Using a custom algorithm developed in Wekinator and visual elements created with p5.js, the project allows users to generate sheet music by drawing beats directly on the screen. The generated music visually unfolds in real time, transforming user input into dynamic compositions.

Instead of starting from symbols, the project focuses on trying ideas through gestures and learning through immediate feedback.

Draw the Beat! was developed using Processing and Wekinator. Processing visualizes user input in real time and generates musical elements, while Wekinator uses machine learning to recognize user-drawn graphics and trigger sounds.

Figure 1. Images used in training

Figure 2. Connecting Processing and Wekinator in real-time via OSC control

Figure 3. Creating sounds by growing flower's height

Figure 4. An example of a created song: School Bell