Works and composition tools
Graphic Score Generator
From sound description to graphic score. A 799-term morphological vocabulary on Schaefferian axes, FFT analysis of real sound, Bertin-style visual mapping.
- Author's contribution
- Concept of the morphological vocabulary, design and development.
- Data
- Audio files and microphone input are analysed in the browser, the app works offline.
The project
A tool for composing graphic scores from time-stamped textual sound descriptions. A bilingual morphological vocabulary of 799 terms in nine categories, rooted in Schaeffer and Smalley, maps sound descriptors (pitch, intensity, timbre, shape, motion, spatiality, duration, periodicity, density) onto shapes, colours and sizes on the canvas, following Bertin's visual variables.
Three rendering modes (spectromorphological, textural, articulated) and a playhead that scrolls the score for performance in class. FFT analysis of real sound (centroid, flatness, onset detection) works on an audio file or on the microphone, and the file plays back under the score, to compare the expected score with the actual sound. Export to PNG, vector SVG, JSON and PDF. Works offline and installs as an app.
Features
- 799-term morphological vocabulary in 9 categories
- 3 rendering modes
- FFT analysis from file or microphone
- Playhead for performing the score in class
- PNG/SVG/JSON/PDF export
- Offline and installable
Characteristics
- Audio
- Offline
Tech stack
- JavaScript
- Web Audio API
- Canvas
- PWA
Collaborations and research
If this work is relevant to your field, profile and contacts are on the main site.
Contact on francescomariano.art