SOUND FOR MOBILE DEVICES: PHYSICAL MODELING AND PROGRAMMING
PREREQUISITES: Geometry, Algebra, basic knowledge of a programming language and interest in software tools for recording and analysis
INSTRUCTORS: Jim Simmons, Professor, Computer-assisted Recording/Director, Electronic Music Ensemble, Fullerton College; Dr. Martin Jaroszewicz, Ph.D. UC Riverside
How does sound work? What are the sound components of thunder and wind, a jet engine or a plucked string? Covering the physics of sound, materials and acoustics, this course introduces students to the latest research in sound analysis and synthesis applied to the latest iOS technology. Students will design, build and complete an educational iOS app that demonstrates the sound capabilities of mobile devices using mathematics, physics and programming skills to synthesize everyday sounds. Using software tools to perform waveform, spectral and physical analysis of everyday sounds, students will learn the basics of digital audio manipulation and how to create physical models that can be ported to mobile devices.
- Part 1 Physics of Sound and Digital Audio Manipulation: Audio manipulation and processing has undergone dramatic changes in recent history. For example, where once the manipulation of analog tapes required a large studio, now software Digital Audio Workstations (DAW) offer the requisite tools necessary to record, edit and mix different sources. Students will learn fluency in navigating a DAW using Open Source software including editing and techniques for capturing audio with microphones and portable field recorders. Using special audio analytical and editing software developed by the Institut de Recherche et Coordination Acoustique/Musique (IRCAM), the world’s leading research institution for the science of music and sound, students will perform waveform analysis, spectral analysis, study spatialization, psychoacoustics and various synthesis techniques including physical modeling.
- Part 2 iOS Application Development: The exponentially increasing use of mobile devices and smart phones in our daily life has changed the way we interact with our world. With a device that fits in our hand, it is possible to communicate, navigate to a destination, take a photograph and send it to a friend, record and create music, read a book and many other creative and/or productive tasks. These devices are becoming faster and robust enough to compete with laptops and desktops. Developers are shifting their focus to a different programming paradigm that prioritizes multi-touch, multi-user and gestural interactions on graphical display surfaces. Students will learn how to create a sound-oriented app working with the latest iOS SDK, the Objective-C and Swift computer languages, and a sound library for analysis and synthesis. Students will learn the process of designing, testing and debugging for mobile devices, general computer programing skills, specialized algorithms and formal logic.