This cluster was formerly titled MOBILE DIGITAL MEDIA. In 2014 there are some revisions to our description. If you apply to Cluster 5, you are applying to our newly revised cluster: “Computer Models of Sounds for IOS APPS ...”
COMPUTER MODELS OF SOUND FOR IOS APPS, WITH AN EXPLORATION OF DIGITAL SOUND AND MULTI-TOUCH USER INTERFACES
PREREQUISITES: Geometry, Algebra. Basic knowledge of a programming language and interest in software tools for recording and analysis
INSTRUCTORS: Jim Simmons, Professor, Computer-assisted Recording, Cerritos College; Martin Jaroszewicz, Ph.D. Candidate, Digital Music, UC Riverside
How does sound work? What are the sound components of thunder and wind, a jet engine or a plucked string? Covering the physics of sound, materials and acoustics, this course introduces students to the latest research in sound analysis and synthesis applied to the latest iOS technology. Students will design, build and complete an educational iOS app that demonstrates the sound capabilities of mobile devices using mathematics, physics and programming skills to synthesize everyday sounds. Using software tools to perform waveform, spectral and physical analysis of everyday sounds, students will learn the basics of digital audio manipulation and how to create physical models that can be ported to mobile devices.
- Part 1 Physics of Sound and Digital Audio Manipulation
Audio manipulation and processing has undergone dramatic changes in recent history. For example, where once the manipulation of analog tapes required a large studio, now software Digital Audio Workstations (DAW) offer the requisite tools necessary to record, edit and mix different sources. Students will learn fluency in navigating a DAW using Apple Logic Pro X including editing and techniques for capturing audio with microphones and portable field recorders. Using open source audio plug ins, students will perform waveform analysis, spectral analysis, study spatialization, psychoacoustics and various synthesis techniques including physical modeling.
- Part 2 iOS Application Development
The exponentially increasing use of mobile devices and smart phones in our daily life has changed the way we interact with our world. With a device that fits in our hand, it is possible to communicate, navigate to a destination, take a photograph and send it to a friend, record and create music, read a book and many other creative and/or productive tasks. These devices are becoming faster and robust enough to compete with laptops and desktops. Developers are shifting their focus to a different programming paradigm that prioritizes multi-touch, multi-user and gestural interactions on graphical display surfaces. Students will learn how to create a sound-oriented iOS application. Students will be exposed to the latest iOS SDK, the Objective-C computer language and a sound library for iOS that uses Pure Data, a visual object-oriented programing language for sound analysis and synthesis. Students will learn the process of designing, testing and debugging for mobile devices, general computer programing skills, specialized algorithms and formal logic.