.
MOBILE DIGITAL MEDIA: RESEARCH AND DEVELOPMENT OF MULTIMEDIA APPLICATIONS FOR MULTITOUCH TABLET DEVICES, FROM IDEA TO IMPLEMENTATION
PREREQUISITES: Algebra, familiarity with scripting language such as JAVA Script, LUA, C++ and familiarity with digital audio
INSTRUCTORS: Jim Simmons, MFA UC Irvine; Professor, Computer-assisted Recording, Cerritos College; Martin Jaroszewicz, Ph.D. Candidate; special area of interest: human interaction with new interfaces for multimedia and digital audio, UC Riverside; Professor Kojiro Umezaki, UCI Music Department; special area of interest: dynamic time warping

• Digital media has become an integral component of modern life. The use of various functional types of mobile device applications for work, time management or leisure, has risen, catering to a wide array of uses. Interaction with hand held computer devices has changed the fabric of human communication and interaction. This cluster will delve into two sections; first, the recording process of digital audio, learning how to record, edit, mix and master multi-track recordings for use in a mobile device using Apple Logic Digital Audio Workstation (DAW). Second, learning the computer language necessary for its composition culminating with the development of a mobile device application.
  
  
• Part 1 – Digital Audio Production
  Audio production has undergone dramatic changes in recent history. Where once recording required a large studio, now software Digital Audio Workstations (DAW) offer the requisite tools necessary to record, edit, mix and master both audio and Musical Instrument Digital Interface (MIDI) data. Students will learn fluency in navigating a DAW and its numerous interfaces, including techniques in recording audio using USB microphones, field recorders, and importing audio for editing. Once edited, students will mix audio and MIDI data using Digital Signal Processors (DSP) to enhance recorded material sound quality for delivery as a component of a mobile device application. Students will study panning, audio frequency spectrum, spatialization, synthesis (subtractive and frequency modulation), and psychoacoustics, as part of the recording process.
  
  
• Part 2 – iOS Application Development
  The exponentially increasing use of mobile devices and smart phones in our daily life has changed the way we interact with our world. With a device that fits in our hand it is possible to communicate, navigate to a destination, take a photograph and send it to a friend, record and create music, read a book and many other creative and/or productive tasks. These devices are becoming faster and robust enough to compete with laptops and desktops. Developers are shifting their focus to a different programming paradigm that prioritizes multi-touch, multi-user and gestural interactions on graphical display surfaces. In this cluster students will learn how to create a full-featured iOS multimedia application with an emphasis on sound and multitouch interactivity. Students will be exposed to the latest iOS SDK, the computer languages Lua and OpenAL, a 3D audio API. Students will learn the process of designing, testing and debugging for mobile devices, general computer programing skills, specialized algorithms and formal logic. Given its portability and speed, Lua is rapidly becoming the standard scripting language for making apps and video games for mobile devices. In addition Lua has been used to create software and games such as Adobe Photoshop Lightroom, World of Warcraft and SimCity. OpenAL has also become the standard for creating apps and games for mobile platforms given its portability; as a 3D audio tool it is possible to create and animate sounds in a 3D space in which the necessary algorithms as far as distance attenuation, Doppler effect, etc., are precisely calculated by the rendering engine.