Multi Media Framework Client Overview

MMF (Multi Media Framework) provides a client API consisting of several interfaces that encapsulate a lightweight plugin framework enabling you to manipuate audio and video features of v7.0s.The features made available by the MMF API are:

• Audio playing, recording, and conversion - An interface consisting of three classes; CMdaAudioPlayerUtility, CMdaAudioRecorderUtility, and CMdaAudioConvertUtility. These classes provide methods to create, play, and manipulate audio data stored in files, descriptors, and URLs.

• Audio streaming - An interface consisting of two classes; CMdaAudioInputStream and CMdaAudioOutputStream. These classes provide methods for recording and playing audio streams such as audio from a web address.

• Tone playing - An interface consisting of a single class CMdaAudioToneUtility. This class provides methods for playing and configuring single and sequenced tones as well as DTMF (Dual Tone Multi-Frequency) strings.

• Video playing and recording - An interface consisting of two classes CVideoPlayerUtility and CVideoRecorderUtility. These classes provide methods to create, play, and manipulate video clips with or without audio tracks stored in files, descriptors, and URLs.

The MMF API interfaces are binary compatible with those of the v7.0 Media Server, but have been extended to provide the additional features included in the list above.

Note 1: A set of standard plugins have been written to provide equivalent audio support to that provided by the v7.0 Media Server.

Note 2: The video playing and recording interface uses a similar lightweight plugin framework as the audio interface, except that it does not provide any default plugins.

Shown below is a representation of how the MMF client API interfaces interact with the Multi Media Controller Framework and other components.

The player and recorder interfaces of both audio and video and also the audio converter interface uses the controller plugins provided by the multi media controller framework. These plugins provide the functionality to convert, interpret, and play audio and video data. The resultant data from one of these plugins can be directed to one or more sinks such as a file, or directly to screen or to a lower level audio device driver (DevSound).

The tone player and audio streaming APIs are also provided as part of the MMF but do not interact with controller plugins. Input and output from these APIs is already in a known data format and do not require a plugin for encoding or decoding. As a result, these APIs by-pass the controller framework.

Each component of the MMF Client API is listed below and described in greater detail by following the appropriate links.

• Multi Media Framework Client Overview (this page) - general overview of the various components of the MMF Client API and the functionality they provide.

• Audio Recording, Conversion and Playing - advanced audio file manipulation features; Specifically, the ability to record, convert, and playback sound clips as well as to manipulate meta data.

  • Audio Recording - Introduction to the audio recording class.

  • Audio Conversion - Introduction to the audio conversion class.

  • Audio Playing - Introduction to the audio playing class.

• Audio Streaming - The interface to the streaming sampled audio.

• Audio Tone Player - A simple interface for tone generation (synthesized sounds) that is supported on all audio-capable devices.

• Video Recording and Playing - Video manipulation features; Specifically, the ability to record and playback video clips as well as to manipulate meta data.

  • Video Recording - Introduction to the video recording class.

  • Video Playing - Introduction to the video playing class.