--Raman
Note that speech style-sheets play the dual role of specifying how a document should be rendered aurally to a user who is functionally blind, i.e. is not currently looking at a visual display, and may also specify how a visual rendering should be augmented with sound cues to provide a truly multimodal rendering. Examples of situations where a user is functionally blind in terms of looking at the computer display include:
We adopt the more sophisticated solution of defining a separate (possibly cascaded) speech style-sheet so as to:
This said, an auditory browser is free to use the information provided by the standard visual stylesheet to augment the aural rendering where necessary. Thus, when rendering a well-written document that uses the emphasis tag to mark emphasized phrases, such an aural browser would use the speech properties specified for emphasis in the speech stylesheet. However, if a document uses layout specific tags such as <IT> an aural browser can fall back on a default rendering that maps specific speech properties to the visual layout tags. In general, the speech stylesheet will not attempt to specify the mapping between visual layout tags and speech properties, instead leaving it to specific browser implementations to decide how such tags are rendered.
In the following, we enumerate a collection of aural properties that allows designers to exploit the capabilities of a wide range of auditory displays. Implementors using simpler audio output devices are free to map properties specified by a style-sheet to audio properties that are available on a particular device. We provide this flexibility to allow a rich collection of aural renderings. The field of audio formatting is relatively new (see AsTeR --Audio System For Technical Readings for research defining some of the key notions in this area. Also see Janet Cahn's Masters Thesis entitled Generating Expression in Synthesized Speech (Copyright MIT 1990) for additional examples of varying speech synthesis parameters to produce interesting effects. Restricting the style sheet specification language to the constraints of lower quality devices would throttle research in this field.
Specifies the speaker volume for the left-channel. Devices not supporting stereo output may ignore this setting.
Specifies the speaker volume for the right-channel. Devices not supporting stereo output may ignore this setting.
Analogous to the :font-family property. This specifies the kind of voice to be used, and can be something generic such as male or something more specific such as comedian or something very specific such as paul. We recommend the same approach as used in the case of :font-family --the style sheet provide a list of possible values ranging from most to least specific and allow the browser to pick the most specific voice that it can find on the output device in use.
Specifies the speaking rate. If specified as a level, 5 is interpreted as medium.
Specifies the average pitch of the speaking voice in hertz (hz). The average pitch is the fundamental frequency of the speaking voice. Lowering it typically produces a deeper voice --increasing it produces a higher pitched voice. Listen to AsTeR rendering superscripts and subscripts for an example of this effect.
Specifies variation in average pitch. A pitch range of 0 produces a flat, monotonic voice. A pitch range of 100 produces normal inflection. Pitch ranges greater than 100 produce animated voices.
Less sophisticated speech output devices specify a simple prosody setting that acts as a toggle that sets this value to either 0 or 100.
Specifies the level of stress (assertiveness or emphasis) of the speaking voice. English is a stressed language, and different parts of a sentence are assigned primary, secondary or tertiary stress. The value of property :stress controls amount of inflection that results from these stress markers. Different speech devices may require the setting of one or more device-specific parameters to achieve this effect.
Increasing the value of this property results in the speech being more strongly inflected. It is in a sense dual to property :pitch-range and is provided to allow developpers to exploit higher-end auditory displays. The resulting voice sounds excited or animated.
Specifies the richness (brightness) of the speaking voice. Different speech devices may require the setting of one or more device-specific parameters to achieve this effect.
The effect of increasing richness is to produce a voice that carries --reducing richness produces a soft, mellifluous voice. For an example of continuously reducing richness listen to AsTeR rendering a continuous fraction
Note: In the above example of a continuous fraction the voice also grows more animated --this is a result of increasing the value of property :stress.
Allows implementors to experiment with features available on specific speech devices. The use of this property is device-specific, but is provided as an escape mechanismsince auditory displays are not yet as standardized as their visual counterparts. Implementors are encouraged to use this property only where absolutely necessary. In many cases, the desired effect can be abstracted using the properties defined earlier and having the device-specific component of the browser map a single abstract property to a collection of device specific properties.
In general, we expect document specific style sheets to completely avoid this escape mechanism to ensure that documents remain device-independent. User-specific and UA-specific local stylesheets may choose to use this facility to enhance the presentation.
Pause can be used to great effect in conveying structural information. Experience with AsTeR (Audio System For Technical Readings) has shown that small amounts of pause --5 to 20 milliseconds-- can prove perceptually significant and aid in the grouping of mathematical subexpressions. listen to AsTeR rendering simple fractions where pauses are used effectivley to convey grouping.
Specifies the number of milliseconds of silence to insert before rendering a document element. In situations where the :pause-before intersects the :pause-after of the preceding document element, we compute the amount of pause to insert in a manner similar to that used to compute the amount of intervening whitespace in producing visual renderings.
Specifies the number of milliseconds of silence to insert after rendering a document element.
Specifies the number of milliseconds of silence to insert before and after rendering a document element. Though this effect can be achieved by using :pause-before and :pause-after in conjunction, style-sheet designers are encouraged to use :pause-around where appropriate since it makes the intent clearer. Perhaps :before :after and :around should be modifiers so they can be generally applied to other property settings?
Specify the pronunciation mode to be used when speaking a document element. Pronunciation modes can include
:speak-military-timeand
:speak-am-pmetc.
The device-specific component of a browser is expected to map those values that it does not understand to a suitable default. Alternatively, the device-specific component of the browser may choose to transform the contents of the document element to a form that is suitable to be rendered by the specific device. To give an example:
Consider the value date-string. Given a content string of the form Jan 1, 1996 an aural browser could:
speak datemode.
Language to use when rendering the contents of the document element. Specified by using the appropriate ISO encoding for international languages.
Specified using ISO encoding for specifying country codes. Can be used in conjunction with :language to specify British or American English. (See property :dialect below for variations in speaking style within a country.) This property will be useful for multilingual speech devices capable of switching between languages.
Specifies the dialect to be used, e.g.: american-mid-western-english.
Specifies a file containing sound data. The sound is played before rendering the document element to produce an auditory icon. An optional :cue-volume can specify a volume scaling to be applied to the sound before playing it.
Specifies a file containing sound data. The sound is played after rendering the document element to produce an auditory icon. An optional :cue-volume can specify a volume scaling to be applied to the sound before playing it.
Specifies a file containing sound data. The sound is played around rendering the document element to produce an auditory icon. An optional :cue-volume can specify a volume scaling to be applied to the sound before playing it.
Specifies a file containing sound data. The sound is played repeatedly during rendering the document element to produce an auditory icon that provides an aural backdrop.
three-dimensional sound.