Syllable Lab

Synthetic Voice Evaluation

A Fixed 60-Second Passage for Comparing Text-to-Speech Prosody: Design and Limitations

By the Syllable Lab editors / / 6 min read

Short answer. A fixed 60-second passage makes text-to-speech comparisons more repeatable by giving every voice the same linguistic material and prosodic challenges. It should include varied sentence structures, punctuation, names, numbers and emphasis opportunities, while keeping its limitations visible: one short passage cannot represent every speaking style, language or listening context.

Key points

  • Identical text creates a more controlled starting point for comparing synthetic voices.
  • A useful passage contains several kinds of stress, phrasing, punctuation and pronunciation challenges.
  • Sixty seconds is long enough to reveal some recurring patterns but too short to establish general voice quality.
  • Listening notes should separate audible observations from assumptions about how a system generated its speech.

Why a fixed passage improves comparison

Comparing text-to-speech systems is difficult when each voice receives different material. A dramatic sentence may make one system sound expressive, while a sequence of short instructions may favor another. A fixed passage controls the linguistic input. When the wording, punctuation and intended pronunciation remain constant, listeners can concentrate on differences in timing, emphasis, articulation and voice quality. This creates a more useful basis for evaluating synthetic voice behavior than selecting unrelated demonstration clips.

The method is especially helpful when choosing natural sounding text to speech for narration, education or accessibility. Naturalness is not a single acoustic property. A voice may pronounce every word clearly yet place stress awkwardly, pause at an unexpected point or flatten the distinction between a question and a statement. A controlled passage gives these features opportunities to become audible. It does not eliminate subjective judgment, but it makes the conditions behind that judgment easier to describe.

The design of a 60-second passage

A practical passage should contain approximately 120 to 145 words, depending on the intended speaking rate and the amount of silence between phrases. At 135 words per minute, a 135-word passage takes approximately one minute to deliver before additional pauses. The timing is an editorial target, not a universal requirement. Some narration styles need more space, while conversational speech may move faster.

The passage should move through several linguistic conditions without sounding like an artificial collection of pronunciation exercises. For example, begin with two straightforward declarative sentences, introduce a longer sentence with subordinate clauses, include a direct question, and finish with a sentence that contains a contrastive emphasis opportunity. This arrangement provides changes in phrase length, information structure and expected intonation.

  • A short declarative sentence with familiar vocabulary.
  • A longer sentence with two or more meaningful phrase boundaries.
  • A direct question and a sentence containing a parenthetical phrase.
  • One personal or place name with a documented intended pronunciation.
  • A number, a time expression and a contrasting pair of words.

What the passage should make audible

Stress is one of the first properties to consider. English uses lexical stress to distinguish word patterns and sentence stress to organize information. For example, the contrast between 'I wanted the blue folder' and 'I wanted the blue folder' can change depending on which word receives emphasis. A passage should include at least one context in which the intended focus is reasonably clear. Listeners can then note whether the synthetic voice emphasizes the relevant word or distributes prominence evenly.

Pausing deserves equally careful attention. Commas, periods, parentheses and clause boundaries provide different kinds of information, but punctuation alone does not specify exact silence duration. A useful listening note identifies where a pause occurs, whether it interrupts a grammatical unit and whether its duration seems proportionate to the surrounding phrase. Breath-like sounds may also matter for expressive narration, although a synthetic voice can sound natural without imitating every feature of human breathing.

  • Lexical stress and sentence-level emphasis.
  • Pitch movement at statements and questions.
  • Pause placement around clauses and punctuation.
  • Consistency of vowel and consonant articulation.
  • Pronunciation of names, numbers and abbreviations.

A reusable example passage

Consider a passage about a community archive preparing a new listening collection. The subject is ordinary enough to avoid forcing an exaggerated performance, but it allows names, numbers, questions and contrasting information to appear naturally. A sample could read: 'The archive opens its new listening room on Thursday. Visitors can explore recordings from the harbor, the old market and the northern railway station. Some files are less than a minute long, while others contain several speakers and overlapping conversations. The collection includes a recording by Elena García, whose family name is pronounced carefully in the original interview. Should the first caption appear before or after the speaker finishes? That decision affects how comfortably a listener can follow the exchange. The team has selected twelve recordings, but only three will be introduced during the opening session. The shorter selection is deliberate: each recording needs enough space for its details to become clear.'

This example contains 91 words, so it is a component of a longer passage rather than a complete 60-second script. It can be extended with another 40 to 50 words that introduce a contrast, a date or a second speaker. The important point is to preserve natural syntax. Adding random tongue twisters or dense strings of numbers may create pronunciation challenges, but it also changes the task into something closer to a speech exercise than a narration comparison.

Listening observations and interpretation

A comparison becomes more useful when listeners record observations in consistent categories. Instead of writing that a voice sounds robotic, identify the audible property: every clause receives nearly identical pitch movement, a pause separates an article from its noun, or the final word of each sentence receives excessive emphasis. These descriptions can be revisited by another listener and linked to particular words or timestamps.

A simple observation table can include the passage segment, the expected behavior, the audible behavior and a note about its possible effect on comprehension. For example, a question might be expected to have an intonational pattern that supports its conversational function. If the pitch movement is difficult to interpret, record that uncertainty. The goal is to distinguish the sound itself from an explanation of why it occurred.

  • Record the same passage version for every comparison.
  • Keep speaking-rate and voice settings documented.
  • Use timestamps to locate specific prosodic events.
  • Separate pronunciation errors from unusual but intelligible accents.
  • Repeat listening with the surrounding sentence included.

The limitations of short-form evaluation

A fixed minute of speech cannot represent the full range of a voice system. It may contain no emotional dialogue, technical terminology, code-switching, long-form narration or sustained character performance. A voice that handles a short explanatory paragraph smoothly may become tiring over an audiobook chapter. Likewise, one accent-specific pronunciation example cannot establish how the same system handles an entire regional variety.

The text itself also influences what listeners hear. English spelling does not consistently reveal pronunciation, and the same word may change stress or meaning across contexts. A passage written for one dialect or audience may favor certain pronunciation conventions. Evaluation should therefore identify the intended language variety, speaking purpose and audience before conclusions are drawn. Product behavior can also depend on available voice settings, supported languages and the version in use.

Turning the passage into a repeatable method

A useful comparison begins with a documented script, a defined target duration and a small set of listening questions. Save the passage as plain text, preserve punctuation and record any pronunciation guidance supplied to the system. Keep delivery settings consistent wherever possible. If a product does not expose a setting, record that limitation instead of assuming an equivalent default. This keeps the comparison interpretable when the same method is used later.

After listening, write one observation about stress, one about pausing and one about pronunciation. Add an example with a timestamp for each observation. This modest structure discourages broad judgments based on a single attractive sentence. It also makes disagreements productive: two listeners can identify the same phrase and explain why they interpreted its timing differently. Begin by drafting a 120-to-145-word passage and checking that every intended prosodic feature has a clear place in its context.

Questions readers ask

How many words should a one-minute TTS passage contain?

Approximately 120 to 145 words is a useful starting range for moderate English narration. The final duration depends on speaking rate, articulation and pauses, so word count should be treated as a planning estimate.

Should every system receive identical pronunciation instructions?

The same intended pronunciations should be documented for every system. Where pronunciation controls differ, record the available instructions separately so the resulting comparison retains its context.

Can a fixed passage reveal whether a voice is suitable for audiobooks?

It can identify potential issues with phrasing, stress and listening comfort, but sustained narration introduces additional demands. A longer sample should include dialogue, descriptive passages and transitions between paragraphs.

Why include numbers in a prosody passage?

Numbers reveal how a voice handles units, dates, times and numerical sequences. They also expose differences in phrasing, especially when a number appears inside a longer sentence.

Related reading