ParsVoice: A Large-Scale Multi-Speaker Persian Speech Corpus for Text-to-Speech Synthesis

Basic Information

• Paper ID: 2510.10774
• Title: ParsVoice: A Large-Scale Multi-Speaker Persian Speech Corpus for Text-to-Speech Synthesis
• Authors: Mohammad Javad Ranjbar Kalahroodi, Heshaam Faili, Azadeh Shakery (University of Tehran)
• Categories: cs.SD (Sound), cs.AI (Artificial Intelligence), cs.HC (Human-Computer Interaction), cs.LG (Machine Learning)
• Publication Date: October 14, 2025 (arXiv v2)
• Paper Link: https://arxiv.org/abs/2510.10774

Abstract

Existing Persian language speech datasets are typically significantly smaller than their English counterparts, creating critical limitations for developing Persian speech technologies. This paper addresses this gap by introducing ParsVoice, the largest-scale Persian speech corpus specifically designed for text-to-speech (TTS) applications. The research team developed an automated pipeline to convert raw audiobook content into TTS-ready data, incorporating a BERT-based sentence completeness detector, a binary search boundary optimization method for precise audio-text alignment, and an audio-text quality assessment framework customized for Persian. The pipeline processed 2,000 audiobooks, yielding 3,526 hours of clean speech, further filtered to 1,804 hours of high-quality subset containing 470+ speakers. To validate the dataset, the team fine-tuned XTTS for Persian, achieving a naturalness Mean Opinion Score (MOS) of 3.6/5 and a speaker similarity MOS (SMOS) of 4.0/5.

Research Background and Motivation

Problem Definition

1. Data Scarcity Issue: Persian, spoken by over 100 million people globally, severely lacks representation in speech corpora compared to high-resource languages such as English.
2. TTS-Specific Requirements: Text-to-speech systems have different data quality requirements than automatic speech recognition (ASR) systems. While ASR can benefit from noisy real-world data, TTS requires clean and precisely aligned audio-text pairs to generate natural speech.
3. Limitations of Existing Datasets:
   • DeepMine+: 480+ hours, 1850+ speakers, but with commercial restrictions
   • DeepMine-Multi-TTS: 120 hours, 67 speakers
   • ArmanTTS: 9 hours, single speaker
   • ManaTTS: 86 hours, single speaker

Research Significance

Persian data scarcity extends beyond speech to text processing, creating cascading effects across multiple Persian language processing domains, including speech-to-text alignment systems, optical character recognition (OCR) models, and others, severely hindering the development of Persian language technologies.

Core Contributions

1. Construction of the largest publicly available Persian TTS corpus: Containing 1,804 hours of high-quality speech data with 470+ distinct speakers, representing a 10-fold increase compared to existing Persian resources
2. Development of a scalable automated data construction pipeline:
   • BERT-based sentence completeness detection
   • Binary search boundary optimization algorithm
   • Persian-specific quality assessment framework
3. Implementation of phoneme-free Persian TTS: Achieving high-quality speech synthesis without explicit phoneme transcription through fine-tuning the XTTS model
4. Provision of open-source dataset: Complete dataset publicly released to advance Persian speech technology development

Methodology Details

Task Definition

Converting raw audiobook audio into high-quality TTS training data, including:

• Input: Raw audiobook audio files and corresponding text
• Output: Segmented audio-text pairs with accurate temporal alignment and quality scores
• Constraints: Maintaining sentence integrity, ensuring audio quality, enabling speaker identification

Automated Corpus Construction Pipeline

1. Data Collection and Source Selection

• Data Source: IranSeda platform (book.iranseda.ir)
• Scale: 3,800+ audiobooks with multi-category coverage
• Quality: Professional narrators, controlled recording environment, 44.1 kHz sampling rate
• Copyright: Publicly accessible, no copyright restrictions

2. Intelligent Audio Segmentation

Sentence Completeness Detection Model:

• Binary classifier fine-tuned on ParsBERT
• Training data: Complete Persian sentences and synthetically generated incomplete sentences
• Performance: F1 score of 97.4%

Three-Stage Segmentation Process:

1. Acoustic Boundary Detection: Using WebRTC voice activity detection (VAD)
2. Transcription and Alignment: Google Speech-to-Text API transcription
3. Linguistic Validation: BERT classifier detects sentence completeness, with boundary expansion in 0.1-second increments when necessary

3. Boundary Optimization Algorithm

Two-Stage Search Strategy:

1. Initial Adjustment: Removing 3 seconds from beginning and end
2. Stability Verification: Checking transcription discrepancies
3. Binary Search Optimization: Iteratively halving trimming intervals
4. Fine-Grained Linear Search: 0.1-second increment precision alignment

4. Text-Audio Quality Assessment

Persian Text Quality Framework:

• Character Quality: Proportion of valid Persian characters and numerals
• Length Quality: Sentence length appropriateness assessment
• Repetition Score: Vocabulary diversity rewards
• Phoneme Coverage: Range of Persian characters and phonemes

Audio Quality Framework:

• Signal-to-noise ratio estimation
• Dynamic range analysis
• Spectral features and MFCC variance
• Clipping, silence, and background music detection

5. Speaker Identification

Two-Stage Identification Process:

1. Local Speaker Separation: Clustering based on ECAPA-TDNN embeddings
2. Global Speaker Identification: Cross-book speaker unification

Technical Innovations

1. Sentence-Aware Segmentation: Combining acoustic boundary detection with linguistic completeness verification
2. Adaptive Boundary Optimization: Efficient algorithm combining binary search with linear fine-tuning
3. Persian-Specific Quality Assessment: Multi-dimensional quality assessment framework tailored to Persian characteristics
4. Scalable Processing Pipeline: Automated pipeline capable of processing thousands of hours of audio content

Experimental Setup

Dataset Statistics

• Raw Data: 3,807 books (9,538 hours), with 2,000 books actually processed
• Initial Segmentation: 5,158,344 audio segments
• After Filtering: 3,321,212 valid segments
• Final Dataset:
  • Total: 3,526 hours, 470+ speakers
  • TTS Subset: 1,804 hours of high-quality data

Evaluation Metrics

• Subjective Evaluation:
  • Naturalness MOS (1-5 scale)
  • Speaker similarity SMOS (1-5 scale)
  • Text accuracy score
• Objective Evaluation:
  • Word error rate (WER) and character error rate (CER)
  • ECAPA-TDNN embedding cosine similarity

Comparison Methods

• FastSpeech2 End-to-End
• FastSpeech2 Cascaded
• Other Persian TTS systems (ManaTTS, DeepMine-Multi-TTS, etc.)

Implementation Details

• Model: XTTS multilingual TTS model
• Training: BPE model training with 2,500 new Persian tokens
• Fine-tuning: Batch size 16, 170,000 steps
• Evaluation: 90 synthesized samples, 40 evaluators

Experimental Results

Main Results

Objective Evaluation Results

• WER: 22.57%
• CER: 12.78%
• Speaker Similarity: 80% (based on ECAPA-TDNN embeddings)
• Text Accuracy: 4.0/5 (human evaluation)

Dataset Quality Analysis

• Boundary Optimization Effect: Removed 442.73 hours (11.2%) of unnecessary silence and noise
• Segmentation Statistics: 81.0% of segments required beginning trimming, 50.4% required ending trimming
• Average Segment Duration: 5.49 seconds (optimal for TTS training)
• Linguistic Diversity: 267,965 unique words, 25,499,474 tokens

Speaker Identification Accuracy

• Detected Speakers: 1,815 unique speaker instances
• Gender Distribution: Approximately 33% female, 67% male
• Consistency: 97.0% consistency with known narrator labels

Related Work

English Speech Datasets

• LibriSpeech: Large-scale ASR corpus
• LJSpeech: Single-speaker TTS dataset
• VCTK: Multi-speaker English corpus

Multilingual Efforts

• Common Voice: 20+ languages, but insufficient Persian quality
• Multilingual LibriSpeech: Biased toward European languages
• VoxPopuli: Variable quality across language communities

Persian TTS Research

• Traditional methods require explicit phoneme representation
• Existing datasets are small-scale and predominantly single-speaker
• Commercial restrictions hinder research development

Conclusions and Discussion

Main Conclusions

1. Successfully constructed the largest publicly available Persian TTS corpus containing 1,804 hours of high-quality speech data
2. Developed a fully automated and scalable dataset construction pipeline applicable to other low-resource languages
3. Validated dataset effectiveness achieving competitive performance on Persian TTS tasks

Limitations

1. Automatic evaluation metrics may underestimate quality: Due to limited commercial STT system support for Persian synthesized speech data
2. Imbalanced speaker distribution: Higher proportion of male speakers (67% vs 33%)
3. Audio quality dependent on source material: Limited by original audiobook recording quality

Future Directions

1. Extension to other low-resource languages: Applying the pipeline to additional languages
2. Improved quality assessment framework: Developing more accurate automatic evaluation metrics
3. Enhanced speaker diversity: Balancing gender and age distribution
4. Multimodal extension: Incorporating visual information in speech synthesis

In-Depth Evaluation

Strengths

1. Significant Scale Improvement: Achieving 10-fold increase compared to existing Persian resources, filling an important gap
2. Technical Innovation:
   • Novel and effective BERT-based sentence completeness detection
   • Efficient and practical binary search boundary optimization algorithm
   • Strong targeted Persian-specific quality assessment framework
3. Comprehensive Experimentation:
   • Combined subjective and objective evaluation
   • Comparison with multiple baseline methods
   • Detailed dataset analysis and statistics
4. Open-Source Contribution: Complete dataset publicly released to advance community development
5. Method Reproducibility: Detailed description of each pipeline step

Weaknesses

1. Limited Evaluation Scope:
   • Validation on only one TTS model (XTTS)
   • Lack of direct comparison with other large-scale multilingual datasets
2. Quality Assessment Subjectivity:
   • Quality assessment framework weights based on empirical settings
   • Lack of comparative validation with human annotation quality
3. Insufficient Technical Details:
   • Speaker identification threshold selection lacks detailed explanation
   • Limited implementation details of quality assessment framework

Impact

1. Academic Impact:
   • Provides important resources for low-resource language TTS research
   • Advances Persian speech technology development
   • Offers reusable dataset construction methodology
2. Practical Value:
   • Directly supports Persian TTS application development
   • Reduces digital divide between Persian and high-resource languages
   • Provides foundational data for commercial speech applications
3. Reproducibility: Open-source release and detailed methodology description ensure research reproducibility

Applicable Scenarios

1. Direct Applications:
   • Persian TTS system training
   • Persian adaptation of multilingual TTS models
   • Speech synthesis quality assessment research
2. Extended Applications:
   • Dataset construction for other low-resource languages
   • Speech processing pipeline development
   • Cross-lingual speech technology research

References

This paper cites 18 important references covering:

• Transformer architecture foundations (Vaswani et al., 2017)
• English speech datasets (LibriSpeech, LJSpeech, VCTK)
• Multilingual speech resources (Common Voice, VoxPopuli)
• Persian NLP tools (ParsBERT)
• Modern TTS technology (XTTS)
• Speaker identification technology (ECAPA-TDNN)

Overall Assessment: This is a high-quality resource paper that addresses the important resource scarcity problem by constructing a large-scale Persian TTS corpus. The methodology demonstrates moderate innovation but strong practicality, with sufficient experimental validation and significant implications for Persian speech technology development. The open-source release further enhances its academic and practical value.