LITF-PA-2026-068 · Cybersecurity / Speech Processing / Edge AI

System and Method for Real-Time Detection of Synthetic Speech During Telephony Sessions Using Glottal Pulse Irregularity Analysis and Personalized Speaker Biometric Baselines on Edge Devices

Visualization of natural vs synthetic glottal pulse waveform analysis on a smartphone
⚖️ Prior Art Notice: This document is published as defensive prior art under 35 U.S.C. § 102(a)(1). The inventions described herein are dedicated to the public domain as of the publication date above. This disclosure is intended to prevent the patenting of these concepts by any party.

Abstract

Disclosed is a system and method for detecting AI-generated synthetic speech in real time during live telephone calls by analyzing the micro-irregularity structure of glottal pulses extracted from the incoming audio stream. Natural human speech is produced by the quasi-periodic opening and closing of the vocal folds, a biomechanical process governed by the nonlinear dynamics of mucosal wave propagation across asymmetric vocal fold tissue. This process generates inherent cycle-to-cycle variations in fundamental frequency (jitter, typically 0.5-1.0% in healthy speakers), amplitude (shimmer, typically 0.2-0.5 dB), and glottal pulse shape (open quotient variation, closing velocity asymmetry) that are chaotic in the mathematical sense: deterministic but aperiodic, with correlation dimensions between 2.0 and 4.5. Current neural vocoders (HiFi-GAN, VITS, BigVGAN, Vocos) generate speech by predicting mel-spectrograms frame-by-frame and synthesizing audio through learned upsampling networks, producing glottal pulses that are systematically too regular because the frame-level prediction architecture inherently smooths the high-frequency stochastic components of vocal fold biomechanics. The system extracts glottal pulse trains from telephony audio using iterative adaptive inverse filtering (IAIF), computes a 14-dimensional micro-irregularity feature vector per 2-second analysis window, and classifies the incoming speech as natural or synthetic using a lightweight temporal convolutional network. A personalized enrollment module builds speaker-specific jitter-shimmer-shape profiles from known authentic calls, enabling per-caller verification. The system runs entirely on-device on consumer smartphones, requiring no cloud connectivity, and operates within the audio processing pipeline of standard telephony codecs.

Field of the Invention

This invention relates to telecommunications security and speech signal processing, specifically to real-time detection of AI-generated synthetic speech during live telephone calls using biomechanically grounded analysis of glottal source signal micro-irregularities on edge computing devices.

Background

Voice phishing (vishing) attacks using AI-cloned voices represent one of the fastest-growing categories of financial fraud. The FTC reported that impostor scams cost U.S. consumers $2.7 billion in 2023, with phone-based attacks accounting for the highest per-incident losses ($1,480 median). NCC Group demonstrated in 2024 that real-time voice deepfakes can now operate with sub-500ms latency using consumer GPUs, enabling attackers to impersonate any individual during a live phone conversation with no perceptible delay.

Current voice cloning services require as little as 3 seconds of reference audio to produce a convincing clone. ElevenLabs, Resemble AI, and open-source tools like GPT-SoVITS have made high-quality voice cloning accessible to non-technical users. The convergence of real-time operation and minimal enrollment audio creates an acute threat to telephony-based identity verification used by financial institutions, government agencies, and personal communications.

Existing deepfake audio detection approaches have significant limitations:

The fundamental weakness shared by spectral approaches is that they target artifacts of current synthesis technology rather than invariant properties of natural speech production. As vocoders improve, spectral artifacts diminish. The gap in the art is a detection method grounded in the biophysics of vocal fold vibration, targeting a signal that becomes paradoxically easier to detect as synthesis quality improves: the absence of biomechanically authentic micro-irregularity in the glottal source signal.

Detailed Description

1. Biomechanical Basis: Why Natural Speech is Irregular

Human speech production begins with airflow from the lungs passing through the glottis, where the vocal folds oscillate to produce a quasi-periodic excitation signal. The vocal folds are layered structures consisting of the epithelium, lamina propria (superficial, intermediate, and deep layers), and the thyroarytenoid muscle. During phonation, the mucosal wave propagates from inferior to superior across the vocal fold surface, with the medial edge closing in a zipper-like motion from anterior to posterior.

The cycle-to-cycle variations in this process arise from well-characterized biomechanical sources. The viscoelastic properties of the lamina propria exhibit nonlinear stress-strain behavior, where tissue stiffness depends on displacement history (hysteresis), creating deterministic chaos with Lyapunov exponents in the range of 0.2-0.8 bits per glottal cycle (Titze, 2000, Principles of Voice Production). Asymmetry between left and right vocal folds (mass differences of 5-15%, stiffness differences of 10-20%) produces subharmonic coupling, where the left fold's closing event perturbs the right fold's opening phase on the subsequent cycle. Mucus rheology affects fold contact mechanics in a time-varying manner dependent on hydration state, producing shimmer patterns that drift over timescales of 10-60 seconds. Neural control jitter from the recurrent laryngeal nerve introduces motor unit firing irregularities at 2-8 Hz that modulate fold tension.

These sources produce measurable acoustic signatures:

2. Why Neural Vocoders Produce Over-Regular Glottal Pulses

Modern neural vocoders operate by predicting audio waveforms from mel-spectrogram representations. The mel-spectrogram captures spectral envelope information at a temporal resolution of 10-25 ms (hop size 256-512 samples at 22,050 Hz). This frame-level representation fundamentally cannot encode the within-frame cycle-to-cycle micro-variations of the glottal source, because a single mel-spectrogram frame spans 2-5 glottal cycles for typical speaking fundamental frequencies (85-255 Hz).

Specific vocoder architectures exhibit characteristic regularity signatures:

The paradox: as vocoders improve at matching spectral envelopes, formant structures, and prosodic contours, they typically become more regular at the glottal pulse level because their training objectives (multi-scale spectral loss, adversarial feature matching loss) reward perceptual similarity at timescales of 10-50 ms while being agnostic to cycle-to-cycle variation at 3-12 ms timescales. A vocoder that explicitly injected random jitter would need to match the specific statistical structure (power-law distribution, long-range autocorrelation, cross-correlation between jitter and shimmer sequences) of human vocal fold biomechanics, not merely add Gaussian noise.

3. Glottal Pulse Extraction via Iterative Adaptive Inverse Filtering

The system extracts the glottal source signal from the speech waveform using iterative adaptive inverse filtering (IAIF), a technique that separates the glottal excitation from the vocal tract filter. IAIF operates on 40 ms analysis frames with 10 ms hop size, performing 4 iterations of: (a) estimating the vocal tract transfer function via linear prediction (LP order = 2 × number of expected formants + 4, typically 14-18 for narrowband telephony), (b) inverse filtering the speech signal with the estimated vocal tract filter to obtain a glottal flow estimate, (c) estimating the glottal spectral tilt via first-order LP of the glottal flow estimate, and (d) canceling the glottal tilt from the original signal before re-estimating the vocal tract.

For telephony audio (8 kHz narrowband or 16 kHz wideband AMR), the LP order is reduced to 10-12 and the analysis frame to 30 ms to match the reduced bandwidth. The IAIF algorithm converges in 3-4 iterations, requiring approximately 0.8 MFLOPS per frame at 8 kHz, well within the capabilities of mobile DSP hardware.

Individual glottal pulses are then segmented from the estimated glottal flow derivative (dEGG-equivalent) using negative peak detection with adaptive thresholding. Each detected closing instant marks the boundary between consecutive glottal cycles.

4. Micro-Irregularity Feature Vector

From the segmented glottal pulse train, the system computes a 14-dimensional micro-irregularity feature vector over a sliding 2-second analysis window (approximately 200-500 glottal cycles at typical speaking F0):

  1. Relative jitter (%): Mean absolute cycle-to-cycle period difference, normalized by mean period.
  2. Jitter distribution kurtosis: Kurtosis of the distribution of period differences. Natural speech: leptokurtic (kurtosis 4-8). Synthetic: mesokurtic (kurtosis 2.5-3.5).
  3. Jitter power-law exponent (α): Slope of the power spectral density of the jitter sequence on a log-log scale. Natural speech: α ≈ 1.2-1.8 (1/f-like). Synthetic: α ≈ 0.1-0.5 (white-noise-like if jitter is injected) or α > 2.5 (over-correlated if jitter arises from upsampling artifacts).
  4. Shimmer (dB): Mean absolute cycle-to-cycle amplitude difference in decibels.
  5. Shimmer Hurst exponent: Estimated via detrended fluctuation analysis of the shimmer sequence. Natural speech: H ≈ 0.65-0.75 (long-range correlated). Synthetic: H ≈ 0.45-0.55 (uncorrelated or weakly correlated).
  6. Jitter-shimmer cross-correlation (lag 0): Pearson correlation between the jitter and shimmer sequences. Natural speech: r ≈ 0.15-0.35 (weak positive coupling from shared biomechanical origin). Synthetic: r ≈ -0.05 to 0.05 (independent if separately generated).
  7. Open quotient coefficient of variation (%): Standard deviation of open quotient divided by mean, expressed as percentage.
  8. Closing quotient asymmetry index: Skewness of the distribution of closing phase durations. Natural speech: slight negative skew (occasional delayed closures from mucus stranding). Synthetic: near-zero skew.
  9. Glottal pulse shape correlation decay rate: Rate at which the autocorrelation of consecutive glottal pulse waveform shapes decays. Natural speech: slow decay (τ ≈ 15-40 cycles) due to slowly varying fold hydration. Synthetic: fast decay (τ ≈ 3-8 cycles) if shape variation is noise-injected, or near-zero decay if shapes are templated.
  10. Subharmonic energy ratio: Ratio of energy at F0/2 and F0/3 to energy at F0, reflecting left-right fold asymmetry coupling. Natural speech: -25 to -15 dB. Synthetic: below -35 dB or absent.
  11. Maximum Lyapunov exponent of period sequence: Estimated from the jitter time series using the Rosenstein algorithm. Natural speech: λ ≈ 0.2-0.8 bits/cycle (chaotic). Synthetic: λ ≈ 0.0-0.1 (periodic or quasi-periodic).
  12. Correlation dimension (D2): Grassberger-Procaccia estimate from the jitter time series embedded in 3-7 dimensional delay space. Natural speech: D2 ≈ 2.0-4.5. Synthetic: D2 < 1.5 or undefined (insufficient complexity).
  13. Recurrence quantification entropy: Shannon entropy of the diagonal line length distribution in a recurrence plot of the period sequence. Natural speech: high entropy (2.5-4.0 bits). Synthetic: low entropy (0.5-1.5 bits) due to repetitive structure.
  14. Harmonic product spectrum peak sharpness: Width of the F0 peak in the harmonic product spectrum relative to the -3 dB bandwidth. Natural speech: broader peak (fractional bandwidth 0.02-0.04) due to jitter spreading. Synthetic: sharper peak (fractional bandwidth 0.005-0.015).

5. Classification Architecture

A lightweight temporal convolutional network (TCN) processes sequences of micro-irregularity feature vectors to classify the incoming speech as natural or synthetic. The TCN architecture comprises: an input projection layer (14 → 32 channels), 4 dilated causal convolutional blocks (dilation factors 1, 2, 4, 8; kernel size 3; 32 channels each; with residual connections and layer normalization), a global average pooling layer, and a binary classification head (32 → 1, sigmoid activation).

Total parameter count: approximately 18,000 (72 KB at FP16, 36 KB at INT8). Inference latency: < 2 ms per 2-second window on a Qualcomm Hexagon 698 DSP (Snapdragon 8 Gen 3) or Apple Neural Engine (A17 Pro). The model updates its classification every 500 ms using a sliding window with 75% overlap, providing quasi-continuous monitoring throughout the call.

Training data is sourced from: natural speech corpora (VCTK, LibriSpeech, Common Voice) processed through IAIF to extract ground-truth glottal features; synthetic speech generated by 12+ vocoder architectures (HiFi-GAN, VITS, BigVGAN, Vocos, WaveGlow, WaveRNN, LPCNet, Encodec, SoundStream, XTTS, Bark, and F5-TTS) to ensure cross-vocoder generalization; and telephony-degraded versions of both sets processed through AMR-NB (4.75-12.2 kbps), AMR-WB (6.6-23.85 kbps), EVS (5.9-128 kbps), and Opus (6-510 kbps) codecs to match real-world telephony conditions.

6. Personalized Speaker Enrollment

The system maintains an on-device speaker profile database. When a user receives calls from known contacts, the system accumulates glottal micro-irregularity statistics from verified authentic calls (those the user has manually marked as genuine or that occurred before the system detected any anomaly). After 60+ seconds of accumulated authentic speech from a contact, the system builds a personalized 14-dimensional baseline distribution for that speaker.

Subsequent calls from the same contact (identified by caller ID, though the system explicitly does not trust caller ID as an authentication mechanism) are compared against the stored baseline using Mahalanobis distance. Natural variation in a speaker's glottal features across calls is bounded: test-retest jitter varies by ±0.15% relative, shimmer by ±0.08 dB, and shape features by ±5-8% over periods of weeks. These variation bounds are substantially tighter than the natural-vs-synthetic gap (which is typically 2-5x the inter-session variation), enabling per-speaker authentication even for callers with atypically regular or irregular baseline phonation.

The personalized baseline addresses edge cases where generic classification may fail: speakers with vocal pathologies (nodules, polyps) who have naturally elevated jitter and shimmer, speakers with trained voices (singers, voice actors) who may have lower-than-typical irregularity, and speakers with neurological conditions affecting laryngeal motor control.

7. Telephony Codec Interaction

Telephony codecs (AMR, EVS, Opus) perform lossy compression that modifies the fine temporal structure of speech. The system accounts for codec-induced perturbation through two mechanisms:

First, codec-aware feature normalization: the system detects the active codec from the audio characteristics (AMR-NB codecs produce characteristic spectral nulls above 3.4 kHz; EVS and Opus exhibit codec-specific pre-emphasis curves) and applies codec-specific normalization factors derived from calibration data. AMR-NB at 12.2 kbps increases measured jitter by approximately 0.08% and shimmer by 0.06 dB relative to uncompressed audio. These offsets are stable and can be compensated.

Second, codec-robust feature selection: features 11-14 (Lyapunov exponent, correlation dimension, recurrence entropy, HPS peak sharpness) are computed from longer time series (200+ cycles) and are inherently robust to the sample-level perturbations introduced by lossy codecs, because they characterize statistical structure at the cycle-to-cycle level rather than the sample level. These features serve as the primary detection signal when codec degradation is severe (AMR-NB at 4.75 kbps).

8. System Integration and User Interface

The system integrates as a background service on the smartphone operating system, hooking into the telephony audio processing pipeline via platform-specific APIs (Android AudioRecord with VOICE_CALL source, iOS CallKit audio session). Audio is processed in real time without recording or storing the call content. Only the extracted 14-dimensional feature vectors and classification results are retained.

When synthetic speech is detected, the system provides tiered alerts: a subtle visual indicator (colored border on the call screen) for low-confidence detections (classification probability 0.6-0.8), an audible chime injected into the user's earpiece for medium-confidence detections (0.8-0.95), and a prominent on-screen warning with vibration for high-confidence detections (>0.95). The system explicitly avoids automatically terminating calls, as false positives could disconnect legitimate callers.

A post-call summary is available showing a timeline of detection confidence throughout the call, with the option to report false positives/negatives for federated model improvement.

9. Figures Description

Claims

  1. A system for detecting synthetic speech during telephone calls, comprising: a glottal source extraction module that applies iterative adaptive inverse filtering to incoming telephony audio to estimate the glottal flow waveform; a pulse segmentation module that identifies individual glottal closing instants from the estimated glottal flow derivative; a micro-irregularity feature extraction module that computes a multi-dimensional feature vector characterizing cycle-to-cycle variations in fundamental period, amplitude, pulse shape, and nonlinear dynamical properties of the glottal pulse train; and a classification module that determines whether the incoming speech is natural or synthetic based on the extracted micro-irregularity features.
  2. The system of claim 1, wherein the micro-irregularity feature vector includes at least: relative jitter, jitter distribution kurtosis, jitter power spectral density slope, shimmer, shimmer Hurst exponent, jitter-shimmer cross-correlation, open quotient coefficient of variation, and maximum Lyapunov exponent of the period sequence.
  3. The system of claim 1, wherein the classification module comprises a temporal convolutional network with dilated causal convolutions processing sequences of feature vectors computed from overlapping analysis windows, enabling quasi-continuous detection throughout the telephone call.
  4. The system of claim 1, further comprising a personalized speaker enrollment module that accumulates glottal micro-irregularity statistics from verified authentic calls with known contacts, builds per-speaker baseline distributions, and compares subsequent calls against the stored baseline using statistical distance measures.
  5. The system of claim 4, wherein the personalized baseline comparison uses Mahalanobis distance and accounts for natural inter-session variation in glottal features, with speaker-specific variation bounds derived from the enrollment data.
  6. The system of claim 1, further comprising a codec-aware normalization module that detects the active telephony codec from audio characteristics and applies codec-specific normalization factors to compensate for codec-induced perturbations to glottal micro-irregularity features.
  7. The system of claim 1, wherein the system runs entirely on-device on a consumer smartphone, processing audio in real time within the telephony audio pipeline without recording, transmitting, or storing call audio content, and wherein the classification model has fewer than 50,000 parameters.
  8. A method for detecting AI-generated voice clones during live telephone conversations, comprising: extracting glottal source signals from incoming telephony audio using inverse filtering; segmenting individual glottal pulses from the estimated source signal; computing statistical measures of cycle-to-cycle irregularity including frequency perturbation distribution shape, amplitude perturbation long-range correlation structure, and nonlinear dynamical complexity of the pulse train; and classifying the speech as natural or synthetic based on the principle that neural vocoders produce systematically over-regular glottal pulses due to their frame-level prediction architecture.
  9. The method of claim 8, wherein detection effectiveness increases as neural vocoder quality improves, because higher-quality vocoders produce more spectrally accurate but more temporally regular glottal pulses, widening the micro-irregularity gap between natural and synthetic speech.
  10. The method of claim 8, further comprising: maintaining a speaker profile database on the device; for each known contact, building a personalized glottal irregularity baseline from accumulated verified authentic speech; and comparing incoming calls against the stored baseline to detect voice cloning attacks that target specific known contacts.
  11. The method of claim 8, wherein the extracted features include the power-law exponent of the jitter power spectral density, the Hurst exponent of the shimmer sequence, and the correlation dimension of the jitter time series, these three features being selected for their robustness to telephony codec degradation and their sensitivity to the fundamental difference between biomechanically generated and computationally generated glottal excitation.
  12. A smartphone application for protecting users from voice phishing attacks using AI-cloned voices, comprising: a background telephony audio processing service that operates during all incoming calls; a real-time glottal analysis engine that extracts and characterizes the micro-irregularity structure of the caller's glottal pulse train; a classification engine that outputs a continuous authenticity score reflecting the probability that the incoming speech is naturally produced; a tiered alert system that provides visual, auditory, and haptic warnings calibrated to the confidence level of synthetic speech detection; and a post-call summary interface showing detection confidence over the call timeline.

Implementation Notes

Reference implementations of the IAIF algorithm are available in the COVAREP toolkit (MATLAB/Octave) and ASVspoof toolkit (Python). Jitter and shimmer computation follows the standards defined in Praat (Boersma & Weenink), the reference tool for acoustic voice analysis. Lyapunov exponent estimation follows Rosenstein et al. (1993), with parameters: embedding dimension m=5, time delay τ=1 cycle, and divergence tracked over 10 cycles. Detrended fluctuation analysis for Hurst exponent estimation follows Peng et al. (1994).

For mobile deployment, the IAIF and feature extraction modules should be implemented in C/C++ using platform DSP libraries (Android: Oboe/AAudio with NEON SIMD; iOS: Accelerate framework with vDSP). The TCN classifier can be deployed via TensorFlow Lite, Core ML, or ONNX Runtime Mobile. Total memory footprint including model weights and feature buffers: approximately 2 MB.

Training data augmentation should include: telephone channel simulation (bandpass filtering, additive noise at 15-30 dB SNR, packet loss simulation), speaking style variation (read speech, spontaneous conversation, emotional speech), and environmental noise conditions (office, street, vehicle). The model should be evaluated on cross-corpus, cross-vocoder, and cross-codec test sets to validate generalization.

Prior Art References

  1. FTC Data Spotlight: Impostor Scams (2024) — $2.7B in consumer losses, phone-based attacks highest per-incident loss
  2. IEEE Spectrum: Real-Time Audio Deepfakes Have Arrived (2024) — NCC Group demonstration of sub-500ms voice cloning
  3. ElevenLabs Voice Cloning Platform — Commercial voice cloning with 3-second enrollment
  4. GPT-SoVITS — Open-source few-shot voice cloning and TTS
  5. Titze, I.R., Principles of Voice Production, 2nd ed. (2000) — Vocal fold biomechanics and nonlinear dynamics
  6. Kong, J., Kim, J., & Bae, J. (2020). HiFi-GAN — Generative adversarial network for speech synthesis
  7. Kim, J., Kong, J., & Son, J. (2021). VITS — Conditional variational autoencoder with adversarial learning
  8. Lee, S.-G., et al. (2023). BigVGAN — Large-scale universal vocoder with anti-aliased periodic activation
  9. Siuzdak, H. (2023). Vocos — Closing the gap between time-domain and Fourier-based neural vocoders
  10. Khanjani et al. (2024) — AI-assisted tagging of deepfake audio calls using challenge-response
  11. US20240089371A1 — Defensive deepfake for detecting live deepfaked audio and video
  12. WO2024220274A2 — Pindrop Security — Server-side deepfake detection for call centers
  13. Rosenstein et al. (1993) — Practical method for calculating largest Lyapunov exponents from small data sets
  14. Peng et al. (1994) — Mosaic organization of DNA nucleotides (detrended fluctuation analysis method)
  15. Praat: Doing Phonetics by Computer — Reference acoustic analysis software (Boersma & Weenink)
  16. COVAREP — Collaborative voice analysis repository with IAIF implementation
  17. ASVspoof Challenge Toolkit — Spoofing countermeasure evaluation framework