sciscape Publications
← All publications

In 10 SEEG participants, spectral shape was decodable above a shift null, while standard r reflected the envelope

We analyzed SEEG and pitch-shifted audio from 10 people who read Dutch words aloud. A linear decoder (PCA-50 plus ordinary least squares) mapped high-gamma activity (70–170 Hz) to 23-bin log-mel spectrograms. The analysis plan was written before decoding. The standard mean-bin Pearson r was almost fully explained by a predicted envelope with constant spectral shape (median M1/M0 = 0.9995), so it did not establish spectral-content decoding. A within-speech spectral-shape metric (M3) exceeded a circular-shift null in all 10 participants (median 0.17; group Wilcoxon p = 0.00098), but shape-based word identification was not above the null (median top-1 accuracy 0.015; null 0.012; p = 0.16, 0.75, and 0.90 for SYM, PAST, and FUT). The standard r was higher for neural activity at or before the sound (PAST) than after it (FUT) in all participants (p = 0.0020). For M3, PAST exceeded FUT in 8 of 10, but the preregistered comparison was not significant (p = 0.064); shape was above the shift null in 10 of 10 PAST decoders and 5 of 10 FUT decoders. Exploratory single-lag peaks were between −200 and 0 ms. Results are limited to offline linear decoding of overt speech with pitch-shifted audio; PAST activity during overt speech can include feedback from earlier frames of the same word, and these results do not establish equivalent information during imagined or attempted speech. Each participant-level null used 20 shifts, limiting the minimum p to 0.048.

speech decoding · SEEG · high-gamma activity · spectral shape · speech brain-computer interface · log-mel spectrogram · circular-shift null · Dutch word production

Admitted 1 citing publication

References

4
  1. challengesThe standard SEEG spectrogram score measured speech envelope, while within-speech shape decoding was weak in one participant sci:sha256:d0f6e932be3ce4a7689876fd8e4bb3b99b4a2632c9b4971655bd5cfcc58b45dc

    The pilot proposed that spectral shape comes mainly from auditory feedback after the sound. In 10 participants, PAST is equal to or better than FUT, FUT shape is above the null in only 5 of 10, and single-lag peaks are at -200..0 ms.

  2. usesThe standard SEEG spectrogram score measured speech envelope, while within-speech shape decoding was weak in one participant sci:sha256:d0f6e932be3ce4a7689876fd8e4bb3b99b4a2632c9b4971655bd5cfcc58b45dc

    We use the metric definitions (M0-M3), lag sets and feature code of this pilot plan.

  3. In three SEEG participants, standard spectrogram r matched envelope-only decoding; spectral shape exceeded shift nulls but did not identify words sci:sha256:0a9d6f0825e1212203d528303c1e9fcdc93508a63778aa21ac3c115f2d945c1f

    [Legacy relation: reproduces] For sub-01..03 we get M3 SYM 0.202/0.131/0.230 (there 0.244/0.134/0.235) and M0 0.482/0.619/0.828 (there 0.484/0.628/0.820). We extend the result (M1 = M0, M3 above null, no word identification from shape) to 10 participants.

  4. usesCausal neural context yielded higher speech spectrogram scores in three SEEG participants sci:sha256:f87a783ff90af05ec65a5dd0e510c1e6bac04df76336cb3c05a5ab9d1ff6af33

    We use the reference high-gamma and log-mel feature pipeline (features_ref.py) without change.

Cited by

1 publication

Public catalog entries on Sciscape.