tag:blogger.com,1999:blog-9048879464910781933.post1492065966245516762..comments2023-10-12T00:25:24.119-07:00Comments on Talking Brains: Does stimulation of motor lip areas affect categorical perception of lip related speech sounds?Greg Hickokhttp://www.blogger.com/profile/16656473495682901613noreply@blogger.comBlogger8125tag:blogger.com,1999:blog-9048879464910781933.post-3440425297168628292009-08-10T14:02:07.363-07:002009-08-10T14:02:07.363-07:00Hi Tom,
Responses to your comments below.
Tom sai...Hi Tom,<br />Responses to your comments below.<br /><br />Tom said: "If you think that TMS to lip cortex might simply be changing subjects' response bias, wouldn't you expect TMS to also change response bias for ka - da?"<br /><br />Yes, if it were a general bias, but biases could be item specific. See my response to Matt above for one possibility.<br /><br />Tom said: "1) TMS to motor cotex has no real consistent effect on the identification of speech sounds (small effect on one of two measures for expt. 1a, but none at all for expt. 2)."<br /><br />That is an important point. The paper really does depend on the discrimination data, which is one reason I focused on it. Without the discrimination result you have an effect that didn't replicate.<br /><br />Tom said: "it's possible that subjects used a rehearsal strategy to make the discrimination decision (e.g. silently repeating the pair to themselves for comparison purposes). TMS to lip cortex would presumably interfere with this strategy and therefore change accuracy rates."<br /><br />This is actually what I suspect might be happening. We need confirmation using d-prime, but my guess is the experiment worked: stimulation to lip areas decreased the ability to discriminate ambiguous speech sounds. But as you suggest, I think the TMS is interfering with articulatory coding which is used in a strategic manner: subjects hear stimulus #1 and recode it into a motor representation which is then compared against stimulus #2. TMS decreases the capacity to recode the stimuli in a motor effector specific manner (a cool effect) and performance falls off. But we still need to know what the data are before we spend too much time speculating about how to interpret them.Greg Hickokhttps://www.blogger.com/profile/16656473495682901613noreply@blogger.comtag:blogger.com,1999:blog-9048879464910781933.post-5697818316021775102009-08-10T10:10:00.166-07:002009-08-10T10:10:00.166-07:00Hi Matt,
I don't think I've gone too far....Hi Matt,<br /><br />I don't think I've gone too far. First let me address your second point: you argue that we can infer FA rate from "different responses" in the within-category conditions. But we already know the FA rate. What we are missing is the hit rate for *category boundary* stimuli -- i.e., the ones that are the most ambiguous and therefore most subject to bias -- so this doesn't help.<br /><br />More importantly you ask how can TMS affect bias only for lip sounds, and doesn't this invoke a "motoric contribution" to syllable discrimination? Well, it suggests a motor contribution either to syllable perception or response bias - we can't tell which. <br /><br />How could motor lip areas contribute to response bias? I'm not sure. I do know that lots of things can affect bias. For example, I could have induced the same pattern of response (fewer different responses) by changing the subject's incentive only for lip-related sounds (S loses $1 for every incorrect "different response" on lip-related trials). Does this mean there is a "monetary contribution" to lip-related syllable discrimination? Presumably this manipulation doesn't affect the "perception" of lip-sounds, only the decision criteria. <br /><br />So what if the "motoric contribution" to this task is to influence decision criteria rather than to modulate acoustic perception? Maybe subjects generate a motor-based prediction upon hearing the first stimulus in the pair. Because the stimulus is ambiguous, this prediction reflects their bias. This prediction may then influence the decision criteria upon hearing the second sound (or it could actually modulate the acoustic response -- we need a d-prime analysis to determine this though). Now with TMS applied, the motor prediction is disrupted and the bias is changed thus changing the response criteria and the proportion of "different responses." All of this could happen even without affecting perceptual discriminability. <br /><br />This is just off-the-cuff speculation, but again, once we have the facts about whether perception or bias has been affected by TMS we can develop theories about what is going on.<br /><br />No let me throw the question back to you. Suppose a d-prime based analysis showed that discriminability didn't change following TMS. Doesn't this completely change the interpretation of this study despite the motor specificity of the effect on proportion of different responses?Greg Hickokhttps://www.blogger.com/profile/16656473495682901613noreply@blogger.comtag:blogger.com,1999:blog-9048879464910781933.post-38093043429895577402009-08-10T08:37:25.603-07:002009-08-10T08:37:25.603-07:00Hi Riikka,
Thanks for your comment. By looking a...Hi Riikka,<br /><br />Thanks for your comment. By looking at the number of different responses at the category boundary versus within category, you can indeed conclude the TMS affected something. But my point was that you can't tell *what* it affected. It could have affected only the subjects' response bias and not the acoustic perception of the sounds. <br /><br />How could stimulation affect bias only at the category boundary? Think of the boundary as an acoustically ambiguous region and the within category region as acoustically unambiguous. Bias will have a much stronger effect under ambiguous conditions and a weak or even negligent effect for unambiguous conditions: if I'm not sure what I heard, my bias strongly influences my decision, if I'm sure of what I heard, this overrides my bias. <br /><br />So you can conclude that TMS affected performance at the boundary of a categorical perception task, but you can't conclude that it affected the perceptual discrimination. You simply can't tell from the data. Did you not collect responses to same trials? I think I missed that in reading your paper.Greg Hickokhttps://www.blogger.com/profile/16656473495682901613noreply@blogger.comtag:blogger.com,1999:blog-9048879464910781933.post-15078859348931823712009-08-10T08:13:22.549-07:002009-08-10T08:13:22.549-07:00Hi Greg,
If you think that TMS to lip cortex migh...Hi Greg,<br /><br />If you think that TMS to lip cortex might simply be changing subjects' response bias, wouldn't you expect TMS to also change response bias for ka - da?<br /><br />SDT issues aside, my reading of this paper is that;<br /><br />1) TMS to motor cotex has no real consistent effect on the identification of speech sounds (small effect on one of two measures for expt. 1a, but none at all for expt. 2).<br /><br />2) TMS to lip cortex does seem to have a real effect on discrimination performance for lip/tongue articulated speech sounds.<br /><br />As you have pointed out before, discrimination doesn't necessarily equate to perception; it's possible that subjects used a rehearsal strategy to make the discrimination decision (e.g. silently repeating the pair to themselves for comparison purposes). TMS to lip cortex would presumably interfere with this strategy and therefore change accuracy rates. I suppose the EMG data recorded during the decision period might help to answer this point. More convincing to me would be if someone combined TMS with a mismatch paradigm, i.e. attempt to show that the mismatch response to lip/tongue deviants (but not VOT deviants) is attenuated after TMS to lip cortex.Tomnoreply@blogger.comtag:blogger.com,1999:blog-9048879464910781933.post-33290279944380512762009-08-10T05:36:18.934-07:002009-08-10T05:36:18.934-07:00Greg,
I would like to point out that you ignored ...Greg,<br /><br />I would like to point out that you ignored half of our data in your comment. In our paper, we reported proportions of “different responses” to both across- and within-category pairs (see Table 2). I agree with you that it is impossible to “tell whether TMS affected the perception of speech sounds or the subjects’ response biases” by analyzing the proportions of “different responses” to across-category pairs only. Therefore, we also reported responses to within-category pairs. Our conclusion that TMS affected categorical perception of speech sounds is supported by both halves of the data. <br /><br />Our results show that during the discrimination task subjects’ gave fewer “different responses” to lip-related across-category pairs (ba-ga and pa-ta) in the post-rTMS condition than in the pre-rTMS condition (see Table 2). In contrast, the proportions of “different responses” to within-category pairs (e.g. ba-ba, pa-pa) did not change (see Table 2).<br /><br />The lack of change in proportions of “different responses” to within-category pairs is really important, because it gives evidence against the possibility that rTMS affected subjects’ response biases. Let’s assume that our subjects’ were biased to give “different responses” in the pre-rTMS condition and to give “same responses” in the post-rTMS condition. As a result of this change in biases, there should be fewer “different responses” in the post-rTMS condition to all stimulus pairs (i.e., to both across- and within-category pairs). In this case it would be indeed wrong to conclude that rTMS affected perception of speech sounds. Importantly, our results showed a decrease in proportions of “different responses” to across-category pairs but not to within-category pairs. These results are in conflict with the assumption that subjects’ response biases changed. Therefore, we concluded that rTMS affected categorical perception of speech sounds. <br /><br />Best wishes,<br />Riikka.riikkahttps://www.blogger.com/profile/01417409101412543201noreply@blogger.comtag:blogger.com,1999:blog-9048879464910781933.post-14355025958122707462009-08-10T04:45:59.991-07:002009-08-10T04:45:59.991-07:00Hi Greg,
It’s good to see a posting on this inter...Hi Greg,<br /><br />It’s good to see a posting on this interesting and important paper. <br /><br />However, I think that you’ve gone too far in the first line of your blog post:<br /><br /><i> Does stimulation of motor lip areas affect categorical perception of lip related speech sounds? Short answer: We don't know. </i><br /><br />I’m not going to criticise you for being a methods curmudgeon. Our field needs more reviewers that read papers carefully and assess whether the science is done correctly, not just whether the right scientists are listed in the citations.<br /><br />However, I think that you’re wrong to suggest that Mottonen and Watkin’s data can be dismissed based on the lack of signal detection analysis alone for the following two reasons: <br /><br />1) Even if response bias contributes to the effect observed, this doesn’t explain why the effect of response bias is somatopically specific. Why should lip TMS stimulation alter response bias for /ba/-/da/ and /pa/-/ta/ but not for /ka/-/ga/ within the same experiment? I can’t see any way to explain this without invoking a motoric contribution to the perception of syllables containing phonemes produced using those articulators.<br /><br /> 2) There are some practical constraints that I’m sure explain why M&W didn’t include trials containing acoustically-identical syllable pairs in their discrimination test. There is insufficient time before the rTMS effect wears off to do all the tests that one could ideally do in one single experiment. Personally, I’d be interested in the Ganong effect and perceptual learning, but I’m sure that other scientists can think of other tests that could be run.<br /><br />For the present data, however, the lack of “same” syllable trials makes it difficult but not impossible to apply Signal Detection analysis. We can make the assumption that the False Alarm rate is simply the proportion of responses in which participants say “different” to within-category pairs. This data is reported in Table 2, and so based on that we can derive the following:<br /><br />Lip (Expt 1a): d' Pre d' Post<br /><br />/ba/–/da/ 1.45 0.91<br /><br />/ka/–/ga/ 2.18 2.17<br /><br /><br />Hand (Expt 1b): d' Pre d' Post <br /><br />/ba/–/da/ 1.55 1.99<br /> <br />/ka/–/ga/ 2.00 1.68<br /><br /><br />Lip (Expt 2): d' Pre d' Post <br /><br />/pa/–/ta/ 1.70 1.36<br /><br />/da/–/ga/ 1.18 1.42<br /><br />That is, d’ shows a numerical decline in the critical predicted conditions and an increase or no change in the comparison cases. M&W could run statistics on d’ values derived from their original data. However, even if this analysis was not significant this would not alter their conclusions. It would only show that the TMS effect is not on “perceptual sensitivity” alone, but also on “response bias”. As I explained above I don’t think that their conclusions are even slightly altered if the effect is in part due to articulator-specific effects on response bias.<br /><br />Like you, though, I’d still be interested to see the outcome of this analysis from M&W as future studies might be interested in pulling apart perceptual and response effects. <br /><br />Matt DavisMatt Davishttps://www.blogger.com/profile/09804714627115834197noreply@blogger.comtag:blogger.com,1999:blog-9048879464910781933.post-36462745458842774062009-08-08T11:16:07.100-07:002009-08-08T11:16:07.100-07:00Hi Aryld, the main point about the two alternative...Hi Aryld, the main point about the two alternative forced choice task (the identification task) is that it too is subject to bias. Suppose I told subjects I would pay them $100 for each correct "ba-identification". This would induce a bias toward ba responses. Even without an incentive subjects may come with there own biases. SDT methods can correct these biases. There are d-prime look up tables for these kinds of designs.<br /><br />For CP though it is not clear what to count as a ba or a pa since boundaries (or biases) vary from subject to subject. I'll have to thunk about that more.<br /><br />More on this soon.Greg Hickokhttps://www.blogger.com/profile/16656473495682901613noreply@blogger.comtag:blogger.com,1999:blog-9048879464910781933.post-78462348340080904342009-08-08T08:40:10.349-07:002009-08-08T08:40:10.349-07:00What about the categorization task? I don't se...What about the categorization task? I don't see how that version of the experiment and the data can be fit into a SDT concept. Sure, in the same-different task, "different" trials can be thought of as representing the "signal" trials, where "change"="signal" and "same" trials represent no signal. (But I already find it a bit of a stretch to categorize this as "detecting a signal in noise".)<br /><br />But the categorization task is symmetrical. So suppose I hear a stimulus in category A and say so, then it's a HIT. If I hear A say B, it's a MISS. But if I hear B and say A, it's arbitrary to label this as a false alarm. Or vice versa. So what about the categorization part of the experiment? If those data are analyzed with non-D' methods and doesn't converge with your D' analysis, then what? Those two tasks are always presented as two sides of the same coin, so they should come out with same inferences.<br /><br /><br />(Btw, this is my first blog ever..)Anonymoushttps://www.blogger.com/profile/11004947975643850040noreply@blogger.com