Saturday, April 1, 2017

International Multisensory Research Forum in Nashville, TN - Abstract Submissions Open!

The 18th International Multisensory Research Forum (IMRF) is returning to the United States for the first time since 2009, and will be held at Vanderbilt University in Nashville, Tennessee, from Friday, May 19th through Monday, May 22nd.

This annual gathering of the international multisensory research community provides a platform for scientists from around the world to highlight research investigating the neural processes across multiple sensory modalities and their impact on perception and behavior. This meeting is a rich, multidisciplinary forum for cognitive scientists, neuroscientists, psychologists, and others, and is an exceptional opportunity for these individuals to present and discuss the most recent work in the field.  Areas of major emphasis include clinical disorders, cognition, computational modeling, decision-making, development, neuroanatomy, neuroimaging, physiology, and speech and language processing.

Abstract submission deadline is Wednesday, April 5th, 2017.
We will send notifications for abstracts selected to be talks on Wednesday, April 19th, 2017.

The program will feature 7 symposia, plus graduate student and post doc talk sessions. 
Featured speakers:
·       Robert J. Zatorre, PhD, McGill University
·       Charles E. Schroeder, PhD, Columbia University
·       Adam Gazzaley, MD, PhD, University of California, San Francisco 

For full conference information and to register, please visit our website at

If you have any questions, please e-mail

Friday, March 31, 2017

Guest blog post from Dial & Martin on Dual Stream models

The following is a guest post from Heather Dial and Randi Martin.  

Greg Hickok has noted several positive aspects of our recent paper but also claims that we have misunderstood the dual stream model and that our findings are, in fact, consistent with this model. We wish to respond to his arguments focusing on two main points: claims of the dual stream model and implications of our data.

Regarding the dual stream model
In this blog post, Hickok argues that we have misunderstood the dual stream model claims regarding sublexical processing. However, we argue that there is a lack of clarity in Hickok and Poeppel’s claims regarding the dual stream model, with statements across different articles seeming to imply different functions that are shared prior to divergence into the dorsal and ventral routes. We will highlight this point with a series of examples. In the 2007 paper, on p. 394, Hickok and Poeppel note that “there is the computational operations leading up to and including the generation of sublexical representations.” If this were the entirety of the claims made by Hickok and Poeppel, then we agree that our findings are perfectly compatible with the dual stream model. However, in referencing the 2000 paper, it is not clear that the claim has always been that sublexical processing is shared. In fact, even the quote he takes from the abstract of the 2000 paper does not argue for sublexical processing as a requirement, but rather for shared auditory processing. In the 2000 paper (p. 131), Hickok and Poeppel expand by stating that:

“auditory related cortical fields in the posterior half of the superior temporal lobe, bilaterally, constitute the primary substrate for constructing sound-based representations of speech. From this point, however, we will argue that there are at least two distinct pathways that participate in speech perception in a task-dependent manner”

In our paper, we emphasize that sublexical processing refers to the processing of abstract, speech-specific representations. The “sound-based representations” that Hickok is referring to in the abstract for the 2000 paper are not necessarily speech-specific.
Moving past the 2000 paper to more recent instantiations of the dual stream model, it remains unclear what processing is shared. The figure that is placed in the blog post comes from the 2007 paper, and Hickok refers to the phonological processing portion (shaded yellow) as evidence that the dorsal and ventral streams share a sublexical processing level. However, on p. 398, Hickok and Poeppel note in a discussion of the superior temporal sulcus, the proposed site of the phonological network, that “STS activation can be modulated by the manipulation of psycholinguistic variables that tap phonological networks, such as phonological neighborhood density.” We would note that phonological neighborhood density is considered a lexical-level variable (e.g., Luce & Pisoni, 1998; Vitevitch & Luce, 1998; Vitevitch & Luce, 1999; Vitevitch, Luce, Charles-Luce & Kemmerer, 1997), which makes it sound like processing in this area is lexical rather than sublexical.  Yet another perspective seems to come from the Vaden, Piquado, & Hickok (2011) paper, that Hickok references in the blog.  Vaden et al. state on p. 2665, “The current study aimed to functionally identify sublexical phonological activity during spoken word recognition.”  This was done by examining the brain regions sensitive to phonotactic frequency in spoken word recognition. They found that this manipulation modulated activity in Broca’s area and not in superior temporal lobe regions. They conclude on p. 2672, “This finding… is more consistent with speech perception models in which segmental information is not explicitly accessed during word recognition.” We had interpreted this perhaps too broadly as implying that sublexical processing in general is not explicitly accessed, though as Hickock notes, it is possible that sublexical units other than phonemes might necessarily be involved (e.g., syllables) in word recognition.  However, such a possibility appears  yet to be tested in a fashion to distinguish segmental and syllable-level representations.  It should be emphasized, however, that other researchers have found that activation in the superior temporal lobe does respond to sublexical manipulations (see Dial & Martin, p. 205).

We wish to reiterate that if the dual route model’s claim is that the phonological network instantiates a sublexical processing level, then our findings are wholly compatible with this claim. If the current debate serves to clarify the issue of what phonological processes are argued to be shared prior to divergence into the two streams, then that will be a step forward.

Regarding our data and the use of syllable discrimination to tap sublexical processing
In addition to the theoretical issue of shared sublexical processing, our paper raised an important methodological issue regarding whether syllable discrimination predicts lexical processing, as might be expected if lexical processing depends on sublexical processing (particularly so if syllables serve as the unit of sublexical phonological coding). Hickok and Poeppel have largely discredited the use of this task in assessing speech perception. For example, Hickok and Poeppel (2004, p.74) state:
“Sub-lexical tasks (syllable discrimination/identification) presumably represent an attempt to isolate and study the early stages in this normal comprehension process, that is, the acoustic– phonetic analysis and/or the sub-lexical processing stage. The paradox, of course, stems from the fact that patients exist who cannot accurately perform syllable discrimination/identification tasks, yet have normal word comprehension: if sub-lexical tasks isolate and measure early stages of the word comprehension process, deficits on sub-lexical tasks should be highly predictive of auditory comprehension deficits, yet they are not. What we suggest is that performance on sub-lexical tasks involves neural circuits beyond (i.e. a superset of) those involved in the normal comprehension process. This is an important observation because there are many studies of the functional anatomy of ‘speech perception’ that utilize sub-lexical tasks. Because sub-lexical tasks recruit neural circuits beyond those involved in word comprehension, the outcome of such studies may paint a misleading picture of the neural organization of speech perception, as it is used under more normal listening conditions.” [emphasis added]

And, Hickok and Poeppel (2007, p. 394) note that:

“the use of sublexical tasks would seem to be a logical choice for assessing these sublexical processes, except for the empirical observation that speech perception and speech recognition doubly dissociate.”

However, we would argue that tasks like syllable discrimination are valid assessments of sublexical processing that can be highly predictive of lexical processing. The behavioral double dissociations that Hickok and Poeppel refer to have most often been derived from studies in which the perceptual discriminations required in the sublexical tasks were much more difficult than those in the lexical tasks (e.g., single distinctive features in the sublexical discrimination task, and no phonological overlap with distractors in a picture-word matching task, as in the WAB word recognition subtest). When sublexical and lexical tasks are matched in the required discriminations, then performance on the two is highly related (e.g., our correlation between syllable discrimination and word discrimination for matched stimuli was .96). We did find, however, as pointed out in this blog post, that even though performance on picture-word matching and syllable discrimination were highly correlated (r=.86), two patients performed significantly better on our picture to word matching (PWM) task than on our syllable discrimination task and that our control group performed better on the PWM task than the syllable discrimination task. Hickok argues that this is consistent with claims regarding the tasks tapping partially shared and partially different processes. On this point, we do not disagree. Our findings that controls performed better on the PWM task than the syllable discrimination suggest that the PWM task is easier than the syllable discrimination task. In other words, the PWM and syllable discrimination tasks were not appropriately matched. We believe that one important difference lies in the fact that the PWM task allows the participant to generate an internal phonological code for the picture which they can then compare to the auditory input. We thus created the auditory-written syllable matching (AWSM) task that allows for this same internal generation of a phonological code, thus matching task demands between the sublexical and lexical processing tasks. In addition, AWSM and PWM require maintenance of a single auditory percept to compare to a single picture or written syllable, whereas in the syllable discrimination task two items must be maintained. The AWSM was indeed easier than the syllable discrimination task, and almost all of the patients and the control group  performed better on the AWSM than syllable discrimination task.
Thus, our findings argue that as long as you match tasks demands and perceptual discriminability across sublexical and lexical tasks, syllable discrimination is a perfectly reasonable measure of sublexical processing, which can predict performance on a lexical task to a high degree.  It should be the burden of the researcher to design carefully matched tasks to isolate processes of interest. Specifically regarding the findings at hand, our results support the use of a standard syllable discrimination task as a predictor of lexical processing.

Wednesday, March 22, 2017

Misunderstandings of the Hickok & Poeppel Dual Stream framework: Comments on Dial & Martin 2017

A recent paper by Dial & Martin (DM) presents some interesting data on the relation between performance on a range of different speech perception tasks including some that have been the topic of discussion on this blog and in many of my papers.  These include syllable discrimination and auditory comprehension among others.  I have argued in several papers with David Poeppel and others that these two tasks differentially engage the dorsal (syllable discrimination) and ventral streams (comprehension).  DM sought to test this claim by testing how well these tasks hang together or dissociate in a group of 13 aphasic patients.  Their primary claim is that performance on sublexical and comprehension tasks largely hang together in contrast to previous reports of double dissociations. They suggest the discrepancy is due to better controlled stimuli in their experiment compared to past studies. DM's experiments are really nicely done and generated some fantastic data.  I don't think their conclusions about the dual stream model follow, however, because they get the dual stream model wrong.

First a comment on their data, focusing on the syllable discrimination and word picture matching tasks  (their Experiment 2a) as these are the poster-child cases.  DM report a strong correlation between performance on these tasks.  It indeed looks quite strong.  But they also report that two patients (18%) performed significantly better on the auditory comprehension task compared to the discrimination task. The control group did the same: significantly better on comp than disc.  So this is consistent with claims that these tasks are tapping into partially shared, partially different processes, as Hickok &  Poeppel (HP) have claimed.  

Do these findings lead to a rejection of part of the HP dual stream framework claims?  DM say yes. Here's a couple quotes from their concluding remarks:
5.2. Concluding comments on implications for dual route models 
Though dual route models with a specific neuroanatomical basis like that of Hickok and Poeppel have been proposed relatively recently (Hickok and Poeppel, 2000), cognitive models of language processes with a dual route framework (though typically without a specified neural basis) are common in the neuropsychological literature, particularly for reading and repetition (e.g., Coltheart et al., 2001; Dell et al., 2007; Hanley et al., 2004; Hanley and Kay, 1997; Hillis and Caramazza, 1991; McCarthy and Warrington, 1984; Nozari et al., 2010). Critically, many of these models assume that sublexical processing is shared between the two routes and the routes do not become activated until after sublexical processing occurs. A similar approach could be applied in the speech perception domain. That is, one might assume that there are separable routes for translation to speech output and for accessing meaning, but assume that sublexical processing is shared by the two routes and must be accomplished before processing branches into the separate routes. 
... In summary, the current study provides support for models of speech perception where processing of sublexical information is a prerequisite for processing of lexical information, as is the case in TRACE (McClelland and Elman, 1986), NAM (Luce and Pisoni, 1998) and Shortlist/MERGE (Norris, 1994; Norris et al., 2000). On the other hand, we failed to find support for models that do not require passage through sublexical levels to reach lexical levels, such as the episodic theory of speech perception (e.g., Goldinger, 1998) or dual route models of speech perception (Hickok and Poeppel, 2000, 2004, 2007; Hickok, 2014; Poeppel and Hickok, 2004; Majerus, 2013; Scott and Wise, 2004; Wise et al., 2001).  [emphasis added]
The problem with these conclusions is that this characterization of the HP dual route framework is inaccurate.  We do not claim that the system does not require passage through sublexical levels.  Rather, we specifically propose a phonological (not lexical) level of processing/representation that is shared between the two routes, as is clear in our figure from HP 2007 (yellow shading).

This is not a new feature of the HP framework.  Our claim of a shared level of representation between dorsal and ventral streams goes back to our 2000 paper.  From the abstract:
In this review, we argue that cortical fields in the posterior–superior temporal lobe, bilaterally, constitute the primary substrate for constructing sound-based representations of speech, and that these sound-based representations interface with different supramodal systems in a task-dependent manner. [emphasis added]
To restate, we proposed one sound-based (not lexically based) speech network located in the STG region that interfaces with two systems in a task dependent manner.  This clearly predicts associations between tasks if the functional damage is in the shared region and dissociations if the functional damage is in one stream or the other.  Both patterns should be found and DM's study confirms this.

So where did the idea that HP propose that speech recognition/comprehension can skip the sublexical level?  They quote one of my papers with former student, Kenny Vaden, as support for this assumption:
For example, Vaden et al. (2011) state that: [sublexical] information is only represented on the motor side of speech processing and…[is] not explicitly extracted or represented as a part of spoken word recognition (p. 2672). 
But this is misleading especially when you look at the term that DM replaced with their bracketed [sublexical] term.  Here's the full quote from this paper:
Our findings are more in line with the view that segment level information is only represented explicitly on the motor side of speech processing and that segments are not explicitly extracted or represented as a part of spoken word recognition as some authors have proposed (Massaro, 1972).  -Vaden et al. 2011
Two things to note here.  One is that Vaden et al. are noting that the findings we reported were more in line with theories that did not specifically implicate segmental representations in speech recognition; we were not making a claim about the position of the dual stream model of HP.  Second and more importantly, there is a difference between sublexical and segmental.  Sublexical means things that are below the level of the word, which includes segments but also syllables or pieces of syllables. In recent years I have leaned more and more toward the view that segmental units are not represented on the perceptual/recognition side of speech processing as the Vaden et al. quote suggests.  (David's position is different, by the way, I think.)  But this view of mine does not imply that sublexical information isn't processed in the STG and shared between the two streams.  I believe it is!  And DM's findings are perfectly compatible with this view.

Moreover, the HP claim has little to do with the nature of the representation and more to do with the process.  Notice that we don't say that the dorsal stream is more involved in sublexical representations, we say that it is more involved in sublexical tasks.  It is about the task driven cognitive/metalinguistic/ecologically invalid processes that are invoked most strongly by sublexical tasks, what we called "explicit attention" in HP2000:
Tasks that regularly involve these extra-auditory left hemisphere structures [i.e., the dorsal stream] all seem to require explicit attention to segmental information.  Note that such tasks are fundamentally different from tasks that involve auditory comprehension: when one listens to an utterance in normal conversation, there is no conscious knowledge of the occurrence of specific phonemic segments, the content of the message is consciously retained. 
So, the reason why the dorsal stream gets involved in syllable discrimination is that it is a task that requires attentional mechanisms that aren't normally involved in normal speech recognition and the network over which these attentional mechanisms can best operate is the sensorimotor dorsal stream network.

The problem with tasks like syllable discrimination is NOT that they can't assess the integrity of the perceptual analysis/representational system in the STG/STS, it is that you can't tell whether deficits on that task are coming from perceptual problems or metalinguistic attentional (or working memory) problems.  It's interesting to see how various speechy tasks hang together or not--and stay tuned for my own foray into this area with evidence for both associations and dissociations consistent with HP--but honestly, if you want to unambiguously map the circuits and computations involved in speech recognition as it is used in the wild, dump syllable discrimination and stick to auditory comprehension.

Tuesday, March 14, 2017

RESEARCH FACULTY POSITIONS at the BCBL- Basque Center on Cognition Brain and Language (San Sebastián, Basque Country, Spain)

RESEARCH FACULTY POSITIONS at the BCBL- Basque Center on Cognition Brain and Language (San Sebastián, Basque Country, Spain) (Center of excellence Severo Ochoa)

The Basque Center on Cognition Brain and Language (San Sebastián, Basque Country, Spain) together with IKERBASQUE (Basque Foundation for Science) offer 3 permanent IKERBASQUE Research Professor positions in the following areas:

-Language acquisition
- Any area of Language processing and/or disorders with advanced experience in MRI
- Any area of Language processing and/or disorders with advanced experience in MEG

The BCBL Center (recently awarded the label of excellence Severo Ochoa) promotes a vibrant research environment without substantial teaching obligations. It provides access to the most advanced behavioral and neuroimaging techniques, including 3 Tesla MRI, a whole-head MEG system, four ERP labs, a NIRS lab, a baby lab including eyetracker, EEG and NIRS, two eyetracking labs, and several well-equipped behavioral labs.  There are excellent technical support staff and research personnel (PhD and postdoctoral students). The senior positions are permanent appointments. 

We are looking for cognitive neuroscientists or experimental psychologists with a background in psycholinguistics and/or neighboring cognitive neuroscience areas, and physicists and/or engineers with fMRI or MEG expertise. Individuals interested in undertaking research in the fields described in should apply through the BCBL web page ( The successful candidate will be working within the research lines of the BCBL whose main aim is to develop high-risk/high gain projects at the frontiers of Cognitive Neuroscience. We expect high readiness to work with strong engagement and creativity in an interdisciplinary and international environment.

Deadline June 30th

We encourage immediate applications as the selection process will be ongoing and the appointment may be made before the deadline.

Only senior researchers with a strong record of research experience will be considered. Women candidates are especially welcome.
To submit your application please follow this link: applying for Ikerbasque Research Professor 2017 and upload:
  1. Your curriculum vitae.
  2. A cover letter/statement describing your research interests (4000 characters maximum)
  3. The names of two referees who would be willing to write letters of recommendation

Applicants should be fluent in English. Knowledge of Spanish and/or Basque will be considered useful but is not compulsory.

For more information, please contact the Director of BCBL, Manuel Carreiras (

Monday, February 27, 2017

Post-doctoral position in sensorimotor learning and control of speech production

The Laboratory for Speech Physiology and Motor Control (PI Ludo Max, Ph.D.) at the University of Washington (Seattle) announces an open post-doctoral position in the areas of sensorimotor integration and sensorimotor learning for speech production. The position will involve experimental work on both typical speech and stuttering. The lab is located in the University of Washington's Department of Speech and Hearing Sciences and has additional affiliations with the Graduate Program in Neuroscience and the Department of Bioengineering. See for more information.

The successful candidate will use speech sensorimotor adaptation paradigms (with digital signal processing perturbations applied to the real-time auditory feedback or mechanical forces applied to the jaw by a robotic device) to investigate aspects of learning and control in stuttering and nonstuttering adults and children. In addition, the candidate will use electroencephalographic (EEG) techniques to investigate auditory-motor interactions during speech movement planning in the same populations.

The position is initially for one year (a second-year extension is possible contingent upon satisfactory performance and productivity) with a preferred starting date in the spring or early summer of 2017. Applicants should have the Ph.D. degree by the start of the appointment. Review of applications will begin immediately. Candidates with a Ph.D. degree in neuroscience, cognitive/behavioral neuroscience, motor control/kinesiology, biomedical engineering, communication disorders/speech science, and related fields, are encouraged to apply.

We seek a candidate with excellent verbal and written communication skills who is strongly motivated and has substantial computer programming experience (in particular MATLAB and/or R).

For more information, please contact lab director Ludo Max, Ph.D. ( Applications can be submitted to the same e-mail address. Interested candidates should submit (a) a cover letter describing their research experiences, interests, and goals, (b) a curriculum vitae, (c) the names and contact information of three individuals who can serve as references, and (d) reprints of relevant journal publications.

The University of Washington is an affirmative action and equal opportunity employer. All qualified applicants will receive consideration for employment without regard to, among other things, race, religion, color, national origin, sex, age, status as protected veterans, or status as qualified individuals with disabilities.