Control stimuli in experimental code-switching research

Article published in Languages.

The current study investigates whether there is variation among different types of control stimuli in code-switching (CS) research, how such stimuli can be used to accommodate heterogeneity, and how they can also be used as a baseline comparison of acceptability. A group of native Spanish–English bilinguals (n = 20) completed a written acceptability judgment task with a 7-point Likert scale. Five different types of control stimuli were included, with three types considered to be completely acceptable (complex-sentence switches, direct-object switches, and subject–predicate switches) and two types considered to be completely unacceptable (pronoun switches and present–perfect switches). Additionally, a set of present–progressive switches were included as a comparison, as their acceptability status is still actively debated. The participants as a whole exhibited the expected grammatical distinctions among the control stimuli, but with a high degree of individual variability. Pronoun switches and auxiliary verb switches were rated significantly lower than the complex-sentence switches, direct-object switches, and subject–predicate switches. These results show that control stimuli can also establish a baseline comparison of acceptability, and recommendations for inclusion in experimental CS research are provided.

doi:10.3390/languages4030067

Rethinking and shifting discourses and practice of “testing”: From accuracy to engagement with situated contexts

Co-authored book chapter published in the edited volume Pathways to paradigm change: Critical examinations of prevailing discourses and ideologies in second language education.

The chapter presents a reflective analysis of the discourse and practices regarding the written test in three coordinated introductory/intermediate language programs (French, German, and Spanish) at a large public university. Written tests that students complete in class are specifically targeted because this type of assessment tends to reflect traditional ideologies and practices, focused on measuring accuracy and declarative knowledge, at odds with calls for teaching (and assessing) language and culture as integrated and situated practices (Kramsch, 2014; MLA, 2007; National Standards, 2015). This chapter examines how the collective imagined conceptualizations of paper-based written tests affect discourse, design, and Graduate Teaching Assistants’ (GTAs) professional development. The analysis starts by considering the terminology used in each program, as it conveys specific ideologies about testing. To evaluate how successful the programs’ written tests are in reflecting the pedagogical approach, their role and position are examined, followed by a comparative analysis of three recent tests. The contribution then goes on to describe the current procedures for written test development and offers both a reflection of challenges encountered and possibilities for written tests in coordinated language programs going forward. The chapter concludes with general recommendations to engage into a rethinking and reframing of what testing language in the classroom means.

Modality in experimental code-switching research: Aural versus written stimuli

Co-authored book chapter published in the edited volume Code-switching – Experimental answers to theoretical questions: In honor of Kay González-Vilbazo.

Various methodological concerns are specific to code-switching research; however, the modality of experimental stimuli has yet to be thoroughly investigated. This study explicitly tests if the mode of presentation does in fact affect participants’ judgments in Spanish-English code-switching using two different syntactic phenomena: (i) pronouns and lexical DPs, and (ii) wh-movement. The results are parallel, but not identical for the two modalities. We found no difference on a global level, indicating that written code-switched stimuli do not produce depressed ratings. We found a few individual differences when looking at specific structures within the two phenomena. In those cases, the aural condition enhanced the ratings of more acceptable sentences. Crucially, these differences did not affect the interpretation of the results.

doi:10.1075/ihll.19.06kor

Acquiring L1-English L2-Spanish code-switching: The role of exposure to language mixing

Article published in Languages.

This paper explores the code-switching behavior of second language (L2) bilinguals as a lens into the development of their L2 linguistic systems. Specifically, it investigates the acceptability judgments of L1-English L2-Spanish bilinguals on intra-sentential code-switching, comparing those judgments to a group of Spanish–English bilinguals who acquired both languages as an L1. The particular issues of proficiency and bilingual language behavior are analyzed, testing whether either factor has an effect on L2 code-switching intuitions. The results suggest that both proficiency and bilingual language behavior are relevant. L2 bilinguals with an intermediate/advanced proficiency level of Spanish were more likely to align with 2L1 bilinguals with regard to code-switching judgments, as were L2 bilinguals who reported prior experience with language mixing. L2 bilinguals with lower proficiency in Spanish, as well as those who reported never engaging in code-switching, however, were more likely to diverge from the 2L1 bilinguals in their judgments.

doi:10.3390/languages3030026

Monolingual data as a foundation for analyzing code-switching data

Co-authored article published in Linguistic Approaches to Bilingualism.

Among methodological concerns specific to code-switching (CS) research is the design of the target stimuli used in experiments with an acceptability judgment task. We argue here that research which makes use of CS data of this type must also incorporate monolingual stimuli into the experimental design, specifically monolingual stimuli judged by the same bilingual participants who judge the code-switched stimuli. We do so by reviewing two sets of experimental CS data we collected and exploring the role that monolingual stimuli can play in the analysis of that data. In each experiment, an analysis based solely on acceptability judgments of the CS stimuli leads to one interpretation, while incorporation of results from the monolingual stimuli leads to a distinct interpretation. We show that it is the interpretation integrating the monolingual acceptability judgments which is more valid, thereby arguing for the value of monolingual stimuli in design and analysis.

doi:10.1075/lab.16007.ebe