Language Acquisition Theory

Henna Lemetyinen

Postdoctoral Researcher

BSc (Hons), Psychology, PhD, Developmental Psychology

Henna Lemetyinen is a postdoctoral research associate at the Greater Manchester Mental Health NHS Foundation Trust (GMMH).

Learn about our Editorial Process

Saul McLeod, PhD

Editor-in-Chief for Simply Psychology

BSc (Hons) Psychology, MRes, PhD, University of Manchester

Saul McLeod, PhD., is a qualified psychology teacher with over 18 years of experience in further and higher education. He has been published in peer-reviewed journals, including the Journal of Clinical Psychology.

Olivia Guy-Evans, MSc

Associate Editor for Simply Psychology

BSc (Hons) Psychology, MSc Psychology of Education

Olivia Guy-Evans is a writer and associate editor for Simply Psychology. She has previously worked in healthcare and educational sectors.

On This Page:

Language is a cognition that truly makes us human. Whereas other species do communicate with an innate ability to produce a limited number of meaningful vocalizations (e.g., bonobos) or even with partially learned systems (e.g., bird songs), there is no other species known to date that can express infinite ideas (sentences) with a limited set of symbols (speech sounds and words).

This ability is remarkable in itself. What makes it even more remarkable is that researchers are finding evidence for mastery of this complex skill in increasingly younger children.

My project 1 51

Infants as young as 12 months are reported to have sensitivity to the grammar needed to understand causative sentences (who did what to whom; e.g., the bunny pushed the frog (Rowland & Noble, 2010).

After more than 60 years of research into child language development, the mechanism that enables children to segment syllables and words out of the strings of sounds they hear and to acquire grammar to understand and produce language is still quite an enigma.

Behaviorist Theory of Language Acquisition

One of the earliest scientific explanations of language acquisition was provided by Skinner (1957). As one of the pioneers of behaviorism , he accounted for language development using environmental influence, through imitation, reinforcement, and conditioning.

In this view, children learn words and grammar primarily by mimicking the speech they hear and receiving positive feedback for correct usage.

Skinner argued that children learn language based on behaviorist reinforcement principles by associating words with meanings. Correct utterances are positively reinforced when the child realizes the communicative value of words and phrases.

For example, when the child says ‘milk’ and the mother smiles and gives her some. As a result, the child will find this outcome rewarding, enhancing the child’s language development (Ambridge & Lieven, 2011).

Over time, through repetition and reinforcement, they refine their linguistic abilities. Critics argue this theory doesn’t fully explain the rapid pace of language acquisition nor the creation of novel sentences.

Chomsky Theory of Language Development

However, Skinner’s account was soon heavily criticized by Noam Chomsky, the world’s most famous linguist to date.

In the spirit of the cognitive revolution in the 1950s, Chomsky argued that children would never acquire the tools needed for processing an infinite number of sentences if the language acquisition mechanism was dependent on language input alone.

Noam Chomsky introduced the nativist theory of language development, emphasizing the role of innate structures and mechanisms in the human brain. Key points of Chomsky’s theory include:

Language Acquisition Device (LAD): Chomsky proposed that humans have an inborn biological capacity for language, often termed the LAD, which predisposes them to acquire language.

Universal Grammar: He suggested that all human languages share a deep structure rooted in a set of grammatical rules and categories. This “universal grammar” is understood intuitively by all humans.

Poverty of the Stimulus: Chomsky argued that the linguistic input received by young children is often insufficient (or “impoverished”) for them to learn the complexities of their native language solely through imitation or reinforcement. Yet, children rapidly and consistently master their native language, pointing to inherent cognitive structures.

Critical Period: Chomsky, along with other linguists, posited a critical period for language acquisition, during which the brain is particularly receptive to linguistic input, making language learning more efficient.

Critics of Chomsky’s theory argue that it’s too innatist and doesn’t give enough weight to social interaction and other factors in language acquisition.

Universal Grammar

Consequently, he proposed the theory of Universal Grammar: an idea of innate, biological grammatical categories, such as a noun category and a verb category, that facilitate the entire language development in children and overall language processing in adults.

Universal Grammar contains all the grammatical information needed to combine these categories, e.g., nouns and verbs, into phrases. The child’s task is just to learn the words of her language (Ambridge & Lieven).

For example, according to the Universal Grammar account, children instinctively know how to combine a noun (e.g., a boy) and a verb (to eat) into a meaningful, correct phrase (A boy eats).

This Chomskian (1965) approach to language acquisition has inspired hundreds of scholars to investigate the nature of these assumed grammatical categories, and the research is still ongoing.

Contemporary Research

A decade or two later, some psycho-linguists began to question the existence of Universal Grammar. They argued that categories like nouns and verbs are biologically, evolutionarily, and psychologically implausible and that the field called for an account that can explain the acquisition process without innate categories.

Researchers started to suggest that instead of having a language-specific mechanism for language processing, children might utilize general cognitive and learning principles.

Whereas researchers approaching the language acquisition problem from the perspective of Universal Grammar argue for early full productivity, i.e., early adult-like knowledge of the language, the opposing constructivist investigators argue for a more gradual developmental process. It is suggested that children are sensitive to patterns in language which enables the acquisition process.

An example of this gradual pattern learning is morphology acquisition. Morphemes are the smallest grammatical markers, or units, in language that alter words. In English, regular plurals are marked with an –s morpheme (e.g., dog+s).

Similarly, English third singular verb forms (she eat+s, a boy kick+s) are marked with the –s morpheme. Children are considered to acquire their first instances of third singular forms as entire phrasal chunks (Daddy kicks, a girl eats, a dog barks) without the ability to tease the finest grammatical components apart.

When the child hears a sufficient number of instances of a linguistic construction (i.e., the third singular verb form), she will detect patterns across the utterances she has heard. In this case, the repeated pattern is the –s marker in this particular verb form.

As a result of many repetitions and examples of the –s marker in different verbs, the child will acquire sophisticated knowledge that, in English, verbs must be marked with an –s morpheme in the third singular form (Ambridge & Lieven, 2011; Pine, Conti-Ramsden, Joseph, Lieven & Serratrice, 2008; Theakson & Lieven, 2005).

Approaching language acquisition from the perspective of general cognitive processing is an economic account of how children can learn their first language without an excessive biolinguistic mechanism.

However, finding a solid answer to the problem of language acquisition is far from being over. Our current understanding of the developmental process is still immature.

Investigators of Universal Grammar are still trying to convince that language is a task too demanding to acquire without specific innate equipment, whereas constructivist researchers are fiercely arguing for the importance of linguistic input.

The biggest questions, however, are yet unanswered. What is the exact process that transforms the child’s utterances into grammatically correct, adult-like speech? How much does the child need to be exposed to language to achieve the adult-like state?

What account can explain variation between languages and the language acquisition process in children acquiring very different languages to English? The mystery of language acquisition is granted to keep psychologists and linguists alike astonished decade after decade.

What is language acquisition?

Language acquisition refers to the process by which individuals learn and develop their native or second language.

It involves the acquisition of grammar, vocabulary, and communication skills through exposure, interaction, and cognitive development. This process typically occurs in childhood but can continue throughout life.

What is Skinner’s theory of language development?

Skinner’s theory of language development, also known as behaviorist theory, suggests that language is acquired through operant conditioning. According to Skinner, children learn language by imitating and being reinforced for correct responses.

He argued that language is a result of external stimuli and reinforcement, emphasizing the role of the environment in shaping linguistic behavior.

What is Chomsky’s theory of language acquisition?

Chomsky’s theory of language acquisition, known as Universal Grammar, posits that language is an innate capacity of humans.

According to Chomsky, children are born with a language acquisition device (LAD), a biological ability that enables them to acquire language rules and structures effortlessly.

He argues that there are universal grammar principles that guide language development across cultures and languages, suggesting that language acquisition is driven by innate linguistic knowledge rather than solely by environmental factors.

Ambridge, B., & Lieven, E.V.M. (2011). Language Acquisition: Contrasting theoretical approaches . Cambridge: Cambridge University Press.

Chomsky, N. (1965). Aspects of the Theory of Syntax . MIT Press.

Pine, J.M., Conti-Ramsden, G., Joseph, K.L., Lieven, E.V.M., & Serratrice, L. (2008). Tense over time: testing the Agreement/Tense Omission Model as an account of the pattern of tense-marking provision in early child English. Journal of Child Language , 35(1): 55-75.

Rowland, C. F.; & Noble, C. L. (2010). The role of syntactic structure in children’s sentence comprehension: Evidence from the dative. Language Learning and Development , 7(1): 55-75.

Skinner, B.F. (1957). Verbal behavior . Acton, MA: Copley Publishing Group.

Theakston, A.L., & Lieven, E.V.M. (2005). The acquisition of auxiliaries BE and HAVE: an elicitation study. Journal of Child Language , 32(2): 587-616.

Further Reading

An excellent article by Steven Pinker on Language Acquisition

Pinker, S. (1995). The New Science of Language and Mind . Penguin.

Tomasello, M. (2005). Constructing A Language: A Usage-Based Theory of Language Acquisition . Harvard University Press.

Print Friendly, PDF & Email

Thank you for visiting nature.com. You are using a browser version with limited support for CSS. To obtain the best experience, we recommend you use a more up to date browser (or turn off compatibility mode in Internet Explorer). In the meantime, to ensure continued support, we are displaying the site without styles and JavaScript.

  • View all journals
  • Explore content
  • About the journal
  • Publish with us
  • Sign up for alerts
  • Review Article
  • Published: 01 November 2004

Early language acquisition: cracking the speech code

  • Patricia K. Kuhl 1  

Nature Reviews Neuroscience volume  5 ,  pages 831–843 ( 2004 ) Cite this article

41k Accesses

1174 Citations

115 Altmetric

Metrics details

Infants learn their native language quickly and effortlessly, and follow the same developmental path regardless of culture. However, it has proved difficult to understand how they do this, or to build computers that can reproduce this feat.

An early and essential task for infants is to make sense of the speech that they hear. Each language uses a unique set of about 40 phonemes, and infants must learn to partition varied speech sounds into these phonemic categories. Young infants are sensitive to subtle differences between all phonetic units, whereas older children lose their sensitivity to distinctions that are not used in their native language. The loss of discrimination for foreign-language distinctions is paralleled by an increase in sensitivity to native-language phonetic units.

There is evidence that infants analyse the statistical distributions of sounds that they hear in ambient language, and use this information to form phonemic categories. They also learn phonotactic rules — language-specific rules that govern the sequences of phonemes that can be used to compose words.

To identify word boundaries, infants can use both transitional probabilities between syllables, and prosodic cues, which relate to linguistic stress. Most languages are dominated by either trochaic words (with the stress on the first syllable) or iambic ones (with the stress on later syllables). Infants seem to use a combination of statistical and prosodic cues to segment words in speech.

Social influences are important in speech learning. Infants learn more easily from interactions with human beings speaking another language than they do from audiovisual exposure to the same language material, and their speech is strongly influenced by the response of others around them, such as their mothers. The importance of social input in language learning has some similarities to social influences on song learning in birds.

Language experience causes neural changes. One hypothesis, native language neural commitment (NLNC), proposes that language learning produces dedicated neural networks that code the patterns of native-language speech. As these networks develop, they make it easier for new speech elements and patterns to be learned if they are consistent with the existing patterns, but place constraints on the learning of foreign-language patterns. NLNC might explain the closing of the 'sensitive period' for language learning; once a certain amount of learning has occurred, neural commitment interferes with the learning of new languages so they cannot be learned as easily.

Infants learn language with remarkable speed, but how they do it remains a mystery. New data show that infants use computational strategies to detect the statistical and prosodic patterns in language input, and that this leads to the discovery of phonemes and words. Social interaction with another human being affects speech learning in a way that resembles communicative learning in songbirds. The brain's commitment to the statistical and prosodic patterns that are experienced early in life might help to explain the long-standing puzzle of why infants are better language learners than adults. Successful learning by infants, as well as constraints on that learning, are changing theories of language acquisition.

This is a preview of subscription content, access via your institution

Access options

Subscribe to this journal

Receive 12 print issues and online access

176,64 € per year

only 14,72 € per issue

Buy this article

  • Purchase on Springer Link
  • Instant access to full article PDF

Prices may be subject to local taxes which are calculated during checkout

research on language acquisition indicates that

Similar content being viewed by others

research on language acquisition indicates that

How adults understand what young children say

research on language acquisition indicates that

Child-directed speech is optimized for syntax-free semantic inference

research on language acquisition indicates that

A systematic review and Bayesian meta-analysis of the acoustic features of infant-directed speech

Ladefoged, P. Vowels and Consonants: An Introduction to the Sounds of Language 2nd edn (Blackwell, Oxford, UK, 2004).

Google Scholar  

Liberman, A. M., Cooper, F. S., Shankweiler, D. P. & Studdert-Kennedy, M. Perception of the speech code. Psychol. Rev. 74 , 431–461 (1967).

Article   CAS   PubMed   Google Scholar  

Eimas, P. D., Siqueland, E. R., Jusczyk, P. & Vigorito, J. Speech perception in infants. Science 171 , 303–306 (1971).

Lasky, R. E., Syrdal-Lasky, A. & Klein, R. E. VOT discrimination by four to six and a half month old infants from Spanish environments. J. Exp. Child Psychol. 20 , 215–225 (1975).

Eimas, P. D. Auditory and phonetic coding of the cues for speech: discrimination of the /r-l/ distinction by young infants. Percept. Psychophys. 18 , 341–347 (1975).

Article   Google Scholar  

Werker, J. F. & Lalonde, C. Cross-language speech perception: initial capabilites and developmental change. Dev. Psychol. 24 , 672–683 (1988).

Miyawaki, K. et al. An effect of linguistic experience: the discrimination of /r/ and /l/ by native speakers of Japanese and English. Percept. Psychophys. 18 , 331–340 (1975).

Stevens, K. N. Acoustic Phonetics (MIT Press, Cambridge, Massachusetts, 2000).

Kuhl, P. K. & Miller, J. D. Speech perception by the chinchilla: voice–voiceless distinction in alveolar plosive consonants. Science 190 , 69–72 (1975).

Kuhl, P. K. & Miller, J. D. Speech perception by the chinchilla: identification functions for synthetic VOT stimuli. J. Acoust. Soc. Am. 63 , 905–917 (1978).

Kuhl, P. K. & Padden, D. M. Enhanced discriminability at the phonetic boundaries for the place feature in macaques. J. Acoust. Soc. Am. 73 , 1003–1010 (1983).

Pisoni, D. B. Identification and discrimination of the relative onset time of two component tones: implications for voicing perception in stops. J. Acoust. Soc. Am. 61 , 1352–1361 (1977).

Jusczyk, A. M., Pisoni, D. B., Walley, A. & Murray, J. Discrimination of relative onset time of two-component tones by infants. J. Acoust. Soc. Am. 67 , 262–270 (1980).

Kuhl, P. K. Theoretical contributions of tests on animals to the special-mechanisms debate in speech. Exp. Biol. 45 , 233–265 (1986).

CAS   PubMed   Google Scholar  

Kuhl, P. K. in Plasticity of Development (eds Brauth, S. E., Hall, W. S. & Dooling, R. J.) 73–106 (MIT Press, Cambridge, Massachusetts, 1991).

Aslin, R. N. & Pisoni, D. B. in Child Phonology: Perception and Production (eds Yeni-Komshian, G., Kavanagh, J. & Ferguson, C.) 67–96 (Academic, New York, 1980).

Burnham, D. Developmental loss of speech perception: exposure to and experience with a first language. Appl. Psycholinguist. 7 , 207–240 (1986).

Kuhl, P. K. in Neonate Cognition: Beyond the Blooming Buzzing Confusion (eds Mehler, J. & Fox, R.) 231–262 (Lawrence Erlbaum Associates, Hillsdale, New Jersey, 1985).

Hillenbrand, J. Speech perception by infants: categorization based on nasal consonant place of articulation. J. Acoust. Soc. Am. 75 , 1613–1622 (1984).

Kuhl, P. K. Speech perception in early infancy: perceptual constancy for spectrally dissimilar vowel categories. J. Acoust. Soc. Am. 66 , 1668–1679 (1979).

Kuhl, P. K. Perception of auditory equivalence classes for speech in early infancy. Infant Behav. Dev. 6 , 263–285 (1983).

Miller, J. L. & Liberman, A. M. Some effects of later-occurring information on the perception of stop consonant and semivowel. Percept. Psychophys. 25 , 457–465 (1979).

Eimas, P. D. & Miller, J. L. Contextual effects in infant speech perception. Science 209 , 1140–1141 (1980).

Zue, V. & Glass, J. Conversational interfaces: advances and challenges. Proc. IEEE 88 , 1166–1180 (2000).

Kuhl, P. K. & Meltzoff, A. Infant vocalizations in response to speech: vocal imitation and developmental change. J. Acoust. Soc. Am. 100 , 2425–2438 (1996). Vocalizations of infants watching a video of a female talker were recorded at 12, 16 and 20 weeks of age. The results show developmental change between 12 and 20 weeks of age and also provide evidence of vocal imitation in infants by 20 weeks of age.

Werker, J. F. & Tees, R. C. Cross-language speech perception: evidence for perceptual reorganization during the first year of life. Infant Behav. Dev. 7 , 49–63 (1984).

Best, C. & McRoberts, G. W. Infant perception of non-native consonant contrasts that adults assimilate in different ways. Lang. Speech 46 , 183–216 (2003).

Article   PubMed   PubMed Central   Google Scholar  

Tsushima, T. et al. Proceedings of the International Conference on Spoken Language Processing Vol. S28F-1 , 1695–1698 (Yokohama, Japan, 1994).

Kuhl, P. K., Tsao, F. M., Liu, H. M., Zhang, Y. & de Boer, B. in The Convergence of Natural and Human Science (eds Domasio, A. et al.) 136–174 (The New York Academy of Science, New York, 2001).

Rivera-Gaxiola, M., Silva-Pereyra, J. & Kuhl, P. K. Brain potentials to native- and non-native speech contrasts in seven and eleven-month-old American infants. Dev. Sci. (in the press). An ERP study showing that at 11 months, the infant brain remains sensitive to non-native-language contrasts. Infants' responsiveness to native-language consonant contrasts also increased over time.

Kuhl, P. K., Tsao, F. -M. & Liu, H. -M. Foreign-language experience in infancy: effects of short-term exposure and social interaction on phonetic learning. Proc. Natl Acad. Sci. USA 100 , 9096–9101 (2003). Two studies showing that learning can occur with only short-term exposure to a language in infants, and that it is enhanced by social interaction.

Article   CAS   PubMed   PubMed Central   Google Scholar  

Cheour, M. et al. Development of language-specific phoneme representations in the infant brain. Nature Neurosci. 1 , 351–353 (1998).

Kuhl, P. K., Tsao, F. M., Liu, H. M., Zhang, Y. & De Boer, B. Language/culture/mind/brain. Progress at the margins between disciplines. Ann. NY Acad. Sci. 935 , 136–174 (2001).

Fant, G. Speech Sounds and Features (MIT Press, Cambridge, Massachusetts, 1973).

Hillenbrand, J., Getty, L., Clark, M. & Wheeler, K. Acoustic characteristics of American English vowels. J. Acoust. Soc. Am. 97 , 3099–3111 (1995).

Perkell, J. & Klatt, D. Invariance and Variability in Speech Processes 1–604 (Lawrence Erlbaum Associates, Hillsdale, New Jersey, 1986).

Lacerda, F. The perceptual magnet effect: an emergent consequence of exemplar-based phonetic memory. Proc. Int. Congr. Phonetic Sci. 2 , 140–147 (1995).

Lisker, L. & Abramson, A. S. A cross-language study of voicing in initial stops: acoustical measurements. Word 20 , 384–422 (1964).

Kuhl, P. K. Early linguistic experience and phonetic perception: implications for theories of developmental speech perception. J. Phonetics 21 , 125–139 (1993).

Maye, J., Werker, J. F. & Gerken, L. Infant sensitivity to distributional information can affect phonetic discrimination. Cognition 82 , B101–B111 (2002).

Article   PubMed   Google Scholar  

Kuhl, P. K., Williams, K. A., Lacerda, F., Stevens, K. N. & Lindblom, B. Linguistic experience alters phonetic perception in infants by 6 months of age. Science 255 , 606–608 (1992).

Kuhl, P. K. Human adults and human infants show a 'perceptual magnet effect' for the prototypes of speech categories, monkeys do not. Percept. Psychophys. 50 , 93–107 (1991).

Rosch, E. Cognitive reference points. Cognit. Psychol. 7 , 532–547 (1975).

Jusczyk, P., Luce, P. & Charles-Luce, J. Infants' sensitivity to phonotactic patterns in the native language. J. Mem. Lang. 33 , 630–645 (1994). This study found that 9-month-old infants, but not 6-month-old infants, prefer frequently occurring phonetic patterns in monosyllables.

Fenson, L. et al. MacArthur Communicative Development Inventories: User's Guide and Technical Manual (Singular Publishing Group, San Diego, California, 1993).

Saffran, J. R. Constraints on statistical language learning. J. Mem. Lang. 47 , 172–196 (2002). This study shows that learners can use the predictive relationships that link elements within phrases to acquire phrase structure. Predictive relationships improved learning for sequentially presented auditory stimuli, and for simultaneously presented visual stimuli, but not for sequentially presented visual stimuli.

Goodsitt, J. V., Morgan, J. L. & Kuhl, P. K. Perceptual strategies in prelingual speech segmentation. J. Child Lang. 20 , 229–252 (1993).

Karzon, R. Discrimination of polysyllabic sequences by one- to four-month-old infants. J. Exp. Child Psychol. 39 , 326–342 (1985).

Saffran, J. R., Aslin, R. N. & Newport, E. L. Statistical learning by 8-month old infants. Science 274 , 1926–1928 (1996).

Aslin, R. N., Saffran, J. R. & Newport, E. L. Computation of conditional probability statistics by 8-month-old infants. Psychol. Sci. 9 , 321–324 (1998).

Saffran, J. R., Johnson, E. K., Aslin, R. N. & Newport, E. L. Statistical learning of tone sequences by human infants and adults. Cognition 70 , 27–52 (1999).

Fiser, J. & Aslin, R. N. Statistical learning of new visual feature combinations by infants. Proc. Natl Acad. Sci. USA 99 , 15822–15826 (2002).

Kirkham, N. Z., Slemmer, J. A. & Johnson, S. P. Visual statistical learning in infancy: evidence for a domain general learning mechanism. Cognition 83 , B35–B42 (2002). This study provides evidence that infants' statistical learning from auditory input can be generalized to the visual domain.

Hauser, M. D., Newport, E. L. & Aslin, R. N. Segmentation of the speech stream in a non-human primate: statistical learning in cotton-top tamarins. Cognition 78 , B53–B64 (2001).

Cutler, A. & Carter, D. The predominance of strong initial syllables in the English vocabulary. Comput. Speech Lang. 2 , 133–142 (1987).

Jusczyk, P. W., Houston, D. M. & Newsome, M. The beginnings of word segmentation in English-learning infants. Cognit. Psychol. 39 , 159–207 (1999).

Johnson, E. K. & Jusczyk, P. W. Word segmentation by 8-month-olds: when speech cues count more than statistics. J. Mem. Lang. 44 , 548–567 (2001). The authors showed that, when multiple cues are available, 8-month-olds weighed prosodic cues more heavily than statistical cues.

Saffran, J. R. & Thiessen, E. D. Pattern induction by infant language learners. Dev. Psychol. 39 , 484–494 (2003). A study of how infants segment words according to stress patterns. Nine-month-old infants learned to segment speech using the iambic pattern whether the exposure consisted of 100% or 80% iambic words. Seven-month-olds could alter their segmentation strategies when the distribution of stress cues in words was altered.

Thiessen, E. D. & Saffran, J. R. Learning to learn: infants' acquisition of stress–based strategies for word segmentation. J. Mem. Lang. (under revision).

Santelmann, L. M. & Jusczyk, P. W. Sensitivity to discontinuous dependencies in language learners: evidence for limitations in processing space. Cognition 69 , 105–134 (1998).

Silva-Pereyra, J., Rivera-Gaxiola, M. & Kuhl, P. K. An event-related brain potential study of sentence comprehension in preschoolers: semantic and morphosyntatic processing. Cognit. Brain Res. (in the press).

Newport, E. L. & Aslin, R. N. Learning at a distance I. Statistical learning of non-adjacent dependencies. Cognit. Psychol. 48 , 127–162 (2004).

Newport, E. L., Hauser, M. D., Spaepen, G. & Aslin, R. N. Learning at a distance II. Statistical learning of non-adjacent dependencies in a non-human primate. Cognit. Psychol. 49 , 85–117 (2004).

Gomez, R. L. & Gerken, L. Artificial grammar learning by 1-year-olds leads to specific and abstract knowledge. Cognition 70 , 109–135 (1999).

Gomez, R. L. & Gerken, L. Infant artificial language learning and language acquisition. Trends Cogn. Sci. 4 , 178–186 (2000).

Pena, M., Bonatti, L. L., Nespor, M. & Mehler, J. Signal-driven computations in speech processing. Science 298 , 604–607 (2002).

Marcus, G. F., Vijayan, S., Bandi Rao, S. & Vishton, P. M. Rule learning by seven-month-old infants. Science 283 , 77–80 (1999).

Seidenberg, M. S., MacDonald, M. C. & Saffran, J. R. Does grammar start where statistics stop? Science 298 , 553–554 (2002).

Seidenberg, M. S. & Elman, J. Do infants learn grammar with algebra or statistics? Science 284 , 433 (1999).

Doupe, A. J. & Kuhl, P. K. Birdsong and human speech: common themes and mechanisms. Annu. Rev. Neurosci. 22 , 567–631 (1999).

Kuhl, P. K. Human speech and birdsong: communication and the social brain. Proc. Natl Acad. Sci. USA 100 , 9645–9646 (2003).

Fromkin, V., Krashen, S., Curtiss, S., Rigler, D. & Rigler, M. The development of language in Genie: a case of language acquisition beyond the 'critical period'. Brain Lang. 1 , 81–107 (1974).

Kuhl, P. K., Coffey-Corina, S., Padden, D. M. & Dawson, G. Links between social and linguistic processing of speech in preschool children with autism: behavioral and electrophysiological measures. Dev. Sci. 7 , 19–30 (2004).

Vouloumanos, A. & Werker, J. F. Tuned to the signal: the privileged status of speech for young infants. Dev. Sci. 7 , 270–276 (2004). The authors investigated differences in 2- to 7-month old infants' perception of nonsense speech sounds and structurally similar non-speech analogues. They found a bias for speech sounds in infants as young as 2-months old.

Bruner, I. Child's Talk: Learning to Use Language (W. W. Norton, New York, 1983).

Vigotsky, L. S. Thought and Language: A Usage-Based Theory of Language Acquisition (MIT Press, Cambridge, Massachusetts, 1962).

Book   Google Scholar  

Tomasello, M. Constructing a Language (Harvard Univ. Press, Cambridge, Massachusetts, 2003).

Fernald, A. & Kuhl, P. Acoustic determinants of infant preference for motherese speech. Infant Behav. Dev. 10 , 279–293 (1987).

Kuhl, P. K. et al. Cross-language analysis of phonetic units in language addressed to infants. Science 277 , 684–686 (1997).

Goldstein, M., King, A. & West, M. Social interaction shapes babbling: testing parallels between birdsong and speech. Proc. Natl Acad. Sci. USA 100 , 8030–8035 (2003).

Bloom, K. Social elicitation of infant vocal behavior. J. Exp. Child Psychol. 20 , 51–58 (1975).

Bloom, K. & Esposito, A. Social conditioning and its proper control procedures. J. Exp. Child Psychol. 19 , 209–222 (1975).

Eales, L. The influences of visual and vocal interaction on song learning in zebra finches. Anim. Behav. 37 , 507–508 (1989).

Immelmann, K. in Bird Vocalizations (ed. Hinde, R.) 61–74 (Cambridge Univ. Press, London, 1969).

Baptista, L. F. & Petrinovich, L. Song development in the white-crowned sparrow: social factors and sex differences. Anim. Behav. 34 , 1359–1371 (1986).

Brainard, M. S. & Knudsen, E. I. Sensitive periods for visual calibration of the auditory space map in the barn owl optic tectum. J. Neurosci. 18 , 3929–3942 (1998).

West, M. & King, A. Female visual displays affect the development of male song in the cowbird. Nature 334 , 244–246 (1988).

Nelson, D. & Marler, P. Selection-based learning in bird song development. Proc. Natl Acad. Sci. USA 91 , 10498–10501 (1994).

Adret, P. Operant conditioning, song learning and imprinting to taped song in the zebra finch. Anim. Behav. 46 , 149–159 (1993).

Tchernichovski, O., Mitra, P., Lints, T. & Nottebohm, F. Dynamics of the vocal imitation process: how a zebra finch learns its song. Science 291 , 2564–2569 (2001).

Brooks, R. & Meltzoff, A. N. The importance of eyes: how infants interpret adult looking behavior. Dev. Psychol. 38 , 958–966 (2002).

Baldwin, D. A. in Joint Attention: Its Origins and Role in Development (eds Moore, C. & Dunham, P. J.) 131–158 (Lawrence Erlbaum Associates, Hillsdale, New Jersey, 1995).

Mundy, P. & Gomes, A. Individual differences in joint attention skill development in the second year. Infant Behav. Dev. 21 , 469–482 (1998).

Kuhl, P. K. & Meltzoff, A. N. The bimodal perception of speech in infancy. Science 218 , 1138–1141 (1982).

Bloom, K., Russell, A. & Wassenberg, K. Turn taking affects the quality of infant vocalizations. J. Child Lang. 14 , 211–227 (1987).

Liu, H. -M., Kuhl, P. K. & Tsao, F. -M. An association between mothers' speech clarity and infants' speech discrimination skills. Dev. Sci. 6 , F1–F10 (2003).

Thiessen, E. D., Hill, E. & Saffran, J. R. Infant-directed speech facilitates word segmentation. Infancy (in the press).

Marler, P. in The Epigenesis of Mind: Essays on Biology and Cognition (eds Carey, S. & Gelman, R.) 37–66 (Lawrence Erlbaum Associates, Hillsdale, New Jersey, 1991).

Evans, C. S. & Marler, P. in Comparative Approaches to Cognitive Science: Complex Adaptive Systems (eds Roitblat, H. L. & Meyer, J.-A.) 341–382 (MIT Press, Cambridge, Massachusetts, 1995).

Petitto, L. A., Holowka, S., Sergio, L. E., Levy, B. & Ostry, D. J. Baby hands that move to the rhythm of language: hearing babies acquiring sign language babble silently on the hands. Cognition 93 , 43–73 (2004). This study showed that hearing babies acquire sign language 'babble' with their hands in a way that differs from hearing babies acquiring spoken language.

Kuhl, P. K., Williams, K. A. & Meltzoff, A. N. Cross-modal speech perception in adults and infants using nonspeech auditory stimuli. J. Exp. Psychol. Hum. Percept. Perform. 17 , 829–840 (1991).

Meltzoff, A. N. Understanding the intentions of others: re-enactment of intended acts by 18-month-old children. Dev. Psychol. 31 , 838–850 (1995).

Adolphs, R. Cognitive neuroscience of human social behaviour. Nature Rev. Neurosci. 4 , 165–178 (2003).

Article   CAS   Google Scholar  

Dunbar, R. I. M. The social brain hypothesis. Evol. Anthropol. 6 , 178–190 (1998).

Knightly, L. M., Jun, S. -A., Oh, J. S. & Au, T. K. -F. Production benefits of childhood overhearing. J. Acoust. Soc. Am. 114 , 465–474 (2003).

Funabiki, Y. & Konishi, M. Long memory in song learning by zebra finches. J. Neurosci. 23 , 6928–6935 (2003).

Wilbrecht, L. & Nottebohm, F. Vocal learning in birds and humans. Ment. Retard. Dev. Disabil. Res. Rev. 9 , 135–148 (2003).

Nottebohm, F. The road we travelled: discovery, choreography, and significance of brain replaceable neurons. Ann. NY Acad. Sci. 1016 , 628–658 (2004).

Dehaene-Lambertz, G., Dupoux, E. & Gout, A. Electrophysiological correlates of phonological processing: a cross-linguistic study. J. Cogn. Neurosci. 12 , 635–647 (2000).

Callan, D. E., Jones, J. A., Callan, A. M. & Akahane-Yamada, R. Phonetic perceptual identification by native- and second-language speakers differentially activates brain regions involved with acoustic phonetic processing and those involved with articulatory-auditory/orosensory internal models. Neuroimage 22 , 1182–1194 (2004).

Zhang, Y., Kuhl, P. K., Imada, T. & Kotani, M. Effects of language experience: where, when & how. Cognitive Neuroscience Society Annual General Meeting program 2003, 81–82.

Sanders, L. D., Newport, E. L. & Neville, H. J. Segmenting nonsense: an event-related potential index of perceived onsets in continuous speech. Nature Neurosci. 5 , 700–703 (2002).

Golestani, N. & Zatorre, R. J. Learning new sounds of speech: reallocation of neural substrates. Neuroimage 21 , 494–506 (2004).

Wang, Y., Sereno, J. A., Jongman, A. & Hirsch, J. fMRI evidence for cortical modification during learning of Mandarin lexical tone. J. Cogn. Neurosci. 15 , 1019–1027 (2003).

Winkler, I. et al. Brain responses reveal the learning of foreign language phonemes. Psychophysiology 36 , 638–642 (1999).

Koyama, S. et al. Cortical evidence of the perceptual backward masking effect on /l/ and /r/ sounds from a following vowel in Japanese speakers. Neuroimage 18 , 962–974 (2003).

Temple, E. et al. Neural deficits in children with dyslexia ameliorated by behavioral remediation: evidence from functional MRI. Proc. Natl Acad. Sci. USA 100 , 2860–2865 (2003). This fMRI study of children with dyslexia showed that an auditory processing and oral language remediation programme produced increased brain activity in areas that are usually activated in children who have no difficulty in reading.

Cheour, M. et al. Magnetoencephalography (MEG) is feasible for infant assessment of auditory discrimination. Exp. Neurol. (in the press).

Dehaene-Lambertz, G., Dehaene, S. & Hertz-Pannier, L. Functional neuroimaging of speech perception in infants. Science 298 , 2013–2015 (2002). The authors used fMRI to show that, like adults, language activates areas in the left hemisphere, with additional activation in the preforntal cortex of awake infants.

Pena, M. et al. Sounds and silence: an optical topography study of language recognition at birth. Proc. Natl Acad. Sci. USA 100 , 11702–11705 (2003).

Mills, D. L., Coffey-Corina, S. & Neville, H. J. Language comprehension and cerebral specialization from 13–20 months. Dev. Neuropsychol. 13 , 397–445 (1997).

Kuhl, P. K. A new view of language acquisition. Proc. Natl Acad. Sci. USA 97 , 11850–11857 (2000).

Dehaene, S., Spelke, E., Pinel, P., Stanescu, R. & Tsivkin, S. Sources of mathematical thinking: behavioral and brain-imaging evidence. Science 284 , 970–974 (1999).

Iverson, P. et al. A perceptual interference account of acquisition difficulties for non-native phonemes. Cognition 87 , B47–B57 (2003).

Friederici, A. D. & Wessels, J. M. I. Phonotactic knowledge of word boundaries and its use in infant speech perception. Percept. Psychophys. 54 , 287–295 (1993).

Mattys, S., Jusczyk, P., Luce, P. & Morgan, J. L. Phonotactic and prosodic effects on word segmentation in infants. Cognit. Psychol. 38 , 465–494 (1999).

Werker, J. F., Fennell, C., Corcoran, K. & Stager, C. Infants' ability to learn phonetically similar words: effects of age and vocabulary size. Infancy 3 , 1–30 (2002). This study showed that 14-month-old infants could not learn to pair phonetically similar words with different objects, whereas 20-month-old infants could. Vocabulary size was a predictive factor in the younger infants.

Stager, C. & Werker, J. F. Infants listen for more phonetic detail in speech perception than in word-learning tasks. Nature 388 , 381–382 (1997).

Morgan, J. L. & Demuth, K. Signal to Syntax: Bootstrapping from Speech to Grammar in Early Acquisition (Lawrence Erlbaum Associates, Hillsdale, New Jersey, 1996).

Tsao, F. M., Liu, H. M. & Kuhl, P. K. Speech perception in infancy predicts language development in the second year of life: a longitudinal study. Child Dev. 75 , 1067–1084 (2004).

Pang, E. et al. Mismatch negativity to speech stimuli in 8-month-old infants and adults. Int. J. Psychophysiol. 29 , 227–236 (1998).

Kuhl, P. K., Nelson, T., Coffey-Corina, S., Padden, D. M. & Conboy, B. Early brain and behavioral measures of native and non-native speech perception differentially predict later language development: the neural commitment hypothesis. Soc. Neurosci. Abstr. 15935 (2004).

Knudsen, E. I. in Fundamental Neuroscience (ed. Zigmond, M. J.) 637–654 (Academic, San Diego, 1999).

Lenneberg, E. H. Biological Foundations of Language (Wiley, New York, 1967).

Newport, E. Maturational constraints on language learning. Cognit. Sci. 14 , 11–28 (1990).

Johnson, J. & Newport, E. Critical period effects in sound language learning: the influence of maturation state on the acquisition of English as a second language. Cognit. Psychol. 21 , 60–99 (1989).

Piske, T., MacKay, I. & Flege, J. Factors affecting degree of foreign accent in an L2: a review. J. Phonetics 29 , 191–215 (2001).

Long, M. Maturational constraints on language development. Stud. Second Lang. Acquis. 12 , 251–285 (1990).

Birdsong, D. & Molis, M. On the evidence for maturational constraints in second-language acquisition. J. Mem. Lang. 44 , 235–249 (2001).

Flege, J. E., Yeni-Komshian, G. H. & Liu, S. Age constraints on second-language acquisition. J. Mem. Lang. 41 , 78–104 (1999). A study of second language learning in Korean speakers who arrived in the United States at different ages. Age of arrival in the United States predicted the strength of perceived foreign accent, but grammaticality scores were more related to education and use of English.

Mayberry, R. I. & Lock, E. Age constraints on first versus second language acquisition: evidence for linguistic plasticity and epigenesis. Brain Lang. 87 , 369–84 (2003).

Greenough, W. T. & Black, J. E. in The Minnesota Symposia on Child Psychology, Vol. 24: Developmental Behavioral Neuroscience (eds Gunnar, M. & Nelson, C.) 155–200 (Lawrence Erlbaum Associates, Hillsdale, New Jersey, 1992).

Oh, J. S., Jun, S. -A., Knightly, L. M. & Au, T. K. -F. Holding on to childhood language memory. Cognition 86 , B53–B64 (2003).

Au, T. K. -F., Knightly, L. M., Jun, S. -A. & Oh, J. S. Overhearing a language during childhood. Psychol. Sci. 13 , 238–243 (2002). This study showed that adults speak a second language with a more native-like accent if they overheard the language regularly during childhood.

Pallier, C. et al. Brain imaging of language plasticity in adopted adults: can a second language replace the first? Cereb. Cortex 13 , 155–161 (2003).

Flege, J., Bohn, O. & Jang, S. Effects of experience on non-native speakers' production and perception of English vowels. J. Phonetics 25 , 437–470 (1997).

Morgan, J. L., Meier, R. & Newport, E. L. Structural packaging in the input to language learning: contributions of intonational and morphological marking of phrases to the acquisition of language. Cognit. Psychol. 19 , 498–550 (1987).

Saffran, J. R. Statistical language learning: mechanisms and constraints. Curr. Dir. Psychol. Sci. 12 , 110–114 (2003).

Hauser, M. D., Chomsky, N. & Fitch, W. T. The faculty of language: what is it, who has it, and how did it evolve? Science 298 , 1569–1579 (2002)

Download references

Acknowledgements

The author is supported by grants from the National institutes of Health, the Santa Fe Institute, the National Science Foundation (Science of Learning Center), and the William P. and Ruth Gerberding University Professorship Fund. The author thanks D. Padden, J. Pruitt, L. Yamamoto and T. Knight for assistance in preparing the manuscript, and A. Meltzoff and G. Cardillo for helpful comments on earlier drafts.

Author information

Authors and affiliations.

Institute for Learning and Brain Sciences and the Department of Speech and Hearing Sciences, University of Washington, Seattle, 98195, Washington, USA

Patricia K. Kuhl

You can also search for this author in PubMed   Google Scholar

Ethics declarations

Competing interests.

The author declares no competing financial interests.

Related links

Further information, encyclopedia of life sciences.

Kuhl's homepage

Acquisition of knowledge through the computation of information about the distributional frequency with which certain items occur in relation to others, or probabilistic information in sequences of stimuli, such as the odds (transitional probabilities) that one unit will follow another in a given language.

Learning results in a commitment of the brain's neural networks to the patterns of variation that describe a particular language. This learning promotes further learning of patterns that conform to those initially learned, while interfering with the learning of patterns that do not conform to those initially learned.

Elements of a language that distinguish words by forming the contrasting element in pairs of words in a given language (for example, 'rake'–'lake'; 'far'–'fall'). Languages combine different phonetic units into phonemic categories; for example, Japanese combines the 'r' and 'l' units into one phonemic category.

The set of specific articulatory gestures that constitute vowels and consonants in a particular language. Phonetic units are grouped into phonemic categories. For example, 'r' and 'l' are phonetic units that, in English, belong to separate phonemic categories.

In speech perception, the ability to group perceptually distinct sounds into the same category. Unlike computers, infants can classify as similar phonetic units spoken by different talkers, at different rates of speech and in different contexts.

Frequency bands in which energy is highly concentrated in speech. Formant locations for each phonetic unit are distinct and depend on vocal tract shape and tongue position. Formants are numbered from lowest frequencies to highest: F1, F2 and so on.

Sequential constraints, or rules, governing permissible strings of phonemes in a given language. Each language allows different sequences. For example, the combination 'zb' is not permissible in English, but is a legal combination in Polish.

Pitch, tempo, stress and intonation, qualities that are superimposed on phonemes, syllables, words and phrases. These cues convey differences in meaning (statements versus questions), word stress (trochaic versus iambic), speaking styles (infant- versus adult-directed speech) and the emotional state of a speaker (happy versus sad).

Rights and permissions

Reprints and permissions

About this article

Cite this article.

Kuhl, P. Early language acquisition: cracking the speech code. Nat Rev Neurosci 5 , 831–843 (2004). https://doi.org/10.1038/nrn1533

Download citation

Issue Date : 01 November 2004

DOI : https://doi.org/10.1038/nrn1533

Share this article

Anyone you share the following link with will be able to read this content:

Sorry, a shareable link is not currently available for this article.

Provided by the Springer Nature SharedIt content-sharing initiative

This article is cited by

Emergence of the cortical encoding of phonetic features in the first year of life.

  • Giovanni M. Di Liberto
  • Adam Attaheri
  • Usha Goswami

Nature Communications (2023)

Word learning in ASD: the sensorimotor, the perceptual and the symbolic

  • Mila Vulchanova
  • Valentin Vulchanov
  • Melissa Allen

Journal of Cultural Cognitive Science (2023)

Tracking reading skills and reading-related skills in dyslexia before (age 5) and after (ages 10–17) diagnosis

  • Elise Lefèvre
  • Eddy Cavalli
  • Liliane Sprenger-Charolles

Annals of Dyslexia (2023)

Quick links

  • Explore articles by subject
  • Guide to authors
  • Editorial policies

Sign up for the Nature Briefing newsletter — what matters in science, free to your inbox daily.

research on language acquisition indicates that

APS

Observation

The littlest linguists: new research on language development.

  • Bilingualism
  • Developmental Psychology
  • Language Development

research on language acquisition indicates that

How do children learn language, and how is language related to other cognitive and social skills? For decades, the specialized field of developmental psycholinguistics has studied how children acquire language—or multiple languages—taking into account biological, neurological, and social factors that influence linguistic developments and, in turn, can play a role in how children learn and socialize. Here’s a look at recent research (2020–2021) on language development published in Psychological Science . 

Preverbal Infants Discover Statistical Word Patterns at Similar Rates as Adults: Evidence From Neural Entrainment

Dawoon Choi, Laura J. Batterink, Alexis K. Black, Ken A. Paller, and Janet F. Werker (2020)

One of the first challenges faced by infants during language acquisition is identifying word boundaries in continuous speech. This neurological research suggests that even preverbal infants can learn statistical patterns in language, indicating that they may have the ability to segment words within continuous speech.

Using electroencephalogram measures to track infants’ ability to segment words, Choi and colleagues found that 6-month-olds’ neural processing increasingly synchronized with the newly learned words embedded in speech over the learning period in one session in the laboratory. Specifically, patterns of electrical activity in their brains increasingly aligned with sensory regularities associated with word boundaries. This synchronization was comparable to that seen among adults and predicted future ability to discriminate words.

These findings indicate that infants and adults may follow similar learning trajectories when tracking probabilities in speech, with both groups showing a logarithmic (rather than linear) increase in the synchronization of neural processing with frequent words. Moreover, speech segmentation appears to use neural mechanisms that emerge early in life and are maintained throughout adulthood.

Parents Fine-Tune Their Speech to Children’s Vocabulary Knowledge

Ashley Leung, Alexandra Tunkel, and Daniel Yurovsky (2021)

Children can acquire language rapidly, possibly because their caregivers use language in ways that support such development. Specifically, caregivers’ language is often fine-tuned to children’s current linguistic knowledge and vocabulary, providing an optimal level of complexity to support language learning. In their new research, Leung and colleagues add to the body of knowledge involving how caregivers foster children’s language acquisition.

The researchers asked individual parents to play a game with their child (age 2–2.5 years) in which they guided their child to select a target animal from a set. Without prompting, the parents provided more informative references for animals they thought their children did not know. For example, if a parent thought their child did not know the word “leopard,” they might use adjectives (“the spotted, yellow leopard”) or comparisons (“the one like a cat”). This indicates that parents adjust their references to account for their children’s language knowledge and vocabulary—not in a simplifying way but in a way that could increase the children’s vocabulary. Parents also appeared to learn about their children’s knowledge throughout the game and to adjust their references accordingly.

Infant and Adult Brains Are Coupled to the Dynamics of Natural Communication

Elise A. Piazza, Liat Hasenfratz, Uri Hasson, and Casey Lew-Williams (2020)

This research tracked real-time brain activation during infant–adult interactions, providing an innovative measure of social interaction at an early age. When communicating with infants, adults appear to be sensitive to subtle cues that can modify their brain responses and behaviors to improve alignment with, and maximize information transfer to, the infants.

Piazza and colleagues used functional near-infrared spectroscopy—a noninvasive measure of blood oxygenation resulting from neural activity that is minimally affected by movements and thus allows participants to freely interact and move—to measure the brain activation of infants (9–15 months old) and adults while they communicated and played with each other. An adult experimenter either engaged directly with an infant by playing with toys, singing nursery rhymes, and reading a story or performed those same tasks while turned away from the child and toward another adult in the room.

Results indicated that when the adult interacted with the child (but not with the other adult), the activations of many prefrontal cortex (PFC) channels and some parietal channels were intercorrelated, indicating neural coupling of the adult’s and child’s brains. Both infant and adult PFC activation preceded moments of mutual gaze and increased before the infant smiled, with the infant’s PFC response preceding the adult’s. Infant PFC activity also preceded an increase in the pitch variability of the adult’s speech, although no changes occurred in the adult’s PFC, indicating that the adult’s speech influenced the infant but probably did not influence neural coupling between the child and the adult.

Theory-of-Mind Development in Young Deaf Children With Early Hearing Provisions

Chi-Lin Yu, Christopher M. Stanzione, Henry M. Wellman, and Amy R. Lederberg (2020)

Language and communication are important for social and cognitive development. Although deaf and hard-of-hearing (DHH) children born to deaf parents can communicate with their caregivers using sign language, most DHH children are born to hearing parents who do not have experience with sign language. These children may have difficulty with early communication and experience developmental delays. For instance, the development of theory of mind—the understanding of others’ mental states—is usually delayed in DHH children born to hearing parents.

Yu and colleagues studied how providing DHH children with hearing devices early in life (before 2 years of age) might enrich their early communication experiences and benefit their language development, supporting the typical development of other capabilities—in particular, theory of mind. The researchers show that 3- to 6-year-old DHH children who began using cochlear implants or hearing aids earlier had more advanced language abilities, leading to better theory-of-mind growth, than children who started using hearing provisions later. These findings highlight the relationships among hearing, language, and theory of mind.

The Bilingual Advantage in Children’s Executive Functioning Is Not Related to Language Status: A Meta-Analytic Review

Cassandra J. Lowe, Isu Cho, Samantha F. Goldsmith, and J. Bruce Morton (2021)

Acommon idea is that bilingual children, who grow up speaking two languages fluently, perform better than monolingual children in diverse executive-functioning domains (e.g., attention, working memory, decision making). This meta-analysis calls that idea into question.

Lowe and colleagues synthesized data from studies that compared the performance of monolingual and bilingual participants between the ages of 3 and 17 years in executive-functioning domains (1,194 effect sizes). They found only a small effect of bilingualism on participants’ executive functioning, which was largely explained by factors such as publication bias. After accounting for these factors, bilingualism had no distinguishable effect. The results of this large meta-analysis thus suggest that bilingual and monolingual children tend to perform at the same level in executive-functioning tasks. Bilingualism does not appear to boost performance in executive functions that serve learning, thinking, reasoning, or problem solving.

APS regularly opens certain online articles for discussion on our website. Effective February 2021, you must be a logged-in APS member to post comments. By posting a comment, you agree to our Community Guidelines and the display of your profile information, including your name and affiliation. Any opinions, findings, conclusions, or recommendations present in article comments are those of the writers and do not necessarily reflect the views of APS or the article’s author. For more information, please see our Community Guidelines .

Please login with your APS account to comment.

research on language acquisition indicates that

Teaching: Ethical Research to Help Romania’s Abandoned Children 

An early intervention experiment in Bucharest can introduce students to the importance of responsive caregiving during human development.

research on language acquisition indicates that

Silver Linings in the Demographic Revolution 

Podcast: In her final column as APS President, Alison Gopnik makes the case for more effectively and creatively caring for vulnerable humans at either end of life.

research on language acquisition indicates that

Communicating Psychological Science: The Lifelong Consequences of Early Language Skills

“When families are informed about the importance of conversational interaction and are provided training, they become active communicators and directly contribute to reducing the word gap (Leung et al., 2020).”

Privacy Overview

CookieDurationDescription
__cf_bm30 minutesThis cookie, set by Cloudflare, is used to support Cloudflare Bot Management.
CookieDurationDescription
AWSELBCORS5 minutesThis cookie is used by Elastic Load Balancing from Amazon Web Services to effectively balance load on the servers.
CookieDurationDescription
at-randneverAddThis sets this cookie to track page visits, sources of traffic and share counts.
CONSENT2 yearsYouTube sets this cookie via embedded youtube-videos and registers anonymous statistical data.
uvc1 year 27 daysSet by addthis.com to determine the usage of addthis.com service.
_ga2 yearsThe _ga cookie, installed by Google Analytics, calculates visitor, session and campaign data and also keeps track of site usage for the site's analytics report. The cookie stores information anonymously and assigns a randomly generated number to recognize unique visitors.
_gat_gtag_UA_3507334_11 minuteSet by Google to distinguish users.
_gid1 dayInstalled by Google Analytics, _gid cookie stores information on how visitors use a website, while also creating an analytics report of the website's performance. Some of the data that are collected include the number of visitors, their source, and the pages they visit anonymously.
CookieDurationDescription
loc1 year 27 daysAddThis sets this geolocation cookie to help understand the location of users who share the information.
VISITOR_INFO1_LIVE5 months 27 daysA cookie set by YouTube to measure bandwidth that determines whether the user gets the new or old player interface.
YSCsessionYSC cookie is set by Youtube and is used to track the views of embedded videos on Youtube pages.
yt-remote-connected-devicesneverYouTube sets this cookie to store the video preferences of the user using embedded YouTube video.
yt-remote-device-idneverYouTube sets this cookie to store the video preferences of the user using embedded YouTube video.
yt.innertube::nextIdneverThis cookie, set by YouTube, registers a unique ID to store data on what videos from YouTube the user has seen.
yt.innertube::requestsneverThis cookie, set by YouTube, registers a unique ID to store data on what videos from YouTube the user has seen.

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here .

Loading metrics

Open Access

Peer-reviewed

Research Article

The Critical Period Hypothesis in Second Language Acquisition: A Statistical Critique and a Reanalysis

* E-mail: [email protected]

Affiliation Department of Multilingualism, University of Fribourg, Fribourg, Switzerland

  • Jan Vanhove

PLOS

  • Published: July 25, 2013
  • https://doi.org/10.1371/journal.pone.0069172
  • Reader Comments

17 Jul 2014: The PLOS ONE Staff (2014) Correction: The Critical Period Hypothesis in Second Language Acquisition: A Statistical Critique and a Reanalysis. PLOS ONE 9(7): e102922. https://doi.org/10.1371/journal.pone.0102922 View correction

Figure 1

In second language acquisition research, the critical period hypothesis ( cph ) holds that the function between learners' age and their susceptibility to second language input is non-linear. This paper revisits the indistinctness found in the literature with regard to this hypothesis's scope and predictions. Even when its scope is clearly delineated and its predictions are spelt out, however, empirical studies–with few exceptions–use analytical (statistical) tools that are irrelevant with respect to the predictions made. This paper discusses statistical fallacies common in cph research and illustrates an alternative analytical method (piecewise regression) by means of a reanalysis of two datasets from a 2010 paper purporting to have found cross-linguistic evidence in favour of the cph . This reanalysis reveals that the specific age patterns predicted by the cph are not cross-linguistically robust. Applying the principle of parsimony, it is concluded that age patterns in second language acquisition are not governed by a critical period. To conclude, this paper highlights the role of confirmation bias in the scientific enterprise and appeals to second language acquisition researchers to reanalyse their old datasets using the methods discussed in this paper. The data and R commands that were used for the reanalysis are provided as supplementary materials.

Citation: Vanhove J (2013) The Critical Period Hypothesis in Second Language Acquisition: A Statistical Critique and a Reanalysis. PLoS ONE 8(7): e69172. https://doi.org/10.1371/journal.pone.0069172

Editor: Stephanie Ann White, UCLA, United States of America

Received: May 7, 2013; Accepted: June 7, 2013; Published: July 25, 2013

Copyright: © 2013 Jan Vanhove. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.

Funding: No current external funding sources for this study.

Competing interests: The author has declared that no competing interests exist.

Introduction

In the long term and in immersion contexts, second-language (L2) learners starting acquisition early in life – and staying exposed to input and thus learning over several years or decades – undisputedly tend to outperform later learners. Apart from being misinterpreted as an argument in favour of early foreign language instruction, which takes place in wholly different circumstances, this general age effect is also sometimes taken as evidence for a so-called ‘critical period’ ( cp ) for second-language acquisition ( sla ). Derived from biology, the cp concept was famously introduced into the field of language acquisition by Penfield and Roberts in 1959 [1] and was refined by Lenneberg eight years later [2] . Lenneberg argued that language acquisition needed to take place between age two and puberty – a period which he believed to coincide with the lateralisation process of the brain. (More recent neurological research suggests that different time frames exist for the lateralisation process of different language functions. Most, however, close before puberty [3] .) However, Lenneberg mostly drew on findings pertaining to first language development in deaf children, feral children or children with serious cognitive impairments in order to back up his claims. For him, the critical period concept was concerned with the implicit “automatic acquisition” [2, p. 176] in immersion contexts and does not preclude the possibility of learning a foreign language after puberty, albeit with much conscious effort and typically less success.

sla research adopted the critical period hypothesis ( cph ) and applied it to second and foreign language learning, resulting in a host of studies. In its most general version, the cph for sla states that the ‘susceptibility’ or ‘sensitivity’ to language input varies as a function of age, with adult L2 learners being less susceptible to input than child L2 learners. Importantly, the age–susceptibility function is hypothesised to be non-linear. Moving beyond this general version, we find that the cph is conceptualised in a multitude of ways [4] . This state of affairs requires scholars to make explicit their theoretical stance and assumptions [5] , but has the obvious downside that critical findings risk being mitigated as posing a problem to only one aspect of one particular conceptualisation of the cph , whereas other conceptualisations remain unscathed. This overall vagueness concerns two areas in particular, viz. the delineation of the cph 's scope and the formulation of testable predictions. Delineating the scope and formulating falsifiable predictions are, needless to say, fundamental stages in the scientific evaluation of any hypothesis or theory, but the lack of scholarly consensus on these points seems to be particularly pronounced in the case of the cph . This article therefore first presents a brief overview of differing views on these two stages. Then, once the scope of their cph version has been duly identified and empirical data have been collected using solid methods, it is essential that researchers analyse the data patterns soundly in order to assess the predictions made and that they draw justifiable conclusions from the results. As I will argue in great detail, however, the statistical analysis of data patterns as well as their interpretation in cph research – and this includes both critical and supportive studies and overviews – leaves a great deal to be desired. Reanalysing data from a recent cph -supportive study, I illustrate some common statistical fallacies in cph research and demonstrate how one particular cph prediction can be evaluated.

Delineating the scope of the critical period hypothesis

First, the age span for a putative critical period for language acquisition has been delimited in different ways in the literature [4] . Lenneberg's critical period stretched from two years of age to puberty (which he posits at about 14 years of age) [2] , whereas other scholars have drawn the cutoff point at 12, 15, 16 or 18 years of age [6] . Unlike Lenneberg, most researchers today do not define a starting age for the critical period for language learning. Some, however, consider the possibility of the critical period (or a critical period for a specific language area, e.g. phonology) ending much earlier than puberty (e.g. age 9 years [1] , or as early as 12 months in the case of phonology [7] ).

Second, some vagueness remains as to the setting that is relevant to the cph . Does the critical period constrain implicit learning processes only, i.e. only the untutored language acquisition in immersion contexts or does it also apply to (at least partly) instructed learning? Most researchers agree on the former [8] , but much research has included subjects who have had at least some instruction in the L2.

Third, there is no consensus on what the scope of the cp is as far as the areas of language that are concerned. Most researchers agree that a cp is most likely to constrain the acquisition of pronunciation and grammar and, consequently, these are the areas primarily looked into in studies on the cph [9] . Some researchers have also tried to define distinguishable cp s for the different language areas of phonetics, morphology and syntax and even for lexis (see [10] for an overview).

Fourth and last, research into the cph has focused on ‘ultimate attainment’ ( ua ) or the ‘final’ state of L2 proficiency rather than on the rate of learning. From research into the rate of acquisition (e.g. [11] – [13] ), it has become clear that the cph cannot hold for the rate variable. In fact, it has been observed that adult learners proceed faster than child learners at the beginning stages of L2 acquisition. Though theoretical reasons for excluding the rate can be posited (the initial faster rate of learning in adults may be the result of more conscious cognitive strategies rather than to less conscious implicit learning, for instance), rate of learning might from a different perspective also be considered an indicator of ‘susceptibility’ or ‘sensitivity’ to language input. Nevertheless, contemporary sla scholars generally seem to concur that ua and not rate of learning is the dependent variable of primary interest in cph research. These and further scope delineation problems relevant to cph research are discussed in more detail by, among others, Birdsong [9] , DeKeyser and Larson-Hall [14] , Long [10] and Muñoz and Singleton [6] .

Formulating testable hypotheses

Once the relevant cph 's scope has satisfactorily been identified, clear and testable predictions need to be drawn from it. At this stage, the lack of consensus on what the consequences or the actual observable outcome of a cp would have to look like becomes evident. As touched upon earlier, cph research is interested in the end state or ‘ultimate attainment’ ( ua ) in L2 acquisition because this “determines the upper limits of L2 attainment” [9, p. 10]. The range of possible ultimate attainment states thus helps researchers to explore the potential maximum outcome of L2 proficiency before and after the putative critical period.

One strong prediction made by some cph exponents holds that post- cp learners cannot reach native-like L2 competences. Identifying a single native-like post- cp L2 learner would then suffice to falsify all cph s making this prediction. Assessing this prediction is difficult, however, since it is not clear what exactly constitutes sufficient nativelikeness, as illustrated by the discussion on the actual nativelikeness of highly accomplished L2 speakers [15] , [16] . Indeed, there exists a real danger that, in a quest to vindicate the cph , scholars set the bar for L2 learners to match monolinguals increasingly higher – up to Swiftian extremes. Furthermore, the usefulness of comparing the linguistic performance in mono- and bilinguals has been called into question [6] , [17] , [18] . Put simply, the linguistic repertoires of mono- and bilinguals differ by definition and differences in the behavioural outcome will necessarily be found, if only one digs deep enough.

A second strong prediction made by cph proponents is that the function linking age of acquisition and ultimate attainment will not be linear throughout the whole lifespan. Before discussing how this function would have to look like in order for it to constitute cph -consistent evidence, I point out that the ultimate attainment variable can essentially be considered a cumulative measure dependent on the actual variable of interest in cph research, i.e. susceptibility to language input, as well as on such other factors like duration and intensity of learning (within and outside a putative cp ) and possibly a number of other influencing factors. To elaborate, the behavioural outcome, i.e. ultimate attainment, can be assumed to be integrative to the susceptibility function, as Newport [19] correctly points out. Other things being equal, ultimate attainment will therefore decrease as susceptibility decreases. However, decreasing ultimate attainment levels in and by themselves represent no compelling evidence in favour of a cph . The form of the integrative curve must therefore be predicted clearly from the susceptibility function. Additionally, the age of acquisition–ultimate attainment function can take just about any form when other things are not equal, e.g. duration of learning (Does learning last up until time of testing or only for a more or less constant number of years or is it dependent on age itself?) or intensity of learning (Do learners always learn at their maximum susceptibility level or does this intensity vary as a function of age, duration, present attainment and motivation?). The integral of the susceptibility function could therefore be of virtually unlimited complexity and its parameters could be adjusted to fit any age of acquisition–ultimate attainment pattern. It seems therefore astonishing that the distinction between level of sensitivity to language input and level of ultimate attainment is rarely made in the literature. Implicitly or explicitly [20] , the two are more or less equated and the same mathematical functions are expected to describe the two variables if observed across a range of starting ages of acquisition.

But even when the susceptibility and ultimate attainment variables are equated, there remains controversy as to what function linking age of onset of acquisition and ultimate attainment would actually constitute evidence for a critical period. Most scholars agree that not any kind of age effect constitutes such evidence. More specifically, the age of acquisition–ultimate attainment function would need to be different before and after the end of the cp [9] . According to Birdsong [9] , three basic possible patterns proposed in the literature meet this condition. These patterns are presented in Figure 1 . The first pattern describes a steep decline of the age of onset of acquisition ( aoa )–ultimate attainment ( ua ) function up to the end of the cp and a practically non-existent age effect thereafter. Pattern 2 is an “unconventional, although often implicitly invoked” [9, p. 17] notion of the cp function which contains a period of peak attainment (or performance at ceiling), i.e. performance does not vary as a function of age, which is often referred to as a ‘window of opportunity’. This time span is followed by an unbounded decline in ua depending on aoa . Pattern 3 includes characteristics of patterns 1 and 2. At the beginning of the aoa range, performance is at ceiling. The next segment is a downward slope in the age function which ends when performance reaches its floor. Birdsong points out that all of these patterns have been reported in the literature. On closer inspection, however, he concludes that the most convincing function describing these age effects is a simple linear one. Hakuta et al. [21] sketch further theoretically possible predictions of the cph in which the mean performance drops drastically and/or the slope of the aoa – ua proficiency function changes at a certain point.

thumbnail

  • PPT PowerPoint slide
  • PNG larger image
  • TIFF original image

The graphs are based on based on Figure 2 in [9] .

https://doi.org/10.1371/journal.pone.0069172.g001

Although several patterns have been proposed in the literature, it bears pointing out that the most common explicit prediction corresponds to Birdsong's first pattern, as exemplified by the following crystal-clear statement by DeKeyser, one of the foremost cph proponents:

[A] strong negative correlation between age of acquisition and ultimate attainment throughout the lifespan (or even from birth through middle age), the only age effect documented in many earlier studies, is not evidence for a critical period…[T]he critical period concept implies a break in the AoA–proficiency function, i.e., an age (somewhat variable from individual to individual, of course, and therefore an age range in the aggregate) after which the decline of success rate in one or more areas of language is much less pronounced and/or clearly due to different reasons. [22, p. 445].

DeKeyser and before him among others Johnson and Newport [23] thus conceptualise only one possible pattern which would speak in favour of a critical period: a clear negative age effect before the end of the critical period and a much weaker (if any) negative correlation between age and ultimate attainment after it. This ‘flattened slope’ prediction has the virtue of being much more tangible than the ‘potential nativelikeness’ prediction: Testing it does not necessarily require comparing the L2-learners to a native control group and thus effectively comparing apples and oranges. Rather, L2-learners with different aoa s can be compared amongst themselves without the need to categorise them by means of a native-speaker yardstick, the validity of which is inevitably going to be controversial [15] . In what follows, I will concern myself solely with the ‘flattened slope’ prediction, arguing that, despite its clarity of formulation, cph research has generally used analytical methods that are irrelevant for the purposes of actually testing it.

Inferring non-linearities in critical period research: An overview

research on language acquisition indicates that

Group mean or proportion comparisons.

research on language acquisition indicates that

[T]he main differences can be found between the native group and all other groups – including the earliest learner group – and between the adolescence group and all other groups. However, neither the difference between the two childhood groups nor the one between the two adulthood groups reached significance, which indicates that the major changes in eventual perceived nativelikeness of L2 learners can be associated with adolescence. [15, p. 270].

Similar group comparisons aimed at investigating the effect of aoa on ua have been carried out by both cph advocates and sceptics (among whom Bialystok and Miller [25, pp. 136–139], Birdsong and Molis [26, p. 240], Flege [27, pp. 120–121], Flege et al. [28, pp. 85–86], Johnson [29, p. 229], Johnson and Newport [23, p. 78], McDonald [30, pp. 408–410] and Patowski [31, pp. 456–458]). To be clear, not all of these authors drew direct conclusions about the aoa – ua function on the basis of these groups comparisons, but their group comparisons have been cited as indicative of a cph -consistent non-continuous age effect, as exemplified by the following quote by DeKeyser [22] :

Where group comparisons are made, younger learners always do significantly better than the older learners. The behavioral evidence, then, suggests a non-continuous age effect with a “bend” in the AoA–proficiency function somewhere between ages 12 and 16. [22, p. 448].

The first problem with group comparisons like these and drawing inferences on the basis thereof is that they require that a continuous variable, aoa , be split up into discrete bins. More often than not, the boundaries between these bins are drawn in an arbitrary fashion, but what is more troublesome is the loss of information and statistical power that such discretisation entails (see [32] for the extreme case of dichotomisation). If we want to find out more about the relationship between aoa and ua , why throw away most of the aoa information and effectively reduce the ua data to group means and the variance in those groups?

research on language acquisition indicates that

Comparison of correlation coefficients.

research on language acquisition indicates that

Correlation-based inferences about slope discontinuities have similarly explicitly been made by cph advocates and skeptics alike, e.g. Bialystok and Miller [25, pp. 136 and 140], DeKeyser and colleagues [22] , [44] and Flege et al. [45, pp. 166 and 169]. Others did not explicitly infer the presence or absence of slope differences from the subset correlations they computed (among others Birdsong and Molis [26] , DeKeyser [8] , Flege et al. [28] and Johnson [29] ), but their studies nevertheless featured in overviews discussing discontinuities [14] , [22] . Indeed, the most recent overview draws a strong conclusion about the validity of the cph 's ‘flattened slope’ prediction on the basis of these subset correlations:

In those studies where the two groups are described separately, the correlation is much higher for the younger than for the older group, except in Birdsong and Molis (2001) [ =  [26] , JV], where there was a ceiling effect for the younger group. This global picture from more than a dozen studies provides support for the non-continuity of the decline in the AoA–proficiency function, which all researchers agree is a hallmark of a critical period phenomenon. [22, p. 448].

In Johnson and Newport's specific case [23] , their correlation-based inference that ua levels off after puberty happened to be largely correct: the gjt scores are more or less randomly distributed around a near-horizontal trend line [26] . Ultimately, however, it rests on the fallacy of confusing correlation coefficients with slopes, which seriously calls into question conclusions such as DeKeyser's (cf. the quote above).

research on language acquisition indicates that

https://doi.org/10.1371/journal.pone.0069172.g002

research on language acquisition indicates that

Lower correlation coefficients in older aoa groups may therefore be largely due to differences in ua variance, which have been reported in several studies [23] , [26] , [28] , [29] (see [46] for additional references). Greater variability in ua with increasing age is likely due to factors other than age proper [47] , such as the concomitant greater variability in exposure to literacy, degree of education, motivation and opportunity for language use, and by itself represents evidence neither in favour of nor against the cph .

Regression approaches.

Having demonstrated that neither group mean or proportion comparisons nor correlation coefficient comparisons can directly address the ‘flattened slope’ prediction, I now turn to the studies in which regression models were computed with aoa as a predictor variable and ua as the outcome variable. Once again, this category of studies is not mutually exclusive with the two categories discussed above.

In a large-scale study using self-reports and approximate aoa s derived from a sample of the 1990 U.S. Census, Stevens found that the probability with which immigrants from various countries stated that they spoke English ‘very well’ decreased curvilinearly as a function of aoa [48] . She noted that this development is similar to the pattern found by Johnson and Newport [23] but that it contains no indication of an “abruptly defined ‘critical’ or sensitive period in L2 learning” [48, p. 569]. However, she modelled the self-ratings using an ordinal logistic regression model in which the aoa variable was logarithmically transformed. Technically, this is perfectly fine, but one should be careful not to read too much into the non-linear curves found. In logistic models, the outcome variable itself is modelled linearly as a function of the predictor variables and is expressed in log-odds. In order to compute the corresponding probabilities, these log-odds are transformed using the logistic function. Consequently, even if the model is specified linearly, the predicted probabilities will not lie on a perfectly straight line when plotted as a function of any one continuous predictor variable. Similarly, when the predictor variable is first logarithmically transformed and then used to linearly predict an outcome variable, the function linking the predicted outcome variables and the untransformed predictor variable is necessarily non-linear. Thus, non-linearities follow naturally from Stevens's model specifications. Moreover, cph -consistent discontinuities in the aoa – ua function cannot be found using her model specifications as they did not contain any parameters allowing for this.

Using data similar to Stevens's, Bialystok and Hakuta found that the link between the self-rated English competences of Chinese- and Spanish-speaking immigrants and their aoa could be described by a straight line [49] . In contrast to Stevens, Bialystok and Hakuta used a regression-based method allowing for changes in the function's slope, viz. locally weighted scatterplot smoothing ( lowess ). Informally, lowess is a non-parametrical method that relies on an algorithm that fits the dependent variable for small parts of the range of the independent variable whilst guaranteeing that the overall curve does not contain sudden jumps (for technical details, see [50] ). Hakuta et al. used an even larger sample from the same 1990 U.S. Census data on Chinese- and Spanish-speaking immigrants (2.3 million observations) [21] . Fitting lowess curves, no discontinuities in the aoa – ua slope could be detected. Moreover, the authors found that piecewise linear regression models, i.e. regression models containing a parameter that allows a sudden drop in the curve or a change of its slope, did not provide a better fit to the data than did an ordinary regression model without such a parameter.

research on language acquisition indicates that

To sum up, I have argued at length that regression approaches are superior to group mean and correlation coefficient comparisons for the purposes of testing the ‘flattened slope’ prediction. Acknowledging the reservations vis-à-vis self-estimated ua s, we still find that while the relationship between aoa and ua is not necessarily perfectly linear in the studies discussed, the data do not lend unequivocal support to this prediction. In the following section, I will reanalyse data from a recent empirical paper on the cph by DeKeyser et al. [44] . The first goal of this reanalysis is to further illustrate some of the statistical fallacies encountered in cph studies. Second, by making the computer code available I hope to demonstrate how the relevant regression models, viz. piecewise regression models, can be fitted and how the aoa representing the optimal breakpoint can be identified. Lastly, the findings of this reanalysis will contribute to our understanding of how aoa affects ua as measured using a gjt .

Summary of DeKeyser et al. (2010)

I chose to reanalyse a recent empirical paper on the cph by DeKeyser et al. [44] (henceforth DK et al.). This paper lends itself well to a reanalysis since it exhibits two highly commendable qualities: the authors spell out their hypotheses lucidly and provide detailed numerical and graphical data descriptions. Moreover, the paper's lead author is very clear on what constitutes a necessary condition for accepting the cph : a non-linearity in the age of onset of acquisition ( aoa )–ultimate attainment ( ua ) function, with ua declining less strongly as a function of aoa in older, post- cp arrivals compared to younger arrivals [14] , [22] . Lastly, it claims to have found cross-linguistic evidence from two parallel studies backing the cph and should therefore be an unsuspected source to cph proponents.

research on language acquisition indicates that

The authors set out to test the following hypotheses:

  • Hypothesis 1: For both the L2 English and the L2 Hebrew group, the slope of the age of arrival–ultimate attainment function will not be linear throughout the lifespan, but will instead show a marked flattening between adolescence and adulthood.
  • Hypothesis 2: The relationship between aptitude and ultimate attainment will differ markedly for the young and older arrivals, with significance only for the latter. (DK et al., p. 417)

Both hypotheses were purportedly confirmed, which in the authors' view provides evidence in favour of cph . The problem with this conclusion, however, is that it is based on a comparison of correlation coefficients. As I have argued above, correlation coefficients are not to be confused with regression coefficients and cannot be used to directly address research hypotheses concerning slopes, such as Hypothesis 1. In what follows, I will reanalyse the relationship between DK et al.'s aoa and gjt data in order to address Hypothesis 1. Additionally, I will lay bare a problem with the way in which Hypothesis 2 was addressed. The extracted data and the computer code used for the reanalysis are provided as supplementary materials, allowing anyone interested to scrutinise and easily reproduce my whole analysis and carry out their own computations (see ‘supporting information’).

Data extraction

research on language acquisition indicates that

In order to verify whether we did in fact extract the data points to a satisfactory degree of accuracy, I computed summary statistics for the extracted aoa and gjt data and checked these against the descriptive statistics provided by DK et al. (pp. 421 and 427). These summary statistics for the extracted data are presented in Table 1 . In addition, I computed the correlation coefficients for the aoa – gjt relationship for the whole aoa range and for aoa -defined subgroups and checked these coefficients against those reported by DK et al. (pp. 423 and 428). The correlation coefficients computed using the extracted data are presented in Table 2 . Both checks strongly suggest the extracted data to be virtually identical to the original data, and Dr DeKeyser confirmed this to be the case in response to an earlier draft of the present paper (personal communication, 6 May 2013).

thumbnail

https://doi.org/10.1371/journal.pone.0069172.t001

thumbnail

https://doi.org/10.1371/journal.pone.0069172.t002

Results and Discussion

Modelling the link between age of onset of acquisition and ultimate attainment.

I first replotted the aoa and gjt data we extracted from DK et al.'s scatterplots and added non-parametric scatterplot smoothers in order to investigate whether any changes in slope in the aoa – gjt function could be revealed, as per Hypothesis 1. Figures 3 and 4 show this not to be the case. Indeed, simple linear regression models that model gjt as a function of aoa provide decent fits for both the North America and the Israel data, explaining 65% and 63% of the variance in gjt scores, respectively. The parameters of these models are given in Table 3 .

thumbnail

The trend line is a non-parametric scatterplot smoother. The scatterplot itself is a near-perfect replication of DK et al.'s Fig. 1.

https://doi.org/10.1371/journal.pone.0069172.g003

thumbnail

The trend line is a non-parametric scatterplot smoother. The scatterplot itself is a near-perfect replication of DK et al.'s Fig. 5.

https://doi.org/10.1371/journal.pone.0069172.g004

thumbnail

https://doi.org/10.1371/journal.pone.0069172.t003

research on language acquisition indicates that

To ensure that both segments are joined at the breakpoint, the predictor variable is first centred at the breakpoint value, i.e. the breakpoint value is subtracted from the original predictor variable values. For a blow-by-blow account of how such models can be fitted in r , I refer to an example analysis by Baayen [55, pp. 214–222].

research on language acquisition indicates that

Solid: regression with breakpoint at aoa 18 (dashed lines represent its 95% confidence interval); dot-dash: regression without breakpoint.

https://doi.org/10.1371/journal.pone.0069172.g005

thumbnail

Solid: regression with breakpoint at aoa 18 (dashed lines represent its 95% confidence interval); dot-dash (hardly visible due to near-complete overlap): regression without breakpoint.

https://doi.org/10.1371/journal.pone.0069172.g006

thumbnail

https://doi.org/10.1371/journal.pone.0069172.t004

research on language acquisition indicates that

https://doi.org/10.1371/journal.pone.0069172.g007

thumbnail

Solid: regression with breakpoint at aoa 16 (dashed lines represent its 95% confidence interval); dot-dash: regression without breakpoint.

https://doi.org/10.1371/journal.pone.0069172.g008

thumbnail

Solid: regression with breakpoint at aoa 6 (dashed lines represent its 95% confidence interval); dot-dash (hardly visible due to near-complete overlap): regression without breakpoint.

https://doi.org/10.1371/journal.pone.0069172.g009

thumbnail

https://doi.org/10.1371/journal.pone.0069172.t005

thumbnail

https://doi.org/10.1371/journal.pone.0069172.t006

thumbnail

https://doi.org/10.1371/journal.pone.0069172.t007

thumbnail

https://doi.org/10.1371/journal.pone.0069172.t008

research on language acquisition indicates that

In sum, a regression model that allows for changes in the slope of the the aoa – gjt function to account for putative critical period effects provides a somewhat better fit to the North American data than does an everyday simple regression model. The improvement in model fit is marginal, however, and including a breakpoint does not result in any detectable improvement of model fit to the Israel data whatsoever. Breakpoint models therefore fail to provide solid cross-linguistic support in favour of critical period effects: across both data sets, gjt can satisfactorily be modelled as a linear function of aoa .

On partialling out ‘age at testing’

As I have argued above, correlation coefficients cannot be used to test hypotheses about slopes. When the correct procedure is carried out on DK et al.'s data, no cross-linguistically robust evidence for changes in the aoa – gjt function was found. In addition to comparing the zero-order correlations between aoa and gjt , however, DK et al. computed partial correlations in which the variance in aoa associated with the participants' age at testing ( aat ; a potentially confounding variable) was filtered out. They found that these partial correlations between aoa and gjt , which are given in Table 9 , differed between age groups in that they are stronger for younger than for older participants. This, DK et al. argue, constitutes additional evidence in favour of the cph . At this point, I can no longer provide my own analysis of DK et al.'s data seeing as the pertinent data points were not plotted. Nevertheless, the detailed descriptions by DK et al. strongly suggest that the use of these partial correlations is highly problematic. Most importantly, and to reiterate, correlations (whether zero-order or partial ones) are actually of no use when testing hypotheses concerning slopes. Still, one may wonder why the partial correlations differ across age groups. My surmise is that these differences are at least partly the by-product of an imbalance in the sampling procedure.

thumbnail

https://doi.org/10.1371/journal.pone.0069172.t009

research on language acquisition indicates that

The upshot of this brief discussion is that the partial correlation differences reported by DK et al. are at least partly the result of an imbalance in the sampling procedure: aoa and aat were simply less intimately tied for the young arrivals in the North America study than for the older arrivals with L2 English or for all of the L2 Hebrew participants. In an ideal world, we would like to fix aat or ascertain that it at most only weakly correlates with aoa . This, however, would result in a strong correlation between aoa and another potential confound variable, length of residence in the L2 environment, bringing us back to square one. Allowing for only moderate correlations between aoa and aat might improve our predicament somewhat, but even in that case, we should tread lightly when making inferences on the basis of statistical control procedures [61] .

On estimating the role of aptitude

Having shown that Hypothesis 1 could not be confirmed, I now turn to Hypothesis 2, which predicts a differential role of aptitude for ua in sla in different aoa groups. More specifically, it states that the correlation between aptitude and gjt performance will be significant only for older arrivals. The correlation coefficients of the relationship between aptitude and gjt are presented in Table 10 .

thumbnail

https://doi.org/10.1371/journal.pone.0069172.t010

The problem with both the wording of Hypothesis 2 and the way in which it is addressed is the following: it is assumed that a variable has a reliably different effect in different groups when the effect reaches significance in one group but not in the other. This logic is fairly widespread within several scientific disciplines (see e.g. [62] for a discussion). Nonetheless, it is demonstrably fallacious [63] . Here we will illustrate the fallacy for the specific case of comparing two correlation coefficients.

research on language acquisition indicates that

Apart from not being replicated in the North America study, does this difference actually show anything? I contend that it does not: what is of interest are not so much the correlation coefficients, but rather the interactions between aoa and aptitude in models predicting gjt . These interactions could be investigated by fitting a multiple regression model in which the postulated cp breakpoint governs the slope of both aoa and aptitude. If such a model provided a substantially better fit to the data than a model without a breakpoint for the aptitude slope and if the aptitude slope changes in the expected direction (i.e. a steeper slope for post- cp than for younger arrivals) for different L1–L2 pairings, only then would this particular prediction of the cph be borne out.

Using data extracted from a paper reporting on two recent studies that purport to provide evidence in favour of the cph and that, according to its authors, represent a major improvement over earlier studies (DK et al., p. 417), it was found that neither of its two hypotheses were actually confirmed when using the proper statistical tools. As a matter of fact, the gjt scores continue to decline at essentially the same rate even beyond the end of the putative critical period. According to the paper's lead author, such a finding represents a serious problem to his conceptualisation of the cph [14] ). Moreover, although modelling a breakpoint representing the end of a cp at aoa 16 may improve the statistical model slightly in study on learners of English in North America, the study on learners of Hebrew in Israel fails to confirm this finding. In fact, even if we were to accept the optimal breakpoint computed for the Israel study, it lies at aoa 6 and is associated with a different geometrical pattern.

Diverging age trends in parallel studies with participants with different L2s have similarly been reported by Birdsong and Molis [26] and are at odds with an L2-independent cph . One parsimonious explanation of such conflicting age trends may be that the overall, cross-linguistic age trend is in fact linear, but that fluctuations in the data (due to factors unaccounted for or randomness) may sometimes give rise to a ‘stretched L’-shaped pattern ( Figure 1, left panel ) and sometimes to a ‘stretched 7’-shaped pattern ( Figure 1 , middle panel; see also [66] for a similar comment).

Importantly, the criticism that DeKeyser and Larsson-Hall levy against two studies reporting findings similar to the present [48] , [49] , viz. that the data consisted of self-ratings of questionable validity [14] , does not apply to the present data set. In addition, DK et al. did not exclude any outliers from their analyses, so I assume that DeKeyser and Larsson-Hall's criticism [14] of Birdsong and Molis's study [26] , i.e. that the findings were due to the influence of outliers, is not applicable to the present data either. For good measure, however, I refitted the regression models with and without breakpoints after excluding one potentially problematic data point per model. The following data points had absolute standardised residuals larger than 2.5 in the original models without breakpoints as well as in those with breakpoints: the participant with aoa 17 and a gjt score of 125 in the North America study and the participant with aoa 12 and a gjt score of 117 in the Israel study. The resultant models were virtually identical to the original models (see Script S1 ). Furthermore, the aoa variable was sufficiently fine-grained and the aoa – gjt curve was not ‘presmoothed’ by the prior aggregation of gjt across parts of the aoa range (see [51] for such a criticism of another study). Lastly, seven of the nine “problems with supposed counter-evidence” to the cph discussed by Long [5] do not apply either, viz. (1) “[c]onfusion of rate and ultimate attainment”, (2) “[i]nappropriate choice of subjects”, (3) “[m]easurement of AO”, (4) “[l]eading instructions to raters”, (6) “[u]se of markedly non-native samples making near-native samples more likely to sound native to raters”, (7) “[u]nreliable or invalid measures”, and (8) “[i]nappropriate L1–L2 pairings”. Problem No. 5 (“Assessments based on limited samples and/or “language-like” behavior”) may be apropos given that only gjt data were used, leaving open the theoretical possibility that other measures might have yielded a different outcome. Finally, problem No. 9 (“Faulty interpretation of statistical patterns”) is, of course, precisely what I have turned the spotlights on.

Conclusions

The critical period hypothesis remains a hotly contested issue in the psycholinguistics of second-language acquisition. Discussions about the impact of empirical findings on the tenability of the cph generally revolve around the reliability of the data gathered (e.g. [5] , [14] , [22] , [52] , [67] , [68] ) and such methodological critiques are of course highly desirable. Furthermore, the debate often centres on the question of exactly what version of the cph is being vindicated or debunked. These versions differ mainly in terms of its scope, specifically with regard to the relevant age span, setting and language area, and the testable predictions they make. But even when the cph 's scope is clearly demarcated and its main prediction is spelt out lucidly, the issue remains to what extent the empirical findings can actually be marshalled in support of the relevant cph version. As I have shown in this paper, empirical data have often been taken to support cph versions predicting that the relationship between age of acquisition and ultimate attainment is not strictly linear, even though the statistical tools most commonly used (notably group mean and correlation coefficient comparisons) were, crudely put, irrelevant to this prediction. Methods that are arguably valid, e.g. piecewise regression and scatterplot smoothing, have been used in some studies [21] , [26] , [49] , but these studies have been criticised on other grounds. To my knowledge, such methods have never been used by scholars who explicitly subscribe to the cph .

I suspect that what may be going on is a form of ‘confirmation bias’ [69] , a cognitive bias at play in diverse branches of human knowledge seeking: Findings judged to be consistent with one's own hypothesis are hardly questioned, whereas findings inconsistent with one's own hypothesis are scrutinised much more strongly and criticised on all sorts of points [70] – [73] . My reanalysis of DK et al.'s recent paper may be a case in point. cph exponents used correlation coefficients to address their prediction about the slope of a function, as had been done in a host of earlier studies. Finding a result that squared with their expectations, they did not question the technical validity of their results, or at least they did not report this. (In fact, my reanalysis is actually a case in point in two respects: for an earlier draft of this paper, I had computed the optimal position of the breakpoints incorrectly, resulting in an insignificant improvement of model fit for the North American data rather than a borderline significant one. Finding a result that squared with my expectations, I did not question the technical validity of my results – until this error was kindly pointed out to me by Martijn Wieling (University of Tübingen).) That said, I am keen to point out that the statistical analyses in this particular paper, though suboptimal, are, as far as I could gather, reported correctly, i.e. the confirmation bias does not seem to have resulted in the blatant misreportings found elsewhere (see [74] for empirical evidence and discussion). An additional point to these authors' credit is that, apart from explicitly identifying their cph version's scope and making crystal-clear predictions, they present data descriptions that actually permit quantitative reassessments and have a history of doing so (e.g. the appendix in [8] ). This leads me to believe that they analysed their data all in good conscience and to hope that they, too, will conclude that their own data do not, in fact, support their hypothesis.

I end this paper on an upbeat note. Even though I have argued that the analytical tools employed in cph research generally leave much to be desired, the original data are, so I hope, still available. This provides researchers, cph supporters and sceptics alike, with an exciting opportunity to reanalyse their data sets using the tools outlined in the present paper and publish their findings at minimal cost of time and resources (for instance, as a comment to this paper). I would therefore encourage scholars to engage their old data sets and to communicate their analyses openly, e.g. by voluntarily publishing their data and computer code alongside their articles or comments. Ideally, cph supporters and sceptics would join forces to agree on a protocol for a high-powered study in order to provide a truly convincing answer to a core issue in sla .

Supporting Information

Dataset s1..

aoa and gjt data extracted from DeKeyser et al.'s North America study.

https://doi.org/10.1371/journal.pone.0069172.s001

Dataset S2.

aoa and gjt data extracted from DeKeyser et al.'s Israel study.

https://doi.org/10.1371/journal.pone.0069172.s002

Script with annotated R code used for the reanalysis. All add-on packages used can be installed from within R.

https://doi.org/10.1371/journal.pone.0069172.s003

Acknowledgments

I would like to thank Irmtraud Kaiser (University of Fribourg) for helping me to get an overview of the literature on the critical period hypothesis in second language acquisition. Thanks are also due to Martijn Wieling (currently University of Tübingen) for pointing out an error in the R code accompanying an earlier draft of this paper.

Author Contributions

Analyzed the data: JV. Wrote the paper: JV.

  • 1. Penfield W, Roberts L (1959) Speech and brain mechanisms. Princeton: Princeton University Press.
  • 2. Lenneberg EH (1967) Biological foundations of language. New York: Wiley.
  • View Article
  • Google Scholar
  • 10. Long MH (2007) Problems in SLA. Mahwah, NJ: Lawrence Erlbaum.
  • 14. DeKeyser R, Larson-Hall J (2005) What does the critical period really mean? In: Kroll and De Groot [75], 88–108.
  • 19. Newport EL (1991) Contrasting conceptions of the critical period for language. In: Carey S, Gelman R, editors, The epigenesis of mind: Essays on biology and cognition, Hillsdale, NJ: Lawrence Erlbaum. 111–130.
  • 20. Birdsong D (2005) Interpreting age effects in second language acquisition. In: Kroll and De Groot [75], 109–127.
  • 22. DeKeyser R (2012) Age effects in second language learning. In: Gass SM, Mackey A, editors, The Routledge handbook of second language acquisition, London: Routledge. 442–460.
  • 24. Weisstein EW. Discontinuity. From MathWorld –A Wolfram Web Resource. Available: http://mathworld.wolfram.com/Discontinuity.html . Accessed 2012 March 2.
  • 27. Flege JE (1999) Age of learning and second language speech. In: Birdsong [76], 101–132.
  • 36. Champely S (2009) pwr: Basic functions for power analysis. Available: http://cran.r-project.org/package=pwr . R package, version 1.1.1.
  • 37. R Core Team (2013) R: A language and environment for statistical computing. Available: http://www.r-project.org/ . Software, version 2.15.3.
  • 47. Hyltenstam K, Abrahamsson N (2003) Maturational constraints in sla . In: Doughty CJ, Long MH, editors, The handbook of second language acquisition, Malden, MA: Blackwell. 539–588.
  • 49. Bialystok E, Hakuta K (1999) Confounded age: Linguistic and cognitive factors in age differences for second language acquisition. In: Birdsong [76], 161–181.
  • 52. DeKeyser R (2006) A critique of recent arguments against the critical period hypothesis. In: Abello-Contesse C, Chacón-Beltrán R, López-Jiménez MD, Torreblanca-López MM, editors, Age in L2 acquisition and teaching, Bern: Peter Lang. 49–58.
  • 55. Baayen RH (2008) Analyzing linguistic data: A practical introduction to statistics using R. Cambridge: Cambridge University Press.
  • 56. Fox J (2002) Robust regression. Appendix to An R and S-Plus Companion to Applied Regression. Available: http://cran.r-project.org/doc/contrib/Fox-Companion/appendix.html .
  • 57. Ripley B, Hornik K, Gebhardt A, Firth D (2012) MASS: Support functions and datasets for Venables and Ripley's MASS. Available: http://cran.r-project.org/package=MASS . R package, version 7.3–17.
  • 58. Zuur AF, Ieno EN, Walker NJ, Saveliev AA, Smith GM (2009) Mixed effects models and extensions in ecology with R. New York: Springer.
  • 59. Pinheiro J, Bates D, DebRoy S, Sarkar D, R Core Team (2013) nlme: Linear and nonlinear mixed effects models. Available: http://cran.r-project.org/package=nlme . R package, version 3.1–108.
  • 65. Field A (2009) Discovering statistics using SPSS. London: SAGE 3rd edition.
  • 66. Birdsong D (2009) Age and the end state of second language acquisition. In: Ritchie WC, Bhatia TK, editors, The new handbook of second language acquisition, Bingley: Emerlad. 401–424.
  • 75. Kroll JF, De Groot AMB, editors (2005) Handbook of bilingualism: Psycholinguistic approaches. New York: Oxford University Press.
  • 76. Birdsong D, editor (1999) Second language acquisition and the critical period hypothesis. Mahwah, NJ: Lawrence Erlbaum.

U.S. flag

An official website of the United States government

The .gov means it’s official. Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

The site is secure. The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

  • Publications
  • Account settings

Preview improvements coming to the PMC website in October 2024. Learn More or Try it out now .

  • Advanced Search
  • Journal List
  • Front Psychol

A Review of Research on Technology-Supported Language Learning and 21st Century Skills

Associated data.

The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.

Modern society needs people to be equipped with 21st century skills (e.g., critical thinking, creativity, communication, digital literacy, or collaboration skills). For this reason, teaching and learning nowadays should promote not only students' knowledge acquisition in various learning contexts but also their 21st century skills, and language learning context is no exception. This study reviewed research on technology-supported language learning and 21st century skills. The reason is that earlier studies reviewed only articles related to language learning supported by technology and mostly focused on languages, language skills and technologies used. That is to say, 21st century skills were not considered in earlier review studies. The present study selected and reviewed 34 articles published between 2011 and 2022 (February) and focused on the following dimensions: (1) research focus such as language skills and 21st century skills; (2) theoretical foundations; (3) technologies; (4) learning activities; (5) methodology; and (6) findings. The present research found that reviewed studies had focused most frequently on such language skills as speaking and writing and on such 21st century skills as communication and collaboration. The social constructivism theory was often used by scholars to base their studies on. Facebook, Google Docs, and Moodle were popular technologies in reviewed studies to facilitate language and 21st century skills. Scholars in reviewed studies reported that technology-supported language learning activities provided learners with good learning experiences and enhanced their learning motivation, engagement, and confidence. However, some challenges that learners faced during learning activities were also reported. Based on the results of the review, this study made several recommendations for stakeholders such as educators and researchers in the field.

Introduction

It is important that our students not only acquire new knowledge when they learn, but also develop skills, such as problem-solving, social cooperation, creativity, and so on, in order to apply newly learned knowledge to the real world. Such knowledge and skills will help them adapt to modern society and will enhance their competitiveness (Shadiev et al., 2022a , b ). Many countries have put forward the 21st century skills framework to carry out education reform (Lin et al., 2020 ), and one of them was proposed by the Partnership for 21st Century (P21). The P21 (Partnership for 21st Century Skills, 2008 ) provided a detailed conceptual framework and listed three types of skills: (1) learning and innovation skills (critical thinking and problem solving, creativity and innovation, and communication and collaboration), (2) digital literacy (information literacy, media literacy, and information and communication technologies (ICT) literacy), and (3) career and life skills (flexibility and adaptability, initiative and self-direction, social and cross-cultural interaction, productivity and accountability, and leadership and responsibility). The essence of these skills is that they are key skills that learners will need for their social and professional life in the future. These skills also emphasize the ability of learners to use and transfer knowledge and solve problems in complex situations, so they can achieve deep levels of individual learning as well as lifelong learning (Shadiev et al., 2022a ).

Developing students' 21st century skills needs to be implemented in all disciplines, and foreign language learning is no exception (Shadiev et al., In Press ). This matter has been addressed in the documents related to Asia Pacific Economic Cooperation ( 2004 ). Furthermore, researchers have carried out related studies, and pointed out the advantages of technology in developing both language skills and 21st century skills (Shadiev et al., In Press ). For example, Suzanne ( 2014 ) pointed out that when developing learners' reading skills, they deepened the learners' understanding of reading content, and also developed critical thinking skills. García-Sánchez and Burbules ( 2016 ) have found that students' skills such as problem solving, collaboration, listening and speaking improved after they completed online collaborative tasks. Srebnaja and Stavicka ( 2018 ) also pointed out that, in language learning projects supported by WebQuest, students' creativity, collaboration, and speaking skills have been developed. In the study by Chiang ( 2020 ), the digital storytelling activity was designed which promoted language learners' writing skills as well as their digital literacy skills.

A theoretical foundation to support technology supported language learning and development of 21st century skills can be built on various theories. The most relevant can be considered as second language acquisition theory, socio-cultural theory, and constructivism theory. For example, second language acquisition theory states that language acquisition is a process of input, absorption, and output. Language acquisition is acquired through exposure to contexts, understanding discourse, and then using language in natural communicative contexts (Krashen, 1985 ). According to socio-cultural theory, learning is a social phenomenon; it emphasizes the social nature of learning and argues that the development of learners' abilities arises from interpersonal interactions (Lantolf, 2000 ). Constructivism theory suggests that learning is a process in which a learner actively constructs meaning. That is, learners generate meaning and construct understanding based on prior knowledge and experience, often in the context of socio-cultural interactions. Constructivism theory emphasizes the social and contextual nature of learning (Vygotsky, 1978 ). Over the years, scholars have created technology-supported learning environments for language learning and 21st century skills development based on these theories. Such environments provide students with authentic learning materials, support social interaction, and facilitate their creative expression and construction of meaning actively using the target language.

Some related review studies already exist in the field. For example, Shadiev and Yang ( 2020 ) reviewed 398 articles related to technology-assisted language learning published in 10 Social Science Citation Index (SSCI) journals. The dimensions analyzed in their study included target language, language skills, technologies, and research findings. Shadiev and Yang ( 2020 ) found that the most commonly used language was English, followed by Chinese. The most targeted language skills were writing, speaking, and vocabulary acquisition. Digital games and online videos were the most commonly used technologies in these reviewed studies. In addition, most of the reviewed studies reported positive impacts of technology applications on language learning. Zhang and Zou ( 2020 ) reviewed 57 articles on technology applications for language learning that were published between 2016 and 2019 in 10 SSCI journals. The types of technology, the purpose of technology use, and the effectiveness of the technologies were reviewed by the authors. Zhang and Zou ( 2020 ) found that mobile learning, multimedia learning and socialization, voice to text recognition, text to speech recognition, and digital game-based learning were the most frequently investigated types of technology in the literature. The purposes for their use mainly covered four areas, including promoting practice, providing teaching content, promoting interaction, and reconstructing teaching methods. Scholars have claimed that technologies have positive effects on language learning. Goksu et al. ( 2020 ) reviewed 310 articles in 10 journals in the field of technology-assisted language learning. In addition, they evaluated a metadata set of 469 articles in the Web of Science database through bibliometric mapping. The review focused on the types, purposes, and effectiveness of the latest technologies on language learning. Goksu et al. ( 2020 ) found that most studies used quantitative research methods and were carried out with participants at higher academic levels. In addition, most studies focused on language skills as well as learning motivation and learner perceptions. Shadiev et al. ( 2017 ) studied 37 articles published in the top 10 SSCI journals related to educational technology from 2007 to 2016 (March). Scholars took mobile language learning in a real environment as the research object and summarized the results from four perspectives: journal publishing trends, language learning, research focus, and research methods. The results showed that the journal publishing trend was increasing. The most common research focus was cognition and language learner proficiency. The results also showed that mobile technology was positively perceived and accepted by students in most of these studies, and the technology was also found to have a positive impact on the students' language skills.

By exploring these review studies, the present review research found that 21st century skills were not considered in these earlier studies at all because scholars mainly focused on language skills. Therefore, several important aspects (e.g., theoretical foundations used to support the studies, methodology, and types of learning activities that promote language skills and 21st century skills) were ignored. These aspects are important for stakeholders in the design and implementation of language teaching and learning for 21st century skills development. In order to fill this gap in the literature, the present study was carried out, and the following research questions were addressed:

  • What language skills and 21st century skills did the researchers focus on in the reviewed studies?
  • What theories were used as a foundation in reviewed studies?
  • What technologies were used to promote language skills and 21st century skills?
  • What learning activities were used in the reviewed studies?
  • What were the methodological characteristics of the reviewed studies?
  • What research findings were obtained in the reviewed studies?

Research Method

The present study is a systematic review. The study used preferred reporting items for systematic reviews and meta-analyses (PRISMA) for the electronic search. PRISMA is considered as a set of programs that facilitates researchers to prepare and report various systematic evaluations and meta-analyses (Moher et al., 2009 ). According to scholars, PRISMA has been widely and successfully applied in educational research. In addition to PRISMA, this review followed the general guidelines for searching and selecting research articles proposed by Avgousti ( 2018 ), Shadiev and Yang ( 2020 ), and Shadiev and Yu ( In Press ). The search and selection processes are shown in Figure 1 . Articles were found through a search on the Web of Science database and Peer-Reviewed Instructional Materials Online Database (PRIMO). According to Kukulska-Hulme and Viberg ( 2018 ), PRIMO is a search tool and it contains several databases such as ERIC and Scopus. For this reason, PRIMO features a very comprehensive collection of full-text articles and bibliographic records, and it has been used by many researchers in their systematic reviews and meta-analyses to find relevant literature.

An external file that holds a picture, illustration, etc.
Object name is fpsyg-13-897689-g0001.jpg

The search and selection process.

Based on general recommendations from previous review studies (Guan, 2014 ; Duman et al., 2015 ), this review used keywords such as 21st century skills, language learn * , and technology. 21st century skills were also included to widen the search results (e.g., creativity and innovation, critical thinking, problem solving, communication, collaboration, digital literacy, information literacy, media literacy, ICT literacy, flexibility and adaptability, initiative and self-direction, social and cross-cultural interaction, productivity and accountability, leadership and responsibility). This review used these terms in different combinations to search articles.

A total of 9,162 articles were found from the search. This review narrowed down the selection of research articles based on the following criteria (see Figure 1 ): articles that were (1) published during 2011–2022 (February); (2) published in English; and (3) focused on technology-supported language learning and 21st century skills. Two researchers screened each article individually and excluded articles from the study that did not focus on technology-supported language learning and 21st century skills. The researchers discussed any discrepancies in their selection results until an agreement was reached. At the end of the selection process, 34 empirical studies were chosen for the review.

This review proposed an analytical framework (see Figure 2 ) to answer the research questions of the study and to better understand the research design of the reviewed studies and findings. This review also used this framework to help us better review articles and regarded it as the basis for coding the content of reviewed studies. This review used the open coding method to carry out content analysis (Creswell, 2002 ) which can enable us to segment research content and to form categories relevant to the phenomenon of interest. The analytical dimensions included the following (see Figure 2 ): (1) language skills and 21st century skills—skills related to language learning and 21st century skills, (2) technology—the tools and devices participants used for language learning, (3) learning activities supported by technology to cultivate 21st century skills and language skills, (4) theoretical foundation—theories, models or hypothesis involved in research, (5) methodology—participants' academic level and major, research duration, sample size, data collection tools, and research design, and (6) findings—results reported in research.

An external file that holds a picture, illustration, etc.
Object name is fpsyg-13-897689-g0002.jpg

Analytical framework.

Two researchers were involved in the coding process. They read articles and coded content according to the above coding scheme. After that, they categorized codes into categories and identified attributes for each category. If there were any differences in coding, the researchers re-examined an article to resolve differences, and then finally completed the coding phase. Interrater reliability was measured using Cohen's kappa coefficient and the result was high (k = 0.886).

The present study starts this section with the results related to publication year, languages, and participants. Figure 3 shows the distribution of articles published in the past 10 years. Most studies were published in 2019 ( n = 8), and no articles were published in 2012. From the figure, it can also be seen that the research trend in this field is on the rise. Figure 4 demonstrates the frequency at which different languages were the focus in the reviewed studies. 29 studies focused on English. There were also studies focused on Chinese ( n = 2), Ukrainian ( n = 1), Japanese ( n = 1), and Spanish ( n = 1). As shown in Figure 5 , undergraduates were the most common academic level ( n = 17), and there was a relatively low number of studies conducted on junior high school ( n = 5), senior high school ( n = 2), and primary school ( n = 1) academic levels. As shown in Figure 6 , researchers were more willing to involve students who were majoring in the fields of education ( n = 9), management ( n = 4), or engineering ( n = 4).

An external file that holds a picture, illustration, etc.
Object name is fpsyg-13-897689-g0003.jpg

Distribution of research year.

An external file that holds a picture, illustration, etc.
Object name is fpsyg-13-897689-g0004.jpg

Distribution of languages.

An external file that holds a picture, illustration, etc.
Object name is fpsyg-13-897689-g0005.jpg

Distribution of educational level.

An external file that holds a picture, illustration, etc.
Object name is fpsyg-13-897689-g0006.jpg

Distribution of participants' major.

Research Focus

This section presents the results related to research focus of reviewed articles. As can be seen from Figure 7 (and from Appendix 1 ), researchers carried out technology-assisted language learning studies and focused on the development of listening, speaking, reading, writing, grammar, and vocabulary skills. Among these skills, speaking skills ( n = 20) received considerable attention from researchers, followed by writing skills ( n = 19) and vocabulary ( n = 13). Reading ( n = 5) skills received less interest from researchers.

An external file that holds a picture, illustration, etc.
Object name is fpsyg-13-897689-g0007.jpg

Distribution of language skills.

According to Figure 8 (and Appendix 1 ), researchers pointed out that technology-supported language learning can also promote 21st century skills. These skills relate to the following three categories: 4C (communication, collaboration, critical thinking, and creativity), digital literacy, and career and life skills. The most common skills that scholars targeted were communication ( n = 15) and collaboration ( n = 15), followed by critical thinking ( n = 10) and social and cross-cultural interaction ( n = 10). Problem solving ( n = 5) skills have received the least attention from researchers.

An external file that holds a picture, illustration, etc.
Object name is fpsyg-13-897689-g0008.jpg

Distribution of 21st century skills.

Theoretical Foundation

This section focuses on theoretical foundation in the reviewed articles. As shown in Appendix 2 , a total of 16 theories were used. The most used theory was the social constructivism theory ( n = 9), followed by Byram's intercultural competence model ( n = 3), project-based learning ( n = 2), content based instruction ( n = 2), task based approach to language teaching ( n = 2), and sociocultural theory ( n = 2). The rest of theories were used only once.

As shown in Appendix 3 , a total of 52 technologies were used in reviewed studies. This review grouped them into eight categories: Social tools ( n = 20), Creative tools ( n = 19), Collaboration tools ( n = 13), Learning management system ( n = 9), Multimedia materials ( n = 5), Classroom interactive tools ( n = 4), Presentation tools ( n = 2), Wearable devices ( n = 1). Among the most commonly used technologies were Facebook ( n = 4), Google Docs ( n = 4), Moodle ( n = 4), followed sequentially by Skype ( n = 3), Padlet ( n = 3), WhatsApp ( n = 2), YouTube ( n = 2), Blogs ( n = 2), Google Drive ( n = 2), and Wiki ( n = 2). The other 40 technologies have only been used once, i.e., Windows Movie Maker, Live On, Edmodo, Kahoot, and Prezi. In addition, one study involved a virtual reality production tool (EduVenture) and a wearable device (Google Cardboard).

Learning Activity

As shown in Appendix 4 , in reviewed studies, scholars designed the following five main types of learning activities: (1) collaborative task-based language learning ( n = 9); (2) learning activities based on online communication ( n = 9); (3) creative work-based language learning ( n = 8); (4) adaptive learning activities ( n = 4); and (5) learning activities based on multimedia materials ( n = 4).

Methodology

This section presents methodological details of reviewed studies, such as sample size, research duration, data collection tools and research design.

As shown in Figure 9 , the most common sample size was from 11 to 30 participants ( n = 11), followed by sample sizes between 61 and 90 ( n = 8) and between 31 and 7 ( n = 7). Only two studies selected a sample size between 1 and 10. The sample size of two studies was >151. As shown in Figure 10 , most of research duration was between 3 and 6 months ( n = 10). There were 12 studies that did not state any research duration.

An external file that holds a picture, illustration, etc.
Object name is fpsyg-13-897689-g0009.jpg

Sample size distribution.

An external file that holds a picture, illustration, etc.
Object name is fpsyg-13-897689-g0010.jpg

Research duration distribution.

As shown in Appendix 5 , the most common data collection method was questionnaires ( n = 17), followed by tests ( n = 15) and interviews ( n = 13). Two data collection methods were used only 2 times, they were scales ( n = 2) and rubric ( n = 2).

As shown in Appendix 6 , research designs related to technology-supported language learning and 21st century skills were categorized into three main categories, namely quasi-experimental research ( n = 14), case studies ( n = 12), and action research ( n = 8).

As shown in Appendix 7 , various findings were reported in reviewed studies. In addition, that learners' language skills acquisition and 21st century skills, technology-supported language learning activities provided learners with good learning experiences, enhanced motivation and engagement, and improved self-confidence. In reviewed studies, some scholars reported about challenges faced by students during learning activities; they included challenges from technology, from their own competence, challenges of collaborating with others and self-attitude.

Language Skills

Regarding language skills, researchers have focused on improving learners' speaking, writing and vocabulary skills more. This shows that researchers are more concerned with the improvement of learners' skills related to language output. Researchers who reviewed studies on technology-supported language learning from 2014 to 2019 came to the same conclusion (Shadiev and Yang, 2020 ). However, the present study showed that reading skills received the least attention, while previous studies noted that grammar skills received less attention. This revealed that researchers are now beginning to pay more attention to previously neglected skills and are beginning to focus on the role of technology-supported language learning in facilitating learners' grammar skills. For example, Lai ( 2017 ) noted that grammar skills improved when learners completed activities to create vocabulary lists and greeting cards using multimedia resources. Jung et al. ( 2019 ) noted that students' grammar skills improved as they corrected each other's pronunciation and grammatical errors through video chat. Jamalai and Krish ( 2021 ) found that students' grammar skills improved through online forum discussions and knowledge sharing.

21st Century Skills

In terms of 21st century skills, communication and collaboration have received the most attention from researchers. It is probably because the 21st century society is more globalized and along with the increased complexity of related work, interpersonal communication and cooperation are being enhanced. The 21st century society emphasizes teamwork skills, and therefore scholars focus on collaborative and communication skills. Problem-solving skills have received little attention, and no researcher focused on career and life skills. In the face of the evolving and changing society of the future, problem-solving skills are among the core 21st century skills, emphasizing learners' ability to define problems, think critically, and solve problems. For example, scholars in reviewed studies have focused on learners' problem-solving skills in virtual technology-supported language learning (Chen et al., 2021 ).

Based on the results, this study has several recommendations for educators and researchers. First, input skills are an important component of language skills and an indispensable way for learners to develop output skills (Harmer, 2007 ). The present study suggests that researchers can focus on learners' input skills supported by technology, such as listening and reading. Second, problem-solving skills and career and life skills also deserve attention; therefore, future studies try to explore the effects of technology-supported language learning on these skills.

Theories Related to Instructional Design

The most commonly used instructional design theory in reviewed studies was social constructivism theory. The results of this research are consistent with those of previous review studies of technology-supported language learning (Parmaxi and Zaphiris, 2017 ). According to this theory (Vygotsky, 1978 ), knowledge is not a set of “facts” but rather a synthesis of information that is actively constructed and evolving in the learner's mind. The teacher does not “give” knowledge to the learner, but the learner should acquire knowledge actively. Learners' knowledge evolves as they process old and new information, as well as their experiences. The researchers designed collaborative, creative, and communicative activities based on a social constructivism perspective to encourage learners to input the target language and output the target language in a meaningful context. At the same time, researchers have used various learning and teaching activities to promote students' collaboration, communication, creativity, critical thinking and digital literacy skills (Yang et al., 2013 , 2014 , 2022 ; Lai, 2017 ; Sevilla-Pavón and Nicolaou, 2017 ; Huang, 2021 ).

Other researchers have also used theories based on learner-centered pedagogies such as problem-based or project-based theories. These pedagogies are all used to promote student-directed learning, adaptive learning, and personalized assessment. Learning theories were used to design activities that provided learners with opportunities for language input and output, e.g., to learn new knowledge and then apply it to the real world by creating own content. This allows learners to acquire language skills and develop 21st century skills such as communication, collaboration, and problem solving (Arnó-Macià and Rueda-Ramos, 2011 ; Yang et al., 2013 , 2014 ; Srebnaja and Stavicka, 2018 ).

Theories Related to Language Learning

Researchers have also designed learning activities based on theories related to foreign language learning, such as task-based language teaching, content-based instruction, and output-input theory. For example, digital story creation activities and integrated cross-cultural communication activities designed by the researcher are in line with these theoretical perspectives, in which learners have access to the target language through social tools and partner communication. The ability to use creative and collaborative tools to complete target-language based tasks also contributes to the acquisition of language skills and 21st century skills development, such as social and cross-cultural interaction, communication skills (Lewis and Schneider, 2015 ; Tseng, 2017 ).

Theories Related to Measuring Learning Outcomes

Since language learning is closely related to culture, scholars have designed foreign language courses based on cross-cultural communication, where learners acquired both language skills and cultural knowledge. Further, there are theories that have been used by scholars to assess and measure learners' outcomes. For example, researchers have focused on learners' intercultural competence along with their language skills and utilized the Byram' ICC model and the developmental model of intercultural sensitivity to measure their cross-cultural knowledge acquisition and skills development (Bennett, 1986 ; Byram, 1997 ). In addition, the Keller' ARCS motivational model (Keller, 1987 ) has been used by researchers to measure learners' perceived attention, relevance, confidence, and satisfaction in technology-supported language learning environments.

This review analyzed the theoretical foundation that was used by those few studies that focused on non-English languages such as Chinese, Ukrainian, Japanese, and Spanish. This review found that learning theories used by scholars in these studies were diverse. They were related to instructional design (e.g., social constructivism), language learning (e.g., language output and input), and cross-cultural learning (e.g., intercultural sensitivity).

Based on the findings, several suggestions for educators and researchers are proposed. First, the theories mentioned by researchers are instruction-related theories, language learning-related theories, and measurement-related theories; they were used to guide the design of technology-supported language learning activities that focus both on the acquisition of language skills and on the 21st century skills. These theories can be useful to inform the design of appropriate language learning activities for educators and researchers in the future. Second, this review found that many researchers did not indicate what theories were used in their studies. Theoretical foundations are important for the instructional design, language learning or measuring activities, so such information should be clearly indicated so that other researchers can gain a deeper understanding of them.

Eight Technologies With Different Functions

Based on the literature review, this study grouped technologies into eight categories based on their functions: (1) collaborative tools (e.g., Google Docs or Padlet) for supporting learners to collaborate on a task through co-editing and information sharing; (2) social tools (e.g., Facebook or Skype) for supporting learners to communicate and share content remotely or synchronously using text, audio and video; (3) creative tools (e.g., Photo Story or Adobe Spark) to support learners in creating work, such as digital stories or videos; (4) learning management system (e.g., Moodle) to integrate learning activities and learning resources for adaptive online learning; (5) classroom interaction tools (e.g., Quizlet or Kahoot) to support question-answering, polling, and other activities in the classroom; (6) multimedia materials are some audio and video resources on the web or multimedia textbooks; (7) presentation tools (e.g., PowerPoint) are used to support learners to present their learning content digitally; (8) wearable devices (e.g., Google Glass) to support learners to view or interact with content in virtual reality learning environments.

Most Commonly Used Technologies

Facebook (social tool), Google Docs (collaboration tool), and Moodle technologies (learning management system) were used the most in previous studies to facilitate language and 21st century skills. The study further analyzed which technologies are most often used by researchers to promote 21st century skills. Appendix 8 demonstrates these most commonly used tools. The study found that Facebook (social tool), Google Docs (collaboration tool) and Moodle (learning management system) were also the tools most often used by researchers to promote communication, collaboration and critical thinking, social and cross-cultural interaction skills. This indicates that scholars valued such 21st century skills as collaboration and communication among students in technology-supported language learning activities. For example, Sevy-Biloon and Chroman ( 2019 ) used social and collaborative tools (e.g., Google Docs, Facebook, etc.) to support communication between students from different cultural backgrounds and their results showed that students' speaking skills, social and cross-cultural interaction, and communication skills were promoted. Moodle is popular among researchers because this learning management system not only supports learners' adaptive and inquiry-based learning, but also helps teachers share learning resources with learners, design learning activities, and manage learners' learning progress (García-Sánchez and Burbules, 2016 ). For example, Yang et al. ( 2014 ) designed a language learning activity based on the Moodle platform that asked students to complete reading and writing tasks in the system to promote the development of reading, writing skills and critical thinking. In addition, researchers most often used Google Docs (collaboration tool), Prezi (presentation tool), Windows Movie Maker, Photo Story3 (creative tools) and Blogs (social tool) to support students' creativity and innovation skills, problem-solving skills, and ICT literacy. And only two studies have used films (multimedia materials) and blogs (social tool) to support students' media literacy.

Experienced Challenges of Using Technology

Scholars reported that technologies pose some challenges for learners. For example, students were not experienced to use technology and had no trainings before learning activities; then they complained about problems to use technology during learning (Lai, 2017 ). Students were also confused about the layout of the platform and noted that there were incompatibilities and connectivity issues with learning devices (Hosseinpour et al., 2019 ). When communicating remotely, students pointed out that there were problems with the network and they were not able to connect and participate in learning process (Mohamadi Zenouzagh, 2018 ; Jung et al., 2019 ).

The Distribution of Technology in non-English Language Studies and Different Theories

This review also analyzed technologies that were used by those few studies that focused on non-English languages. This review found that, in general, scholars in these studies used such technologies as creative tools (Adobe Spark), collaboration tools (Google Docs), and social tool (Facebook) to present multimedia content to learners and support collaborative, creative and communicative learning activities (Valdebenito and Chen, 2019 ).

With regard to the distribution of technology in theory. Social constructivism theory was the most commonly cited theory in reviewed research and scholars used various technologies such as learning management systems (e.g., Moodle), creative tools (e.g., iMovie) or social tools (e.g., Facebook) to support constructivism-based learning activities. That is, interactive and collaborative learning activities were designed for students to learn new knowledge and then apply it to construct meaning in authentic contexts.

Based on the results of this study, several recommendations for educators and researchers were proposed. First, it is recommended that learning activities supported by technologies are designed based on appropriate theoretical foundation. Second, teachers are encouraged to conduct appropriate technology training for students beforehand so that they become familiar with technology tools. Third, teachers and researchers should test learning tools with students in advance in order to identify any possible technical problems, and provide timely support during learning process.

Learning Activities Used to Promote Language Skills and 21st Century Skills

This section describes what technologies are used in each type of learning activity and how they contribute to the development of learners' language skills and 21st century skills. In addition, it offers relevant suggestions to researchers and educators.

Adaptive Language Learning Activities on Learning Platforms

As shown in Table 1 , in the reviewed study, researchers used the following tools: Moodle, Google classroom, Quantum leap, and WebQuest, to develop adaptive language learning activities on learning platforms. These tools are used to integrate different types of instructional resources and diverse language learning activities to provide learners with adaptive learning materials that meet their learning needs. Students can ask questions and receive feedback from other students or teachers, and take control of their own learning progress.

Adaptive language learning activities on learning platforms.

Arnó-Macià and Rueda-Ramos ( )Learning management system: Quantum LEAPOnline learning, complete listening, speaking, and reading tasksListening
Speaking
Critical thinking
Yang et al. ( )Learning management system: MoodleOnline learning, complete speaking and listening tasksListening
Speaking
Critical thinking
Yang et al. ( )Learning management system: MoodleOnline learning, complete reading, and writing tasksReading
Writing
Critical thinking
Srebnaja and Stavicka ( )Learning management system: WebQuestsOnline learning, complete speaking and writing tasksSpeaking
Grammar
Writing
Creativity and innovation, collaboration, communication, digital literacy

For example, Arnó-Macià and Rueda-Ramos ( 2011 ) designed tasks for reading, listening, and speaking practice in Quantum leap platform. Researchers have designed listening tasks in Moodle platform; students were required to analyze, evaluate, and summarize content after listening (Yang et al., 2013 , 2014 ). Srebnaja and Stavicka ( 2018 ) designed WebQuests-based speaking and writing tasks.

All of these studies noted that learners' performance in speaking, listening, reading, writing, and grammar improved after completing the computer-assisted adaptive language learning tasks. In addition, students' critical thinking skills were developed.

Collaborative Task-Based Language Learning Activities

As shown in Table 2 , the following tools were used by researchers for the development of collaborative-based language learning activities: (1) collaboration tools: Google Docs, Google Drive, Wiki, Edmodo, and E-writing forum. These collaborative tools have the following functions: sharing, collaborative editing, cloud storage, synchronized display, and help students freely share information in various formats (e.g., text, images, videos, web links, audio recordings, music, etc.) on the platform so that they can exchange ideas and collaborate on editing content; (2) creative tools: Adobe Spark, to support students' expression of ideas; (3) social tools: Blogs or WordPress, to support students in reading and commenting on each other's work.

Collaboration-based language learning activities.

Amir et al. ( )Social tools: BlogCollaborate on writing tasksWritingCollaboration
García-Sánchez and Burbules ( )Learning management system: Moodle Collaboration tools: WikiStudents propose solutions to social problemsSpeaking
Vocabulary
Communication
Collaboration
Digital literacy
Problem solving
Lai ( )Collaboration tools: Padlet
Creative tools: Home Styler, Thing Link
Collaborate on different tasks, such as creating vocabulary list, greeting cardsVocabulary
Grammar
Collaborative
Communication
Mohamadi Zenouzagh ( )Collaboration tools: E-writing forumCollaborate on writing tasksWritingCollaboration
Valdebenito and Chen ( )Creative tools: Adobe Spark, Google My Maps
Collaboration tools: Google Doc, Word Press
Collaborate on culture tasksListening
Speaking
Writing vocabulary
Grammar
Critical thinking
Digital literacy
Collaboration
Communication
Huh and Lee ( )Collaboration tools: Google DocsCooperate to complete role plays or songs to express the vocabulary learnedSpeaking
Writing
Creativity and innovation
Hosseinpour et al. ( )Collaboration tools: EdmodoCollaborate on writing tasksWritingCollaboration
Girgin and Cabaroglu ( )Classroom interactive tools: Quizlet, Quizizz, Cram, Kahoot
Creative tools: Story Bird, Voki, Go Animate, Animoto, Powtoon, Canva, Poster MyWall
Collaboration tools: Padlet
Watch the video
Collaborating on classroom tasks
Creating digital stories
Share and communicate
Listening
Speaking
Reading
Writing
Grammar vocabulary
Collaboration
Critical thinking
Creativity and innovation communication
Chen et al. ( )Creative tools: Edu Venture
Wearable devices: Google Cardboard
Solve problems and create videos collaborativelyVocabularyProblem solving

Collaboration-based language learning activities are those in which students work in groups to solve problems and complete tasks proposed by the teacher, such as asking students to provide an essay or present their ideas in other ways (e.g., a solution, a report, and a performance). For example, Amir et al. ( 2011 ) asked students to work in groups to publish six articles based on different topics over the course of 14 weeks, and one of the tasks required students to find and discuss software about computer-assisted writing.

Mohamadi Zenouzagh ( 2018 ) designed a collaborative writing activity based on the E-writing platform. Valdebenito and Chen ( 2019 ) designed a collaborative activity on the theme of “food and culture” in which students first had to use Google Maps to identify geographic areas related to the content, then use a Google Doc to record their ideas, and finally use video production tools such as Adobe Spark to express their ideas and share them on the WordPress platform. Huh and Lee ( 2020 ) designed a creative learning English collaborative activity in which students first used a mobile app to learn how to spell words, then the group took the words they learned and expressed them through the role play and song. Lai ( 2017 ) designed different collaborative tasks, for example, students needed to use the ThingLink tool to create vocabulary lists and greeting cards related to the topic, which were then shared on the Padlet platform and discussed. In addition, students were required to use HomeStyler to collaboratively design a dream home and use some vocabulary related to “location” to describe the design of their home.

Girgin and Cabaroglu ( 2021 ) designed an English learning project that integrates Web 2.0 technology and flipped classroom, and students used Padlet to watch videos in class. In grammar classes, students used Kahoot, Quizlet, Quizizz, Animoto, Powtoon, and Poster MyWall to answer grammar questions. In vocabulary and reading classes, students used tools such as Mind Meister, Voki, Canva, Cram, Go Animate and Story-bird to create mind maps, as well as create digital stories, which can be presented and shared. Chen et al. ( 2021 ) used virtual reality technology to design language learning activities. Learners were required to first watch a virtual reality scene and think about how to solve the problem based on a series of guiding questions provided by the teacher. Then students role-played in English to create a virtual reality video of the problem being solved.

The results of the abovementioned studies showed that collaborative-based language learning activities facilitated the development of learners' language skills. The researchers noted that collaborative problem-solving language learning activities provided learners with a large number of writing tasks, such as writing reports, essays, or creating storylines and designing works. The process of sharing with each other enabled to point out grammatical errors (Amir et al., 2011 ; Mohamadi Zenouzagh, 2018 ; Hosseinpour et al., 2019 ). When learners used multimedia resources to create vocabulary lists and greeting cards, their vocabulary and grammar skills were also improved (Lai, 2017 ).

At the same time, students' critical thinking was developed as they gave each other's critical and constructive comments (Valdebenito and Chen, 2019 ; Zou and Xie, 2019 ; Girgin and Cabaroglu, 2021 ). In addition, students completed tasks in small groups which promoted the development of communication and collaboration skills during discussions with each other (Amir et al., 2011 ; García-Sánchez and Burbules, 2016 ; Lai, 2017 ; Mohamadi Zenouzagh, 2018 ; Hosseinpour et al., 2019 ; Zou and Xie, 2019 ; Girgin and Cabaroglu, 2021 ). The process of students voicing digital content promoted the development of speaking skills (Huh and Lee, 2020 ). In the process of creating digital works, digital literacy was developed (García-Sánchez and Burbules, 2016 ; Valdebenito and Chen, 2019 ). Chen et al. ( 2021 ) pointed out that learners learn contextually in an immersive learning environment, and solving real problems through virtual reality technology improved learners' vocabulary as well as promoted their problem-solving skills.

Creative Work-Based Language Learning Activities

As shown in Table 3 , in reviewed studies, language learning activities based on creative works consisted of two main categories: creating digital stories or videos. The main models for this type of learning activity were as follows: students communicated in groups about how to create a digital story or video, then collected and processed relevant information, after that created a digital story, and finally shared content and communicated with each other about it.

Creative work-based language learning activities.

Thang et al. ( )Creative tools: Photo Story3
Social tools: Blog
Create digital stories and shareWriting
Speaking
Communication
Creativity and innovation
Collaboration
ICT literacy
Sevilla-Pavón and Nicolaou ( )Creative tools: iMovie, Inspiration
Collaboration tools: Google Docs, Google Drive, Facebook, WhatsApp
Presentation tools: PowerPoint, Prezi
Social tools: Google+ Community, Google+ Forum
Create digital stories and shareSpeaking
Listening
Reading
Writing
Vocabulary
Communication
Collaboration
Creativity and innovation
Critical thinking
Problem solving
Digital literacy
Social and cross-cultural interaction
Kulsiri ( )Creative tools: Windows Movie MakerCreative videoSpeaking
Reading
Writing
Vocabulary
Creativity and innovation
Collaboration
Problem-solving
Yalçin and Öztürk ( )Learning management system: Google-classroomRewrite story endings, create digital stories and shareWritingCommunication
Collaboration
Creativity and innovation
Chiang ( )Creative tools: Story BirdCreate digital stories and shareWritingDigital literacy
Yang et al. ( )Creative tools: Audacity
Collaboration tools: Google Drive
Presentation tools: Prezi
Create digital stories and shareSpeakingCreativity and innovation
Mirza ( )Social tools: YouTube
Presentation tools: PowerPoint
Create digital stories and shareSpeakingCommunication
Huang ( )Creative tools: Smartphone cameraSmartphone-based video creationSpeakingCommunication
Digital literacy

The researchers chose different tools to support such learning process, e.g., (1) creating digital stories, i.e., Photo Story3, Windows Movie Maker, or iMovie; (2) creating video scripts in collaboration, i.e., Google Docs or Google Drive; (3) presenting digital stories, i.e., Prezi or PPT; (4) sharing digital stories and communicating, i.e., Google+ forums, Facebook, Instagram, WhatsApp, Google Classroom, and classroom management systems.

The researcher noted that digital storytelling promoted language skills, specifically, the process of writing story scripts promoted students' writing and vocabulary skills (Thang et al., 2014 ; Sevilla-Pavón and Nicolaou, 2017 ; Kulsiri, 2018 ; Yalçin and Öztürk, 2019 ; Chiang, 2020 ). It also promoted 21st century skills. Researchers mentioned three approaches for creating digital stories or videos such as free-writing, rewriting the ending of the story, and specifying the theme, and in this open-ended work creation process, students' sense of creativity, problem-solving skills, and digital literacy were developed (Thang et al., 2014 ; Sevilla-Pavón and Nicolaou, 2017 ; Kulsiri, 2018 ; Yalçin and Öztürk, 2019 ; Yang et al., 2022 ). Regarding the creation of digital stories on a specific theme, the researcher asked learners to design a new country, and students needed to understand a range of elements including different countries and cultures, such as national characteristics, language, national policies, climate and life. As a result, students' social and cross-cultural skills were improved. In addition, critical thinking was facilitated as students developed different ideas and perspectives as they evaluated each other's digital stories (Sevilla-Pavón and Nicolaou, 2017 ). Finally, students developed their communication and collaboration skills when working in groups (Thang et al., 2014 ; Sevilla-Pavón and Nicolaou, 2017 ; Kulsiri, 2018 ; Yalçin and Öztürk, 2019 ; Mirza, 2020 ; Huang, 2021 ).

Language Learning Activities Based on Multimedia Learning Materials

As shown in Table 4 , language learning activities based on multimedia materials involved such tools as (1) web-based learning management system, e.g., EDpuzzle; (2) social tool, e.g., YouTube; and (3) multimedia textbooks. All of them provided multimedia resources for students. There were also (4) collaboration tools, e.g., Padlet and Google docs, which supported learners to share ideas with each other.

Language learning activities based on learning multimedia materials.

Tseng ( )Multimedia materialsWatch multimedia materials oral report and reflection on cultural differencesListeningSocial and cross-cultural interaction
Zou and Xie ( )Learning management system: EDpuzzle
Collaboration tools: Google Docs, Padlet
Watch video on writing skills, discuss in small groups and complete a reportWritingCritical thinking
Collaboration
Nikitova et al. ( )Multimedia materials: Multimedia textbooksStudy multimedia materials and complete tasksSpeaking
Writing
Grammar
Vocabulary
Collaboration
Critical thinking
Communication
Problem solving
Aristizábal-Jiménez ( )Multimedia materials: videoWatch YouTube videos and analyze, make videos and presentationVocabulary
Grammar
Critical thinking

Scholars have designed a variety of language learning activities based on multimedia materials, but the topics and learning tasks of the multimedia materials involved in these studies differed. For example, Tseng ( 2017 ) asked learners to watch a video on the topic of cultural differences, and then students gave oral presentations and reflections to present their views on cultural differences. Zou and Xie ( 2019 ) asked students to watch a video on EDpuzzle, then to discuss in groups, negotiate and compare answers, to share their output to the Padlet platform, and finally submit their reports in Google docs. Nikitova et al. ( 2020 ) asked students to watch videos from multimedia textbooks with different English contexts and then simulated learners' role play activities. Aristizábal-Jiménez ( 2020 ) asked learners to watch YouTube videos, analyze the structure and content of video content, and then create posters to present and share their ideas.

The researcher noted that language learning activities based on multimedia materials promoted learners' language skills and 21st century skills. Specifically, learners' listening skills were promoted after watching the videos (Tseng, 2017 ). Culturally relevant content in videos and culture-based communication among peers promoted students' social and cross-cultural interaction skills (Tseng, 2017 ). Learners actively used dictionaries and discussed grammar while completing tasks to make the information easier to understand, which also promoted students' vocabulary and grammar skills (Aristizábal-Jiménez, 2020 ). In addition, working in groups to complete tasks promoted speaking, writing, grammar, and vocabulary skills. This was also beneficial to develop students' problem solving, collaboration, critical thinking, and communication skills (Aristizábal-Jiménez, 2020 ; Nikitova et al., 2020 ).

Language Learning Activities Based on Online Communication

As shown in Table 5 , the researchers designed online communication-based language learning activities. Most of them were cross-cultural communication activities to support cross-cultural communication between students from different cultural backgrounds. In terms of technology, the researchers mainly used social tools to support textual or video communication, e.g., Facebook, Skype, and WhatsApp. In addition, researchers have utilized learning management systems to support students to view learning resources uploaded by teachers.

Language learning activities based on online communication.

Calogerakou and Vlachos ( )Multimedia materials: Film
Social tools: Blog
Students from different cultural backgrounds watch films with culturally relevant backgrounds and communicateWritingSocial and cross-cultural interaction
Media literacy
Chen and Yang ( )Social tools: ePals, iEARN, SkypeStudents from different cultural backgrounds share culturally specific folklore stories, make videos, and perform puppet showsWriting
Vocabulary
Social and cross-cultural interaction
Communication
Collaboration
Lewis and Schneider ( )Social tools: SkypeStudents from different cultural backgrounds discuss cultural topics onlineSpeaking
Grammar
Social and cross-cultural interaction
Communication
Chen and Yang ( )Learning management system: Moodle
Social tools: Wiki
Students from different cultural backgrounds discuss movies with culturally diverse content onlineSpeaking
Reading
Writing
Vocabulary
Social and cross-cultural interaction
Özdemir ( )Social tools: Facebook, YouTubeWatch YouTube videos and discuss online based on cross-cultural questions prepared by the instructorWriting
Listening
Social and cross-cultural interaction
Sevy-Biloon and Chroman ( )Social tools: Facebook, Skype, WhatsApp, FacetimeStudents from different cultural backgrounds discuss cultural topics onlineSpeakingCommunication
Social and cross-cultural interaction
Jung et al. ( )Social tools: Live OnStudents from different cultural backgrounds discuss cultural topics onlineGrammar
Vocabulary
Speaking
Social and cross-cultural interaction
Hirotani and Fujii ( )Social tools: FacebookStudents from different cultural backgrounds exchange proverbs online, write reflection journals and perform skits reflecting on cultural differencesSpeaking
Grammar
Communication
Social and cross-cultural interaction
Jamalai and Krish ( )Social tools: online forum (not specific)Online topic discussionGrammar
Vocabulary
Speaking
Critical thinking
Digital literacy

The design of cross-cultural communication activities followed the same pattern—exposure to cross-cultural knowledge, reflection on cross-cultural differences, and cross-cultural exchange. For example, Calogerakou and Vlachos ( 2011 ) had students from two countries to watch movies and compare culture presented in movies with their own culture. Then students had to post comments on a blog and discuss their ideas. Chen and Yang ( 2016 ) asked students to share culturally specific folklore stories with their partners and to make videos of the stories to send to their partners. In addition, students were asked to perform a puppet show via videoconference. All of these were for students to learn about cultural similarities and differences. Chen and Yang ( 2014 ) designed a discussion activity based on cultural themes; for example, students discussed movies that involved culturally different content, and then students shared their opinions on Wiki. Lewis and Schneider ( 2015 ) asked learners to interact with native Spanish-speaking students and discuss cultural topics such as “local living conditions” and “how to celebrate holidays.” Learners were then asked to write a mini-biography or travel brochure for their study partner to demonstrate the cultural knowledge they gained during the exchange. Özdemir ( 2017 ) asked students to watch YouTube videos and discuss them based on cross-cultural questions prepared by the teacher. Sevy-Biloon and Chroman ( 2019 ) designed an intercultural exchange program in which students from Ecuador and the United States were randomly paired and then engaged in a cultural exchange based on the theme of the language course. Jung et al. ( 2019 ) asked students from different cultural backgrounds to discuss cultural topics, including “happiness factors, family, and food,” and finally, students reflected on the discussion, exchanged proverbs with each other, and then presented cultural differences. They reflected on their experiences in a reflective journal. Jamalai and Krish ( 2021 ) designed an online discussion activity, in which learners were required to engage in online discussions based on topics posted by teachers in a forum.

The results showed that students' speaking, vocabulary, writing, reading, and grammar skills improved when communicating through text and speech because students double-checked vocabulary spelling and grammar. Students identified errors they made when communicating using text and speech and corrected them to ensure that others understood their intended meaning (Calogerakou and Vlachos, 2011 ; Chen and Yang, 2014 , 2016 ; Lewis and Schneider, 2015 ; Özdemir, 2017 ; Hirotani and Fujii, 2019 ; Jung et al., 2019 ; Sevy-Biloon and Chroman, 2019 ; Jamalai and Krish, 2021 ). In addition, students' listening skills improved after watching YouTube videos (Özdemir, 2017 ).

At the same time, students' communication process using social tools developed the ability to use writing software, electronic dictionaries, and collect information on the Internet, and therefore media literacy was improved (Calogerakou and Vlachos, 2011 ). All studies point to the development of cultural interaction skills after students interacted and exchanged different cultural perspectives with partners (Calogerakou and Vlachos, 2011 ; Chen and Yang, 2014 , 2016 ; Lewis and Schneider, 2015 ; Özdemir, 2017 ; Hirotani and Fujii, 2019 ; Jung et al., 2019 ; Sevy-Biloon and Chroman, 2019 ). Communication (Chen and Yang, 2014 ; Lewis and Schneider, 2015 ; Hirotani and Fujii, 2019 ) and collaboration skills were also developed (Chen and Yang, 2014 ) in reviewed studies.

This review also analyzed learning activities that were used by those few studies that focused on non-English languages. This review found that most learning activities designed in these studies were online cross-cultural communicative activities. This shows that the primary goal of these learning projects was to develop students' foreign language and intercultural communication skills.

Based on the findings of the reviewed literature, the five types of language learning activities supported by technology had a positive impact on students' language skills as well as their 21st century skills development. Moreover, this review found that these learning activities followed similar pattern. The common pattern for language learning activities based on culture-related communication was exposure to cross-cultural knowledge, reflection on cross-cultural differences, and cross-cultural exchange. The common pattern of language learning activities for creative works was as follows: students communicated in groups about how to create a work (such as digital story or video), then collected and processed relevant information, created a work, and then shared content and communicated with each other about it. These patterns could provide suggestions for researchers and teachers to design similar instructional activities that target development of language skills and 21st century skills in the future.

Second, this review found that researchers designed similar instructional activities, but the research focus was different. For example, in the adaptive language learning activities on learning platforms, researchers focused on the development of students' speaking skills and lacked attention to reading skills. And in the collaborative task-based language learning activities, researchers have focused more on writing and vocabulary skills, collaboration, and communication skills, and lacked attention to listening skills. In creative writing-based language learning activities, researchers focused more on speaking and writing skills as well as creative and communication skills.

Research Duration, Participants' Academic Level, and Sample Size

The most common study samples were small ones with participants range from 11 to 30 ( n = 11) and medium samples with range between 61 and 90 ( n = 8) participants. Research durations were mostly between 3 and 6 months ( n = 10). Small sample size was acknowledged as a limitation in some studies (Hirotani and Fujii, 2019 ; Zou and Xie, 2019 ). The possible reason for this is that most of the studies were based on small classroom settings. In the reviewed studies, the most common academic level of participants was undergraduate level. There were 12 studies that did not specify research duration. Regarding this finding, there is a lack of attention in previous retrospective studies (Guan, 2014 ; Duman et al., 2015 ; Persson and Nouri, 2018 ).

Data Collection

Most of the studies collected both quantitative and qualitative data, which can help researchers to draw conclusions from different perspectives. Quantitative data included tests, scales, and rubrics; qualitative data included student's work, open-ended questions, student feedback, interviews, student chat transcripts, student reflections, teacher journals, and observations. One of the most common forms of quantitative data collection is a test ( n = 15), involving student language tests (tests of English speaking and listening) and tests of 21st century skills (critical thinking and creative thinking). The most common method of qualitative data collection was interview ( n = 13), where the researcher usually designed an interview outline and then asked learners questions to understand their learning experiences, attitudes, motivations, and challenges in the learning process. In addition, researchers have extensively used questionnaires ( n = 17), including both closed-ended and open-ended questions, to collect both quantitative and qualitative data. For example, the researchers used questionnaires to investigate learners' perceptions of technology-supported language learning, including effectiveness, usefulness, and students' perceptions of developing intercultural communicative competence and language skills through online discussions (Jung et al., 2019 ).

Based on the above findings, the recommendations of the present study for researchers and teachers are as follow. First, researchers could consider studies with longer time spans and collect data from bigger number of participants to investigate students' development over time and have generalizable conclusions. Second, researchers can collect multiple types of data, focus on students' learning processes and outcomes, and then interpret findings from different perspectives.

Research Design

There are a variety of research designs for reviewed studies on technology-supported language learning and 21st century skills. The most common are quasi-experimental studies. Such studies are characterized by using pre- and post-tests to measure changes in participants' language skills, 21st century skills and other learning outcomes and attitudes before and after participation in learning activities. In quasi-experimental studies, participants are not randomly assigned to an experimental or control group (Persson and Nouri, 2018 ; Huang, 2021 ). These findings are consistent with other reviews on technology-supported language learning (Persson and Nouri, 2018 ). The present study suggests that educators and researchers can use the three research methods mentioned above to validate their studies in future.

Positive Learning Experiences

In this section, the study discusses findings from reviewed studies and recommendations for educators and researchers. In reviewed studies, in addition to finding that technology-supported learning activities promoted learners' language skills and 21st century skills, researchers also found that these technologies led to positive learning experiences, which resulted in better learning outcomes. For example, learning through multimedia textbooks, collaborative blog-based writing activities, smartphone-based video filming activities and language learning projects based on intercultural exchange all increased students' motivation (Amir et al., 2011 ; García-Sánchez and Burbules, 2016 ; Sevy-Biloon and Chroman, 2019 ; Aristizábal-Jiménez, 2020 ; Huang, 2021 ). For example, Hosseinpour et al. ( 2019 ) noted that through collaborative writing activities, learners' motivation and self-confidence levels were increased. Mirza ( 2020 ) argued that through digital storytelling-based learning activities, students gained more confidence. Researchers have also looked at the different learning performance of students due to individual differences in abilities or their characteristics. Yang et al. ( 2014 ) found that in terms of writing, significant differences were found between “basic” and “low-intermediate” learners as a result of the difference in ability. Yalçin and Öztürk ( 2019 ) found that girls had a more negative attitude toward technology than boys.

Challenges Faced by Students

While many studies pointed to positive student attitudes toward technology-supported learning activities (Arnó-Macià and Rueda-Ramos, 2011 ; Girgin and Cabaroglu, 2021 ), several studies highlighted challenges that students faced when using technology for learning. Challenges from technology, with some learners finding it difficult to use in learning activities or being confused about the layout of mobile applications were mentioned. Students also noted problems with device incompatibility and poor network quality and speed when using technology. Self-competence challenges, with learners noting that learning tasks were difficult for them, for example, insufficient time to complete learning tasks, lack of research skills, or language skills needed to complete tasks, were reported. Difficulties in finding an interesting topic and choosing the right tools to create their work were also reported in reviewed studies. Challenges of collaborating with others, with some learners noting that they encounter uncoordinated teamwork, uneven distribution of work and unequal student contributions in collaborative tasks, were mentioned by scholars. Self-attitudes, as noted by learners who felt anxious about video chatting when they were communicating remotely, as well as fear of having their writing errors discovered by their partners when communicating in text, were reported in reviewed studies.

Based on the above findings, the present study recommends to educators and researchers, in addition to focusing on the impact of technology-supported learning activities on learners' language skills and 21st century skills, it is also important to focus on students' perceptions of technology, motivation, engagement, and confidence. This is because positive learning experiences can lead to better learning outcomes (Sevy-Biloon and Chroman, 2019 ; An et al., 2021 ). Regarding the technological challenges that students encounter in the learning process, it is recommended that they be addressed through advance trainings and through providing students with appropriate technological services during learning activities. Self-competence challenges can be addressed by designing collaborative tasks in which students with higher levels of competence can help students with lower levels of competence to complete the task. Regarding the challenges in collaborative activities, it is recommended that teachers and researchers design learning activities with clear rules for collaborative division of labor and rules regarding how learning performance of every learner will be evaluated. With regard to alleviating negative student attitudes, it is recommended that teachers design diverse teaching strategies and scaffolds to give students assistance during learning activities.

This study reviewed articles on technology-supported language learning and 21st century skills published from 2011 to 2022 (February) in terms of (a) research focus; (b) theoretical foundations; (c) technology; (d) learning activities; (e) methodology and (f) findings. The results indicate that research on technology-supported language learning and 21st century skills have shown an upward trend in the overall research in the covered time period, with most of the research focusing on English and the majority of participants in these studies majored in education.

Secondly, in terms of research focus, most of the researchers focused on learners' speaking skills (27.40%), followed by writing (26.03%) and vocabulary skills (17.81%). In terms of 21st century skills, most researchers focused on communication (20.83%), collaboration (20.83%), critical thinking (13.89%), and social and cross-cultural interaction skills (13.89%). In terms of theoretical foundations, social constructivist learning theory was most often adopted by researchers. In terms of technology, tools that support learners' creativity and socialization are often utilized by researchers, e.g., Facebook or Google Docs. In terms of learning activities, researchers have designed the following five types of learning activities to support learners' language learning and 21st century skills: (1) collaborative task-based language learning activities; (2) language learning activities based on online communication; (3) creative work-based language learning activities (4) adaptive language learning activities based on learning platforms; and (5) language learning activities based on multimedia learning materials. The results of reviewed studies indicate that these learning activities supported by technology are effective in promoting the development of learners' different language skills and 21st century skills. Finally, in terms of methodology, most of the studies had a sample of 11–30, the most common study period was 3–6 months, the data collection method often used by researchers was questionnaires, the most common method to collect quantitative data was tests, and the most common method to collect qualitative data was interviews.

In contrast to traditional paper and pencil-based learning, technologies used by researchers in reviewed studies allowed learners to improve language learning outcomes and 21st century skills through individual and collaborative learning activities. Some reported advantages are learning with technologies without the constraints of time and space, technologies enable personalized learning, technologies create authentic learning environments that provides adaptive learning content, helps create multimedia content actively, allows social interaction such as sharing, giving or receiving feedback, and reflecting on learning more efficiently.

Based on the above findings, recommendations for researchers and educators in this study include: (1) In terms of language skills, in addition to focusing on output skills, input skills (reading, listening) also deserve attention from researchers. In terms of 21st century skills, learners' problem-solving skills and career and life skills also need more attention from researchers in the future; (2) Advanced technology training for learners to familiarize them with technology and its effective usage as well as teachers need to check in advance for possible technology problems, such as network problems. These suggestions can help teachers address the technological barriers that learners encounter in the learning process; (3) The use of various theoretical approaches, such as instructional design-related theories and language learning-related theories, is important for the rational design of instructional activities that promote learners' language and 21st century skills; (4) Researchers and educators can follow the general model of conducting the five types of instructional activities summarized above to design instructional activities. In addition, it is recommended that researchers and educators use variety of technologies and design different instructional activities to promote learners' language and 21st century skills. It is also important to be aware of the challenges that students may encounter in terms of technology, learning activity tasks, peer collaboration and self-attitudes when implementing learning activities; (5) Teachers and educators could involve more participants and consider longer time spans in future studies to focus on more learners' development and to collect diverse quantitative and qualitative data to explain students' learning processes and outcomes.

There are few limitations to this study. Articles reviewed in this study were sourced from PRIMO and Web of Science databases, and some conference papers, books and dissertations were excluded. For this reason, this study reviewed smaller number of articles. Future studies may consider this limitation and address it by including more relevant sources.

Data Availability Statement

Author contributions.

RS and XW contributed to the conception, designed the work, collected the data, analyzed, and interpreted data. XW drafted the work and RS substantively revised it. RS was responsible for correspondence. All authors approved the submitted version and agreed both to be personally accountable for the author's own contributions and to the accuracy the work.

Conflict of Interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher's Note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

1 Articles reviewed in this study.

Supplementary Material

The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fpsyg.2022.897689/full#supplementary-material

  • * . Amir Z., Ismail K., Hussin S. (2011). Blogs in language learning: maximizing students' collaborative writing . Procedia Soc. Behav. Sci. 18 , 537–543. 10.1016/j.sbspro.2011.05.079 [ CrossRef ] [ Google Scholar ]
  • An Z., Wang C., Li S., Gan Z., Li H. (2021). Technology-assisted self-regulated English language learning: associations with English language self-efficacy, English enjoyment, and learning outcomes . Front. Psychol. 11 :558466. 10.3389/fpsyg.2020.558466 [ PMC free article ] [ PubMed ] [ CrossRef ] [ Google Scholar ]
  • * . Aristizábal-Jiménez Y. (2020). Fostering talk as performance in an EFL class through the critical analysis of youtubers' content . Profile Issues Teach. Professional Dev. 22 , 181–195. 10.15446/profile.v22n2.82510 [ CrossRef ] [ Google Scholar ]
  • * . Arnó-Macià E., Rueda-Ramos C. (2011). Promoting reflection on science, technology, and society among engineering students through an EAP online learning environment . J. English Acad. Purposes 10 , 19–31. 10.1016/j.jeap.2010.12.004 [ CrossRef ] [ Google Scholar ]
  • Asia Pacific Economic Cooperation (2004). 2004 APEC Ministerial Meeting. Available online at: https://www.apec.org/Meeting-Papers/Annual-Ministerial-Meetings/2004/2004_amm (accessed June 11, 2022).
  • Avgousti M. I. (2018). Intercultural communicative competence and online exchanges: a systematic review . Computer Assisted Lang. Learn. 31 , 819–853. 10.1080/09588221.2018.1455713 [ CrossRef ] [ Google Scholar ]
  • Bennett M. (1986). A developmental approach to training for intercultural sensitivity . Int. J. Intercultural Relat. 10 , 179–196. 10.1016/0147-1767(86)90005-2 [ CrossRef ] [ Google Scholar ]
  • Byram M. (1997). Teaching and Assessing Intercultural Communicative Competence . Clevedon: Multilingual Matters. [ Google Scholar ]
  • * . Calogerakou C., Vlachos K. (2011). Films and Blogs: an authentic approach to improve the writing skill-an intercultural project-based framework in the Senior High State School . Res. Papers Lang. Teach. Learn. 2 , 98–110. [ Google Scholar ]
  • * . Chen C. H., Hung H. T., Yeh H. C. (2021). Virtual reality in problem-based learning contexts: effects on the problem-solving performance, vocabulary acquisition and motivation of English language learners . J. Computer Assisted Learn. 37 , 851–860. 10.1111/jcal.12528 [ CrossRef ] [ Google Scholar ]
  • * . Chen J. J., Yang S. C. (2014). Fostering foreign language learning through technology-enhanced intercultural projects . Lang. Learn. Technol. 18 , 57–75. [ Google Scholar ]
  • * . Chen J. J., Yang S. C. (2016). Promoting cross-cultural understanding and language use in research-oriented Internet-mediated intercultural exchange . Computer Assisted Lang. Learn. 29 , 262–288. 10.1080/09588221.2014.937441 [ CrossRef ] [ Google Scholar ]
  • * . Chiang M. H. (2020). Exploring the effects of digital storytelling: a case study of adult L2 writers . IAFOR J. Educ. 8 , 65–82. 10.22492/ije.8.1.04 [ CrossRef ] [ Google Scholar ]
  • Creswell J. W. (2002). Educational Research: Planning, Conducting, and Evaluating Quantitative. Upper Saddle River, NJ: Prentice Hall. [ Google Scholar ]
  • Duman G., Orhon G., Gedik N. (2015). Research trends in mobile assisted language learning from 2000 to 2012 . ReCALL 27 , 197–216. 10.1017/S0958344014000287 [ CrossRef ] [ Google Scholar ]
  • * . García-Sánchez M. S., Burbules N. C. (2016). Learning technologies and EFL teamwork . Revista de Lenguas para Fines Específicos 22 , 100–115. 10.20420/rlfe.2016.0092 [ CrossRef ] [ Google Scholar ]
  • * . Girgin P., Cabaroglu N. (2021). Web 2.0 supported flipped learning model: EFL students' perceptions and motivation . Cukurova Univ. Faculty Educ. J. 50 , 858–876. 10.14812/cuefd.944217 [ CrossRef ] [ Google Scholar ]
  • Goksu I., Ozkaya E., Gunduz A. (2020). The content analysis and bibliometric mapping of CALL journal . Computer Assisted Lang. Learn. 1–31. 10.1080/09588221.2020.1857409 [ CrossRef ] [ Google Scholar ]
  • Guan S. (2014). Internet-based technology use in second language learning: a systematic review . Int. J. Cyber Behav. Psychol. Learn. 4 , 69–81. 10.4018/ijcbpl.2014100106 [ CrossRef ] [ Google Scholar ]
  • Harmer J. (2007). The Practice of English Language Teaching . London: Longman. [ Google Scholar ]
  • * . Hirotani M., Fujii K. (2019). Learning proverbs through telecollaboration with Japanese native speakers: facilitating L2 learners' intercultural communicative competence . Asian Pacific J. Second Foreign Lang. Educ. 4 , 1–22. 10.1186/s40862-019-0067-5 [ CrossRef ] [ Google Scholar ]
  • * . Hosseinpour N., Biria R., Rezvani E. (2019). Promoting academic writing proficiency of Iranian EFL learners through blended learning . Turkish Online J. Distance Educ. 20 , 99–116. 10.17718/tojde.640525 [ CrossRef ] [ Google Scholar ]
  • * . Huang H. W. (2021). Effects of smartphone-based collaborative vlog projects on EFL learners' speaking performance and learning engagement . Austral. J. Educ. Technol. 37 , 18–40. 10.14742/ajet.6623 [ CrossRef ] [ Google Scholar ]
  • * . Huh K., Lee J. (2020). Fostering creativity and language skills of foreign language learners through SMART learning environments: evidence from fifth-grade Korean EFL learners . TESOL J. 11 , e489. 10.1002/tesj.489 [ CrossRef ] [ Google Scholar ]
  • * . Jamalai M., Krish P. (2021). Fostering 21st century skills using an online discussion forum in an English for specific purpose course . Malaysian J. Learn. Instruct. 18 , 219–240. 10.32890/mjli2021.18.1.9 [ CrossRef ] [ Google Scholar ]
  • * . Jung Y., Kim Y., Lee H., Cathey R., Carver J., Skalicky S. (2019). Learner perception of multimodal synchronous computer-mediated communication in foreign language classrooms . Lang. Teach. Res. 23 , 287–309. 10.1177/1362168817731910 [ CrossRef ] [ Google Scholar ]
  • Keller J. M. (1987). Development and use of the ARCS model of instructional design . J. Instruct. Dev. 10 , 2–10. 10.1007/BF02905780 [ CrossRef ] [ Google Scholar ]
  • Krashen S. D. (1985). The Input Hypothesis: Issues and Implications . London: Longman. [ Google Scholar ]
  • Kukulska-Hulme A., Viberg O. (2018). Mobile collaborative language learning: state of the art . Br. J. Educ. Technol. 49 , 207–218. 10.1111/bjet.12580 [ CrossRef ] [ Google Scholar ]
  • * . Kulsiri S. (2018). Students' perceptions of a student-produced video project in the General English language course at Srinakharinwirot University, Thailand . Arab World Eng. J. 4 , 40–54. 10.24093/awej/call4.4 [ CrossRef ] [ Google Scholar ]
  • * . Lai A. (2017). Implementing online platforms to promote collaborative learning in Chinese language classrooms . J. Technol. Chin. Lang. Teach. 8 , 39–52. [ Google Scholar ]
  • Lantolf J. (2000). Sociocultural Theory and Language Learning . Oxford: OUP. [ Google Scholar ]
  • * . Lewis T. N., Schneider H. (2015). Integrating international video chat into the foreign language curriculum . Int. J. Comput. Assisted Lang. Learn. Teach. 5 , 72–84. 10.4018/IJCALLT.2015040105 [ CrossRef ] [ Google Scholar ]
  • Lin L., Shadiev R., Hwang W. Y., Shen S. S. (2020). From knowledge and skills to digital works: an application of design thinking in the information technology course . Think. Skill Creat. 36 , 100646. 10.1016/j.tsc.2020.100646 [ CrossRef ] [ Google Scholar ]
  • * . Mirza H. S. (2020). Improving university students' english proficiency with digital storytelling . Int. Online J. Educ. Teach. 7 , 84–94. [ Google Scholar ]
  • * . Mohamadi Zenouzagh Z. (2018). Multidimensional analysis of efficacy of multimedia learning in development and sustained development of textuality in EFL writing performances . Educ. Information Technol. 23 , 2969–2989. 10.1007/s10639-018-9754-y [ CrossRef ] [ Google Scholar ]
  • Moher D., Liberati A., Tetzlaff J., Altman D. G., PRISMA Group * (2009). Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement . Ann. Internal Med. 151 , 264–269. 10.7326/0003-4819-151-4-200908180-00135 [ PMC free article ] [ PubMed ] [ CrossRef ] [ Google Scholar ]
  • * . Nikitova I., Kutova S., Shvets T., Pasichnyk O., Matsko V. (2020). “Flipped learning” methodology in professional training of future language teachers . Euro. J. Educ. Res. 9 , 19–31. 10.12973/eu-jer.9.1.19 [ CrossRef ] [ Google Scholar ]
  • * . Özdemir E. (2017). Promoting EFL learners' intercultural communication effectiveness: a focus on Facebook . Comput. Assisted Lang. Learn. 30 , 510–528. 10.1080/09588221.2017.1325907 [ CrossRef ] [ Google Scholar ]
  • Parmaxi A., Zaphiris P. (2017). Web 2.0 in Computer-Assisted Language Learning: a research synthesis and implications for instructional design and educational practice . Interact. Learn. Environ. 25 , 704–716. 10.1080/10494820.2016.1172243 [ CrossRef ] [ Google Scholar ]
  • Partnership for 21st Century Skills (2008). P21 Framework Definitions Document . Available online at: http://www.21stcenturyskills.org (accessed February 28, 2022).
  • Persson V., Nouri J. (2018). A systematic review of second language learning with mobile technologies . Int. J. Emerg. Technol. Learn. 13 , 188–210. 10.3991/ijet.v13i02.8094 [ CrossRef ] [ Google Scholar ]
  • * . Sevilla-Pavón A., Nicolaou A. (2017). Online intercultural exchanges through digital storytelling . Int. J. Comput. Assisted Lang. Learn. Teach. 7 , 44–58. 10.4018/IJCALLT.2017100104 [ CrossRef ] [ Google Scholar ]
  • * . Sevy-Biloon J., Chroman T. (2019). Authentic use of technology to improve EFL communication and motivation through international language exchange video chat . Teach. English Technol. 19 , 44–58. [ Google Scholar ]
  • Shadiev R., Hwang W.-Y., Ghinea G. (2022a). Guest editorial: Creative learning in authentic contexts with advanced educational technologies . Educ. Technol. Soc. 25 , 76–79. Available online at: https://www.jstor.org/stable/48660125 [ Google Scholar ]
  • Shadiev R., Hwang W. Y., Huang Y. M. (2017). Review of research on mobile language learning in authentic environments . Comput. Assist. Lang. Learn. 30 , 284–303. 10.1080/09588221.2017.1308383 [ CrossRef ] [ Google Scholar ]
  • Shadiev R., Wang X., Liu T.Y., Yang M. (In Press). Improving students' creativity in familiar versus unfamiliar mobile-assisted language learning environments. Interact. Learn. Environ. 10.1080/10494820.2021.2023891 [ CrossRef ] [ Google Scholar ]
  • Shadiev R., Yang M. (2020). Review of studies on technology-enhanced language learning and teaching . Sustainability. 12 , 524. 10.3390/su12020524 [ CrossRef ] [ Google Scholar ]
  • Shadiev R., Yi S., Dang C. Sintawati W. (2022b). Facilitating students' creativity, innovation and entrepreneurship in a telecollaborative project . Front. Psychol. 13 , 887620. 10.3389/fpsyg.2022.887620 [ PMC free article ] [ PubMed ] [ CrossRef ] [ Google Scholar ]
  • Shadiev R., Yu J. T. (In Press). Review of research on computer-assisted language learning with a focus on intercultural education. Comput. Assist. Lang. Learn. 10.1080/09588221.2022.2056616 [ CrossRef ] [ Google Scholar ]
  • * . Srebnaja J., Stavicka A. (2018). Web-based projects to develop transversal skills in secondary school . Hum. Technol. Qual. Educ. 2018 , 25–34. 10.22364/htqe.2018.03 [ CrossRef ] [ Google Scholar ]
  • Suzanne N. (2014). “Critical and effective reading to build the characters as active readers,” in International Conference on Languages and Arts (Padang: ), 47–352. [ Google Scholar ]
  • * . Thang S. M., Sim L. Y., Mahmud N., Lin L. K., Zabidi N. A., Ismail K. (2014). Enhancing 21st century learning skills via digital storytelling: voices of Malaysian teachers and undergraduates . Procedia Soc. Behav. Sci. 118 , 489–494. 10.1016/j.sbspro.2014.02.067 [ CrossRef ] [ Google Scholar ]
  • * . Tseng C. T. H. (2017). Teaching “Cross-Cultural Communication” through content based instruction: curriculum design and learning outcome from EFL learners' perspectives . English Lang. Teach. 10 , 22–34. 10.5539/elt.v10n4p22 [ CrossRef ] [ Google Scholar ]
  • * . Valdebenito M., Chen Y. (2019). Technology as enabler of learner autonomy and authentic learning in chinese language acquisition: a case study in higher education . J. Technol. Chin. Lang. Teach. 10, 61. [ Google Scholar ]
  • Vygotsky L. S. (1978). Mind in Society: The Development of Higher Psychological Processes . Cambridge, MA: Harvard University Press. [ Google Scholar ]
  • * . Yalçin O. B., Öztürk E. (2019). “The effects of digital storytelling on the creative writing skills of literature students based on their gender,” in ICGR 2019 2nd International Conference on Gender Research . (Rome: Academic Conferences and Publishing Limited; ), 59. [ Google Scholar ]
  • * . Yang Y. T. C., Chen Y. C., Hung H. T. (2022). Digital storytelling as an interdisciplinary project to improve students' English speaking and creative thinking . Comput. Assist. Lang. Learn. 35 , 840–862. 10.1080/09588221.2020.1750431 [ CrossRef ] [ Google Scholar ]
  • * . Yang Y. T. C., Chuang Y. C., Li L. Y., Tseng S. S. (2013). A blended learning environment for individualized English listening and speaking integrating critical thinking . Comput. Educ. 63 , 285–305. 10.1016/j.compedu.2012.12.012 [ CrossRef ] [ Google Scholar ]
  • * . Yang Y. T. C., Gamble J. H., Hung Y. W., Lin T. Y. (2014). An online adaptive learning environment for critical-thinking-infused English literacy instruction . Br. J. Educ. Technol. 45 , 723–747. 10.1111/bjet.12080 [ CrossRef ] [ Google Scholar ]
  • Zhang R., Zou D. (2020). Types, purposes, and effectiveness of state-of-the-art technologies for second and foreign language learning . Comput. Assist. Lang. Learn. 35 , 696–742. 10.1080/09588221.2020.1744666 [ CrossRef ] [ Google Scholar ]
  • * . Zou D., Xie H. (2019). Flipping an English writing class with technology-enhanced just-in-time teaching and peer instruction . Interact. Learn. Environ. 27 , 1127–1142. 10.1080/10494820.2018.1495654 [ CrossRef ] [ Google Scholar ]
  • Introduction
  • Article Information

FIP indicates International Pharmaceutical Federation.

eAppendix. Description of Methods

Data Sharing Statement

See More About

Sign up for emails based on your interests, select your interests.

Customize your JAMA Network experience by selecting one or more topics from the list below.

  • Academic Medicine
  • Acid Base, Electrolytes, Fluids
  • Allergy and Clinical Immunology
  • American Indian or Alaska Natives
  • Anesthesiology
  • Anticoagulation
  • Art and Images in Psychiatry
  • Artificial Intelligence
  • Assisted Reproduction
  • Bleeding and Transfusion
  • Caring for the Critically Ill Patient
  • Challenges in Clinical Electrocardiography
  • Climate and Health
  • Climate Change
  • Clinical Challenge
  • Clinical Decision Support
  • Clinical Implications of Basic Neuroscience
  • Clinical Pharmacy and Pharmacology
  • Complementary and Alternative Medicine
  • Consensus Statements
  • Coronavirus (COVID-19)
  • Critical Care Medicine
  • Cultural Competency
  • Dental Medicine
  • Dermatology
  • Diabetes and Endocrinology
  • Diagnostic Test Interpretation
  • Drug Development
  • Electronic Health Records
  • Emergency Medicine
  • End of Life, Hospice, Palliative Care
  • Environmental Health
  • Equity, Diversity, and Inclusion
  • Facial Plastic Surgery
  • Gastroenterology and Hepatology
  • Genetics and Genomics
  • Genomics and Precision Health
  • Global Health
  • Guide to Statistics and Methods
  • Hair Disorders
  • Health Care Delivery Models
  • Health Care Economics, Insurance, Payment
  • Health Care Quality
  • Health Care Reform
  • Health Care Safety
  • Health Care Workforce
  • Health Disparities
  • Health Inequities
  • Health Policy
  • Health Systems Science
  • History of Medicine
  • Hypertension
  • Images in Neurology
  • Implementation Science
  • Infectious Diseases
  • Innovations in Health Care Delivery
  • JAMA Infographic
  • Law and Medicine
  • Leading Change
  • Less is More
  • LGBTQIA Medicine
  • Lifestyle Behaviors
  • Medical Coding
  • Medical Devices and Equipment
  • Medical Education
  • Medical Education and Training
  • Medical Journals and Publishing
  • Mobile Health and Telemedicine
  • Narrative Medicine
  • Neuroscience and Psychiatry
  • Notable Notes
  • Nutrition, Obesity, Exercise
  • Obstetrics and Gynecology
  • Occupational Health
  • Ophthalmology
  • Orthopedics
  • Otolaryngology
  • Pain Medicine
  • Palliative Care
  • Pathology and Laboratory Medicine
  • Patient Care
  • Patient Information
  • Performance Improvement
  • Performance Measures
  • Perioperative Care and Consultation
  • Pharmacoeconomics
  • Pharmacoepidemiology
  • Pharmacogenetics
  • Pharmacy and Clinical Pharmacology
  • Physical Medicine and Rehabilitation
  • Physical Therapy
  • Physician Leadership
  • Population Health
  • Primary Care
  • Professional Well-being
  • Professionalism
  • Psychiatry and Behavioral Health
  • Public Health
  • Pulmonary Medicine
  • Regulatory Agencies
  • Reproductive Health
  • Research, Methods, Statistics
  • Resuscitation
  • Rheumatology
  • Risk Management
  • Scientific Discovery and the Future of Medicine
  • Shared Decision Making and Communication
  • Sleep Medicine
  • Sports Medicine
  • Stem Cell Transplantation
  • Substance Use and Addiction Medicine
  • Surgical Innovation
  • Surgical Pearls
  • Teachable Moment
  • Technology and Finance
  • The Art of JAMA
  • The Arts and Medicine
  • The Rational Clinical Examination
  • Tobacco and e-Cigarettes
  • Translational Medicine
  • Trauma and Injury
  • Treatment Adherence
  • Ultrasonography
  • Users' Guide to the Medical Literature
  • Vaccination
  • Venous Thromboembolism
  • Veterans Health
  • Women's Health
  • Workflow and Process
  • Wound Care, Infection, Healing

Get the latest research based on your areas of interest.

Others also liked.

  • Download PDF
  • X Facebook More LinkedIn

Ashraf AR , Mackey TK , Schmidt J, et al. Safety and Risk Assessment of No-Prescription Online Semaglutide Purchases. JAMA Netw Open. 2024;7(8):e2428280. doi:10.1001/jamanetworkopen.2024.28280

Manage citations:

© 2024

  • Permissions

Safety and Risk Assessment of No-Prescription Online Semaglutide Purchases

  • 1 Department of Pharmaceutics, Faculty of Pharmacy, University of Pécs, Pécs, Hungary
  • 2 Global Health Program, Department of Anthropology, University of California San Diego, La Jolla
  • 3 Global Health Policy and Data Institute, San Diego, California
  • 4 S-3 Research, San Diego, California
  • 5 Institute of Biochemistry and Medical Chemistry, Medical School, University of Pécs, Pécs, Hungary
  • 6 Department of Pharmaceutical Chemistry, Faculty of Pharmacy, University of Pécs, Pécs, Hungary

The popularity of branded semaglutide is surging, with widespread media coverage, viral social media exposure, and celebrity endorsements. 1 Although Wegovy (Novo Nordisk) is approved for long-term weight management, Ozempic (Novo Nordisk) (only approved for type 2 diabetes) is often used off-label for this purpose. Global regulatory agencies, including the US Food and Drug Administration (FDA), European Medicines Agency, and World Health Organization (WHO), have warned about fake versions driven by patient demand, high cost, and shortages. Illegal online pharmacies, which operate without valid licenses and sell medicines like semaglutide without prescription, represent a consumer risk for ineffective and dangerous products.

In this qualitative study, we conducted risk assessment of semaglutide online sourcing ( Figure and eAppendix in Supplement 1 ). We followed the SRQR reporting guideline.

First, we conducted structured searches on Google and Bing to catalog websites advertising semaglutide without a prescription in July 2023. Websites meeting inclusion criteria were selected for a product test buy protocol. 2 Two 0.25-mg per dose prefilled pens or equivalent semaglutide injection vials were ordered from each website. Upon product receipt, authors (A.R.A., and A.F.) used the International Pharmaceutical Federation’s (FIP) checklist for visual inspection to assess potential counterfeiting or falsification risks, compared with genuine Ozempic brand 1-mg semaglutide solution for injection in a prefilled pen. 3 Products were then tested for quality, including sterility and microbiological contamination, according to European Pharmacopoeia and US Pharmacopeia guidelines. Quantification of active ingredients was performed using liquid chromatography–mass spectrometry (LC-MS). Test purchases and analytical testing were performed August from 2023 to March 2024.

Search engine monitoring generated 1080 hyperlinks, with 317 (29.35%) for online pharmacies. Nearly one-half (134 sites [42.27%]) belonged to illegal pharmacy operations; 763 links were websites not offering products for sale, including 615 news and informational websites and 148 telemedicine websites requiring consultation to obtain prescription before purchase.

Six online vendors classified as not recommended or rogue by LegitScript and/or National Association of Boards of Pharmacy and offering parenteral semaglutide products were included in test buys. Three websites offered prefilled 0.25-mg per dose semaglutide injection pens, and 3 sold vials of lyophilized semaglutide to be reconstituted to solution for injection (1-3 mg). All vendors referred to weight loss and obesity on their product page. Prices for the smallest dose and quantity ranged from US $113 to $360 (mean [SD], US $218.5 [$93.6]) ( Table ).

Test purchases were confirmed via email and WhatsApp. Of 6 products purchased, only 3 were received. Three vendors selling Ozempic injections engaged in nondelivery scams requesting extra payments (range, US $650-$1200) to purportedly clear customs, confirmed as fraudulent by customs agencies. Although genuine Ozempic scored the full 22 points on the FIP checklist, test purchased products scored 8 or 9 with clear discrepancies in regulatory registration information, accurate labeling, and evidence products were likely unregistered or unlicensed.

Upon quality testing, one sample had elevated presence of endotoxin (8.95 EU/mg) indicating possible contamination, although no viable microorganisms were detected. LC-MS revealed the presence of semaglutide in all samples, but with considerably lower purity levels (7%-14% vs advertised 99%). The measured semaglutide content substantially exceeded the labeled amount in each sample by 29% to 39%, meaning that users could receive up to 39% more semaglutide per injection. These risk factors indicate likely falsification that does not meet legitimate product quality standards.

This qualitative study found that semaglutide products are actively being sold without prescription by illegal online pharmacies, with vendors shipping unregistered and falsified products. Two websites evaluated were sent FDA warning letters for unlawful sale of unapproved and misbranded semaglutide. 4 , 5 US poison centers have reported a 1500% increase in calls related to semaglutide, highlighting the need for enhanced pharmacovigilance including for online sourcing harms. 6 Study limitations include limited sample of products tested due to nondelivery scams. Furthermore, although tested products represent some accessible semaglutide products sold online, higher priced offerings were excluded, limiting generalizability of the findings.

Accepted for Publication: June 21, 2024.

Published: August 2, 2024. doi:10.1001/jamanetworkopen.2024.28280

Open Access: This is an open access article distributed under the terms of the CC-BY License . © 2024 Ashraf AR et al. JAMA Network Open .

Corresponding Author: Tim K. Mackey, MAS, PhD, Global Health Program, Department of Anthropology, University of California San Diego, 9500 Gilman Dr, MC 0505, La Jolla, CA 92093 ( [email protected] ).

Author Contributions: Dr Ashraf had full access to all of the data in the study and takes responsibility for the integrity of the data and the accuracy of the data analysis.

Concept and design: Ashraf, Mackey, Vida, Li, Fittler.

Acquisition, analysis, or interpretation of data: All authors.

Drafting of the manuscript: Ashraf, Mackey, Kulcsár, Vida, Fittler.

Critical review of the manuscript for important intellectual content: Ashraf, Mackey, Schmidt, Kulcsár, Li, Fittler.

Statistical analysis: Ashraf, Kulcsár, Li.

Obtained funding: Mackey, Fittler.

Administrative, technical, or material support: Ashraf, Mackey, Vida, Li.

Supervision: Mackey, Fittler.

Conflict of Interest Disclosures: Mr Schmidt reported receiving grant TKP2021-EGA-17 from the Hungarian National Research, Development and Innovation Office outside the submitted work. No other disclosures were reported.

Funding/Support: The research was supported by the Hungarian Scientific Research Fund (grant NKFI-ID 143684).

Role of the Funder/Sponsor: The funder had no role in the design and conduct of the study; collection, management, analysis, and interpretation of the data; preparation, review, or approval of the manuscript; and decision to submit the manuscript for publication.

Data Sharing Statement: See Supplement 2 .

Additional Contributions: The research was performed in collaboration with Mass Spectrometry Core Facility at the Szentágothai Research Centre of the University of Pécs.

  • Register for email alerts with links to free full-text articles
  • Access PDFs of free articles
  • Manage your interests
  • Save searches and receive search alerts

Information

  • Author Services

Initiatives

You are accessing a machine-readable page. In order to be human-readable, please install an RSS reader.

All articles published by MDPI are made immediately available worldwide under an open access license. No special permission is required to reuse all or part of the article published by MDPI, including figures and tables. For articles published under an open access Creative Common CC BY license, any part of the article may be reused without permission provided that the original article is clearly cited. For more information, please refer to https://www.mdpi.com/openaccess .

Feature papers represent the most advanced research with significant potential for high impact in the field. A Feature Paper should be a substantial original Article that involves several techniques or approaches, provides an outlook for future research directions and describes possible research applications.

Feature papers are submitted upon individual invitation or recommendation by the scientific editors and must receive positive feedback from the reviewers.

Editor’s Choice articles are based on recommendations by the scientific editors of MDPI journals from around the world. Editors select a small number of articles recently published in the journal that they believe will be particularly interesting to readers, or important in the respective research area. The aim is to provide a snapshot of some of the most exciting work published in the various research areas of the journal.

Original Submission Date Received: .

  • Active Journals
  • Find a Journal
  • Proceedings Series
  • For Authors
  • For Reviewers
  • For Editors
  • For Librarians
  • For Publishers
  • For Societies
  • For Conference Organizers
  • Open Access Policy
  • Institutional Open Access Program
  • Special Issues Guidelines
  • Editorial Process
  • Research and Publication Ethics
  • Article Processing Charges
  • Testimonials
  • Preprints.org
  • SciProfiles
  • Encyclopedia

microorganisms-logo

Article Menu

research on language acquisition indicates that

  • Subscribe SciFeed
  • Recommended Articles
  • Google Scholar
  • on Google Scholar
  • Table of Contents

Find support for a specific problem in the support section of our website.

Please let us know what you think of our products and services.

Visit our dedicated information section to learn more about MDPI.

JSmol Viewer

Advances in research on bacterial oxidation of mn(ii): a visualized bibliometric analysis based on citespace.

research on language acquisition indicates that

1. Introduction

2. materials and methods, 2.1. data source and retrieval strategy, 2.2. data analysis and visualization, 3.1. trend analysis of annual publications, 3.2. analysis of countries and institutions, 3.3. analysis of disciplinary classifications, 3.4. analysis of authors of co-occurrence and co-citation, 3.5. analysis of journal citations, 3.6. analysis of co-cited references, 3.7. analysis of temporal and burst of keywords, 3.8. analysis of keyword clusters, 4. discussion, 4.1. research hotspots and trends, 4.1.1. species and ecological distribution, 4.1.2. factors influencing bacterial mn(ii) oxidation, 4.1.3. mechanisms of mn(ii) oxidation in bacteria, 4.1.4. environmental applications, 4.2. outlook, 5. conclusions, author contributions, data availability statement, conflicts of interest.

  • Learman, D.R.; Hansel, C.M. Comparative Proteomics of Mn(II)-Oxidizing and Non-Oxidizing Roseobacter Clade Bacteria Reveal an Operative Manganese Transport System but Minimal Mn(II)-Induced Expression of Manganese Oxidation and Antioxidant Enzymes. Environ. Microbiol. Rep. 2014 , 6 , 501–509. [ Google Scholar ] [ CrossRef ] [ PubMed ]
  • Beukes, L.S.; Schmidt, S. Isolation and Characterization of a Manganese-Oxidizing Bacterium from a Biofiltration System for the Treatment of Borehole Water in KwaZulu-Natal (South Africa). Eng. Life Sci. 2012 , 12 , 544–552. [ Google Scholar ] [ CrossRef ]
  • Guo, X.; Tang, Y.; Yin, J.; Li, R.; Qin, B.; Jiang, L.; Chen, X.; Huang, Z. Long-Term Manganese Exposure-Mediated Benthic Diatom Assemblage in a Subtropical Stream: Distribution, Substrate Preferences and Mn-Tolerance. J. Environ. Manag. 2022 , 322 , 116153. [ Google Scholar ] [ CrossRef ]
  • Dobson, A.W.; Erikson, K.M.; Aschner, M. Manganese Neurotoxicity. Ann. N. Y. Acad. Sci. 2004 , 1012 , 115–128. [ Google Scholar ] [ CrossRef ] [ PubMed ]
  • Favas, P.J.C.; Sarkar, S.K.; Rakshit, D.; Venkatachalam, P.; Prasad, M.N.V. Chapter 17—Acid Mine Drainages From Abandoned Mines: Hydrochemistry, Environmental Impact, Resource Recovery, and Prevention of Pollution. In Environmental Materials and Waste ; Prasad, M.N.V., Shih, K., Eds.; Academic Press: Cambridge, MA, USA, 2016; pp. 413–462. ISBN 978-0-12-803837-6. [ Google Scholar ]
  • Zeng, L.; Liu, X.; Ma, J.; Yang, J.; Yang, J.; Zhou, Y. Current Progress on Manganese in Constructed Wetlands: Bibliometrics, Effects on Wastewater Treatment, and Plant Uptake. Environ. Res. 2024 , 249 , 118382. [ Google Scholar ] [ CrossRef ] [ PubMed ]
  • Elzinga, E.J. Reductive Transformation of Birnessite by Aqueous Mn(II). Environ. Sci. Technol. 2011 , 45 , 6366–6372. [ Google Scholar ] [ CrossRef ] [ PubMed ]
  • Rambabu, K.; Banat, F.; Pham, Q.M.; Ho, S.-H.; Ren, N.-Q.; Show, P.L. Biological Remediation of Acid Mine Drainage: Review of Past Trends and Current Outlook. Environ. Sci. Ecotechnology 2020 , 2 , 100024. [ Google Scholar ] [ CrossRef ] [ PubMed ]
  • Qin, X.; Sun, X.; Huang, H.; Bai, Y.; Wang, Y.; Luo, H.; Yao, B.; Zhang, X.; Su, X. Oxidation of a Non-Phenolic Lignin Model Compound by Two Irpex Lacteus Manganese Peroxidases: Evidence for Implication of Carboxylate and Radicals. Biotechnol. Biofuels. 2017 , 10 , 103. [ Google Scholar ] [ CrossRef ] [ PubMed ]
  • Yin, H.; Lanson, B.; Zhang, S.; Liu, L.; Peacock, C.L.; Post, J.E.; Zhu, M.; Li, W.; Wang, Q.; Zhang, J.; et al. Effect and Fate of Ni during Aging and Thermal-Induced Phyllomanganate-to-Tectomanganate Transformation. Geochim. Cosmochim. Acta. 2022 , 333 , 200–215. [ Google Scholar ] [ CrossRef ]
  • Berg, B.; Lönn, M. Long-Term Effects of Climate and Litter Chemistry on Rates and Stable Fractions of Decomposing Scots Pine and Norway Spruce Needle Litter—A Synthesis. Forests 2022 , 13 , 125. [ Google Scholar ] [ CrossRef ]
  • Remucal, C.K.; Ginder-Vogel, M. A Critical Review of the Reactivity of Manganese Oxides with Organic Contaminants. Environ. Sci. Process. Impacts. 2014 , 16 , 1247–1266. [ Google Scholar ] [ CrossRef ] [ PubMed ]
  • Wu, R.; Wu, H.; Jiang, X.; Shen, J.; Faheem, M.; Sun, X.; Li, J.; Han, W.; Wang, L.; Liu, X. The Key Role of Biogenic Manganese Oxides in Enhanced Removal of Highly Recalcitrant 1,2,4-Triazole from Bio-Treated Chemical Industrial Wastewater. Environ. Sci. Pollut. Res. 2017 , 24 , 10570–10583. [ Google Scholar ] [ CrossRef ] [ PubMed ]
  • Zerfass, C.; Christie-Oleza, J.A.; Soyer, O.S. Manganese Oxide Biomineralization Provides Protection against Nitrite Toxicity in a Cell-Density-Dependent Manner. Appl. Environ. Microbiol. 2019 , 85 , e02129-18. [ Google Scholar ] [ CrossRef ] [ PubMed ]
  • Furuta, S.; Ikegaya, H.; Fujibayashi, M.; Hashimoto, H.; Suzuki, S.; Okano, K.; Ichise, S.; Miyata, N. Effects of Algal Extracellular Polysaccharides on the Formation of Filamentous Manganese Oxide Particles in the Near-Bottom Layer of Lake Biwa. Microorganisms 2023 , 11 , 1814. [ Google Scholar ] [ CrossRef ] [ PubMed ]
  • Francis, C.; Casciotti, K.; Tebo, B. Localization of Mn(II)-Oxidizing Activity and the Putative Multicopper Oxidase, MnxG, to the Exosporium of the Marine Bacillus sp. Strain SG-1. Arch. Microbiol. 2002 , 178 , 450–456. [ Google Scholar ] [ CrossRef ] [ PubMed ]
  • Murray, K.J.; Tebo, B.M. Cr(III) Is Indirectly Oxidized by the Mn(II)-Oxidizing Bacterium Bacillus sp. Strain SG-1. Environ. Sci. Technol. 2007 , 41 , 528–533. [ Google Scholar ] [ CrossRef ] [ PubMed ]
  • Zeng, X.; Zhang, M.; Liu, Y.; Tang, W. Manganese(II) Oxidation by the Multi-Copper Oxidase CopA from Brevibacillus Panacihumi MK-8. Enzyme Microb. Technol. 2018 , 117 , 79–83. [ Google Scholar ] [ CrossRef ] [ PubMed ]
  • Zhao, X.; Wang, X.; Liu, B.; Xie, G.; Xing, D. Characterization of Manganese Oxidation by Brevibacillus at Different Ecological Conditions. Chemosphere 2018 , 205 , 553–558. [ Google Scholar ] [ CrossRef ] [ PubMed ]
  • Yang, W.; Zhang, Z.; Zhang, Z.; Chen, H.; Liu, J.; Ali, M.; Liu, F.; Li, L. Population Structure of Manganese-Oxidizing Bacteria in Stratified Soils and Properties of Manganese Oxide Aggregates under Manganese-Complex Medium Enrichment. PLoS ONE 2013 , 8 , e73778. [ Google Scholar ] [ CrossRef ]
  • Liang, J.; Bai, Y.; Men, Y.; Qu, J. Microbe-Microbe Interactions Trigger Mn(II)-Oxidizing Gene Expression. ISME J. 2017 , 11 , 67–77. [ Google Scholar ] [ CrossRef ]
  • Bai, Y.; Su, J.; Wen, Q.; Huang, T.; Chang, Q.; Ali, A. Characterization and Mechanism of Mn(II)-Based Mixotrophic Denitrifying Bacterium ( Cupriavidus sp. HY129) in Remediation of Nitrate (NO 3 − -N) and Manganese (Mn(II)) Contaminated Groundwater. J. Hazard. Mater. 2021 , 408 , 124414. [ Google Scholar ] [ CrossRef ]
  • Ridge, J.P.; Lin, M.; Larsen, E.I.; Fegan, M.; McEwan, A.G.; Sly, L.I. A Multicopper Oxidase Is Essential for Manganese Oxidation and Laccase-like Activity in Pedomicrobium sp. ACM 3067. Environ. Microbiol. 2007 , 9 , 944–953. [ Google Scholar ] [ CrossRef ] [ PubMed ]
  • Anderson, C.; Caputo, N.; Davis, R.; Torpey, J.; Tebo, B. Mn(II) Oxidation Is Catalyzed by Heme Peroxidases in “ Aurantimonas Manganoxydans ” Strain SI85-9A1 and Erythrobacter sp. Strain SD-21. Appl. Environ. Microbiol. 2009 , 75 , 4130–4138. [ Google Scholar ] [ CrossRef ] [ PubMed ]
  • Anderson, E.; Paulley, J.; Gaines, J.; Valderas, M.; Martin, D.; Menscher, E.; Brown, T.; Burns, C.; Roop, R. The Manganese Transporter MntH Is a Critical Virulence Determinant for Brucella . Infect. Immun. 2009 , 77 , 3466–3474. [ Google Scholar ] [ CrossRef ] [ PubMed ]
  • Andeer, P.F.; Learman, D.R.; McIlvin, M.; Dunn, J.A.; Hansel, C.M. Extracellular Haem Peroxidases Mediate Mn(II) Oxidation in a Marine Roseobacter Bacterium via Superoxide Production. Environ. Microbiol. 2015 , 17 , 3925–3936. [ Google Scholar ] [ CrossRef ] [ PubMed ]
  • Learman, D.R.; Voelker, B.M.; Vazquez-Rodriguez, A.I.; Hansel, C.M. Formation of Manganese Oxides by Bacterially Generated Superoxide. Nat. Geosci. 2011 , 4 , 95–98. [ Google Scholar ] [ CrossRef ]
  • Bocioaga, D.; El Gheriany, I.A.; Lion, L.W.; Ghiorse, W.C.; Shuler, M.L.; Hay, A.G. Development of a Genetic System for a Model Manganese-Oxidizing Proteobacterium, Leptothrix Discophora SS1. Microbiology. 2014 , 160 , 2396–2405. [ Google Scholar ] [ CrossRef ] [ PubMed ]
  • Corstjens, P.L.A.M.; de Vrind, J.P.M.; Goosen, T.; Jong, E.W.d.V. Identification and Molecular Analysis of the Leptothrix Discophora SS-1 mofA Gene, a Gene Putatively Encoding a Manganese-oxidizing Protein with Copper Domains. Geomicrobiol. J. 1997 , 14 , 91–108. [ Google Scholar ] [ CrossRef ]
  • Eggerichs, T.; Otte, T.; Opel, O.; Ruck, W.K.L. Direct and Mn-Controlled Indirect Iron Oxidation by Leptothrix Discophora SS-1 and Leptothrix Cholodnii . Geomicrobiol. J. 2015 , 32 , 934–943. [ Google Scholar ] [ CrossRef ]
  • El Gheriany, I.A.; Bocioaga, D.; Hay, A.G.; Ghiorse, W.C.; Shuler, M.L.; Lion, L.W. Iron Requirement for Mn(II) Oxidation by Leptothrix Discophora SS-1. Appl. Environ. Microbiol. 2009 , 75 , 1229–1235. [ Google Scholar ] [ CrossRef ]
  • Zhang, D.-C.; Liu, Y.-X.; Li, X.-Z. Characterization of Bacterial Diversity Associated with Deep Sea Ferromanganese Nodules from the South China Sea. J. Microbiol. 2015 , 53 , 598–605. [ Google Scholar ] [ CrossRef ] [ PubMed ]
  • Anand, V.; Kaur, J.; Srivastava, S.; Bist, V.; Dharmesh, V.; Kriti, K.; Bisht, S.; Srivastava, P.K.; Srivastava, S. Potential of Methyltransferase Containing Pseudomonas Oleovorans for Abatement of Arsenic Toxicity in Rice. Sci. Total Environ. 2023 , 856 , 158944. [ Google Scholar ] [ CrossRef ] [ PubMed ]
  • Geszvain, K.; McCarthy, J.K.; Tebo, B.M. Elimination of Manganese(II,III) Oxidation in Pseudomonas Putida GB-1 by a Double Knockout of Two Putative Multicopper Oxidase Genes. Appl. Environ. Microbiol. 2013 , 79 , 357–366. [ Google Scholar ] [ CrossRef ] [ PubMed ]
  • Tang, Y.; Webb, S.M.; Estes, E.R.; Hansel, C.M. Chromium(III) Oxidation by Biogenic Manganese Oxides with Varying Structural Ripening. Environ. Sci.-Process. IMPACTS 2014 , 16 , 2127–2136. [ Google Scholar ] [ CrossRef ] [ PubMed ]
  • Sun, Y.; Zhang, Y.; Li, W.; Zhang, W.; Xu, Z.; Dai, M.; Zhao, G. Combination of the Endophytic Manganese-Oxidizing Bacterium Pantoea Eucrina SS01 and Biogenic Mn Oxides: An Efficient and Sustainable Complex in Degradation and Detoxification of Malachite Green. Chemospher 2021 , 280 , 130785. [ Google Scholar ] [ CrossRef ] [ PubMed ]
  • Djoko, K.Y.; Chong, L.X.; Wedd, A.G.; Xiao, Z. Reaction Mechanisms of the Multicopper Oxidase CueO from Escherichia Coli Support Its Functional Role as a Cuprous Oxidase. J. Am. Chem. Soc. 2010 , 132 , 2005–2015. [ Google Scholar ] [ CrossRef ] [ PubMed ]
  • Das, R.; Yao, P.; Yin, H.; Liang, Z.; Li, G.; An, T. BPA Degradation Using Biogenic Manganese Oxides Produced by an Engineered Escherichia Coli with a Non-Blue Laccase from Bacillus sp. GZB. Chemosphere 2023 , 326 , 138407. [ Google Scholar ] [ CrossRef ]
  • Geszvain, K.; Smesrud, L.; Tebo, B.M. Identification of a Third Mn(II) Oxidase Enzyme in Pseudomonas Putida GB-1. Appl. Environ. Microbiol. 2016 , 82 , 3774–3782. [ Google Scholar ] [ CrossRef ]
  • Bramness, J.G.; Henriksen, B.; Person, O.; Mann, K. A Bibliometric Analysis of European versus USA Research in the Field of Addiction. Research on Alcohol, Narcotics, Prescription Drug Abuse, Tobacco and Steroids 2001–2011. Eur. Addict. Res. 2014 , 20 , 16–22. [ Google Scholar ] [ CrossRef ]
  • Chen, C. Searching for Intellectual Turning Points: Progressive Knowledge Domain Visualization. Proc. Natl. Acad. Sci. USA 2004 , 101 , 5303–5310. [ Google Scholar ] [ CrossRef ]
  • Chen, C.; Ibekwe-SanJuan, F.; Hou, J. The Structure and Dynamics of Cocitation Clusters: A Multiple-Perspective Cocitation Analysis. J. Am. Soc. Inf. Sci. Technol. 2010 , 61 , 1386–1409. [ Google Scholar ] [ CrossRef ]
  • Jones, M.R.; Luther, G.W., 3rd; Mucci, A.; Tebo, B.M. Concentrations of Reactive Mn(III)-L and MnO 2 in Estuarine and Marine Waters Determined Using Spectrophotometry and the Leuco Base, Leucoberbelin Blue. Talanta. 2019 , 200 , 91–99. [ Google Scholar ] [ CrossRef ] [ PubMed ]
  • Oldham, V.E.; Jones, M.R.; Tebo, B.M.; Luther, G.W. Oxidative and Reductive Processes Contributing to Manganese Cycling at Oxic-Anoxic Interfaces. SI Honor. Mar. Chem. 2017 , 195 , 122–128. [ Google Scholar ] [ CrossRef ]
  • Toyoda, K.; Tebo, B.M. The Effect of Ca 2+ Ions and Ionic Strength on Mn(II) Oxidation by Spores of the Marine Bacillus sp. SG-1. Geochim. Cosmochim. Acta. 2013 , 101 , 1–11. [ Google Scholar ] [ CrossRef ] [ PubMed ]
  • Webb, S.M.; Tebo, B.M.; Barger, J.R. Structural Influences of Sodium and Calcium Ions on the Biogenic Manganese Oxides Produced by the Marine Bacillus sp. Strain SG-1. Geomicrobiol. J. 2005 , 22 , 181–193. [ Google Scholar ] [ CrossRef ]
  • Huang, X.; Shin, J.H.; Pinochet-Barros, A.; Su, T.T.; Helmann, J.D. Bacillus Subtilis MntR Coordinates the Transcriptional Regulation of Manganese Uptake and Efflux Systems. Mol. Microbiol. 2017 , 103 , 253–268. [ Google Scholar ] [ CrossRef ] [ PubMed ]
  • Geszvain, K.; Yamaguchi, A.; Maybee, J.; Tebo, B.M. Mn(II) Oxidation in Pseudomonas Putida GB-1 Is Influenced by Flagella Synthesis and Surface Substrate. Arch. Microbiol. 2011 , 193 , 605–614. [ Google Scholar ] [ CrossRef ] [ PubMed ]
  • Geszvain, K.; Butterfield, C.; Davis, R.E.; Madison, A.S.; Lee, S.W.; Parker, D.L.; Soldatova, A.; Spiro, T.G.; Luther, G.W.; Tebo, B.M. The Molecular Biogeochemistry of Manganese(II) Oxidation. Biochem. Soc. Trans. 2012 , 40 , 1244–1248. [ Google Scholar ] [ CrossRef ]
  • Geszvain, K.; Tebo, B.M. Identification of a Two-Component Regulatory Pathway Essential for Mn(II) Oxidation in Pseudomonas Putida GB-1. Appl. Environ. Microbiol. 2010 , 76 , 1224–1231. [ Google Scholar ] [ CrossRef ]
  • Su, J.; Bao, P.; Bai, T.; Deng, L.; Wu, H.; Liu, F.; He, J. CotA, a Multicopper Oxidase from Bacillus Pumilus WH4, Exhibits Manganese-Oxidase Activity. PLoS ONE 2013 , 8 , e60573. [ Google Scholar ] [ CrossRef ]
  • Cai, Y.; Li, D.; Liang, Y.; Luo, Y.; Zeng, H.; Zhang, J. Effective Start-up Biofiltration Method for Fe, Mn, and Ammonia Removal and Bacterial Community Analysis. Bioresour. Technol. 2015 , 176 , 149–155. [ Google Scholar ] [ CrossRef ] [ PubMed ]
  • Tran, T.N.; Kim, D.-G.; Ko, S.-O. Synergistic Effects of Biogenic Manganese Oxide and Mn(II)-Oxidizing Bacterium Pseudomonas Putida Strain MnB1 on the Degradation of 17 α-Ethinylestradiol. J. Hazard. Mater. 2018 , 344 , 350–359. [ Google Scholar ] [ CrossRef ] [ PubMed ]
  • Yang, H.; Yan, Z.; Du, X.; Bai, L.; Yu, H.; Ding, A.; Li, G.; Liang, H.; Aminabhavi, T.M. Removal of Manganese from Groundwater in the Ripened Sand Filtration: Biological Oxidation versus Chemical Auto-Catalytic Oxidation. Chem. Eng. J. 2020 , 382 , 123033. [ Google Scholar ] [ CrossRef ]
  • Zhang, Y.; Tang, Y.; Qin, Z.; Luo, P.; Ma, Z.; Tan, M.; Kang, H.; Huang, Z. A Novel Manganese Oxidizing Bacterium- Aeromonas Hydrophila Strain DS02: Mn(II) Oxidization and Biogenic Mn Oxides Generation. J. Hazard. Mater. 2019 , 367 , 539–545. [ Google Scholar ] [ CrossRef ]
  • Butterfield, C.N.; Soldatova, A.V.; Lee, S.W.; Spiro, T.G.; Tebo, B.M. Mn(II,III) Oxidation and MnO 2 Mineralization by an Expressed Bacterial Multicopper Oxidase. Proc. Natl. Acad. Sci. USA 2013 , 110 , 11731–11735. [ Google Scholar ] [ CrossRef ] [ PubMed ]
  • Marcus, D.N.; Pinto, A.; Anantharaman, K.; Ruberg, S.A.; Kramer, E.L.; Raskin, L.; Dick, G.J. Diverse Manganese(II)-Oxidizing Bacteria Are Prevalent in Drinking Water Systems. Environ. Microbiol. Rep. 2017 , 9 , 120–128. [ Google Scholar ] [ CrossRef ] [ PubMed ]
  • Chen, C. CiteSpace II: Detecting and Visualizing Emerging Trends and Transient Patterns in Scientific Literature. J. Am. Soc. Inf. Sci. Technol. 2006 , 57 , 359–377. [ Google Scholar ] [ CrossRef ]
  • Su, J.; Deng, L.; Huang, L.; Guo, S.; Liu, F.; He, J. Catalytic Oxidation of Manganese(II) by Multicopper Oxidase CueO and Characterization of the Biogenic Mn Oxide. Water. Res. 2014 , 56 , 304–313. [ Google Scholar ] [ CrossRef ] [ PubMed ]
  • Su, J.; Li, Z.; Liao, B.; Zhu, Y.; Zhang, X.; Wang, C.; He, J. Microcalorimetric Study of the Effect of Manganese on the Growth and Metabolism in a Heterogeneously Expressing Manganese-Dependent Superoxide Dismutase (Mn-SOD) Strain. J. Therm. Anal. Calorim. 2017 , 130 , 1407–1416. [ Google Scholar ] [ CrossRef ]
  • Rajasabapathy, R.; Mohandass, C.; Dastager, S.G.; Liu, Q.; Li, W.J.; Colaco, A. Citreicella Manganoxidans sp. nov., a Novel Manganese Oxidizing Bacterium Isolated from a Shallow Water Hydrothermal Vent in Espalamaca (Azores). Antonie Van Leeuwenhoek 2015 , 108 , 1433–1439. [ Google Scholar ] [ CrossRef ]
  • Wang, L.; Liu, Y.; Wang, Y.; Dai, X.; Zhang, X.H. Celeribacter Manganoxidans sp. nov., a Manganese-Oxidizing Bacterium Isolated from Deep-Sea Sediment of a Polymetallic Nodule Province. Int. J. Syst. Evol. Microbiol. 2015 , 65 , 4180–4185. [ Google Scholar ] [ CrossRef ] [ PubMed ]
  • Huang, L.; Liu, X.; Rensing, C.; Yuan, Y.; Zhou, S.; Nealson, K.H. Light-Independent Anaerobic Microbial Oxidation of Manganese Driven by an Electrosyntrophic Coculture. ISME J. 2023 , 17 , 163–171. [ Google Scholar ] [ CrossRef ] [ PubMed ]
  • Yu, H.; Leadbetter, J.R. Bacterial Chemolithoautotrophy via Manganese Oxidation. Nature 2020 , 583 , 453–458. [ Google Scholar ] [ CrossRef ] [ PubMed ]
  • Bargar, J.R.; Tebo, B.M.; Bergmann, U.; Webb, S.M.; Glatzel, P.; Chiu, V.Q.; Villalobos, M. Biotic and Abiotic Products of Mn(II) Oxidation by Spores of the Marine Bacillus sp. Strain SG-1. Am. Mineral. 2005 , 90 , 143–154. [ Google Scholar ] [ CrossRef ]
  • Estes, E.R.; Andeer, P.F.; Nordlund, D.; Wankel, S.D.; Hansel, C.M. Biogenic Manganese Oxides as Reservoirs of Organic Carbon and Proteins in Terrestrial and Marine Environments. Geobiology 2017 , 15 , 158–172. [ Google Scholar ] [ CrossRef ] [ PubMed ]
  • Tebo, B.M.; Johnson, H.A.; McCarthy, J.K.; Templeton, A.S. Geomicrobiology of Manganese(II) Oxidation. Trends Microbiol. 2005 , 13 , 421–428. [ Google Scholar ] [ CrossRef ] [ PubMed ]
  • Vasilatos, C.; Economou-Eliopoulos, M. Fossilized Bacteria in Fe-Mn-Mineralization: Evidence from the Legrena Valley, W. Lavrion Mine (Greece). Minerals 2018 , 8 , 107. [ Google Scholar ] [ CrossRef ]
  • Okano, K.; Furuta, S.; Ichise, S.; Miyata, N. Whole-Genome Sequences of Two Manganese(II)-Oxidizing Bacteria, Bosea sp. Strain BIWAKO-01 and Alphaproteobacterium Strain U9-1i. Genome Announc. 2016 , 4 , e01309-16. [ Google Scholar ] [ CrossRef ] [ PubMed ]
  • Hansel, C.M.; Francis, C.A. Coupled Photochemical and Enzymatic Mn(II) Oxidation Pathways of a Planktonic Roseobacter -Like Bacterium. Appl. Environ. Microbiol. 2006 , 72 , 3543–3549. [ Google Scholar ] [ CrossRef ]
  • Jiang, S.; Kim, D.-G.; Kim, J.; Ko, S.-O. Characterization of the Biogenic Manganese Oxides Produced by Pseudomonas Putida Strain MnB1. Environ. Eng. Res. 2010 , 15 , 183–190. [ Google Scholar ] [ CrossRef ]
  • Learman, D.R.; Wankel, S.D.; Webb, S.M.; Martinez, N.; Madden, A.S.; Hansel, C.M. Coupled Biotic–Abiotic Mn(II) Oxidation Pathway Mediates the Formation and Structural Evolution of Biogenic Mn Oxides. Geochim. Cosmochim. Acta 2011 , 75 , 6048–6063. [ Google Scholar ] [ CrossRef ]
  • Villalobos, M.; Toner, B.; Bargar, J.; Sposito, G. Characterization of the Manganese Oxide Produced by Pseudomonas Putida Strain MnB1. Geochim. Cosmochim. Acta 2003 , 67 , 2649–2662. [ Google Scholar ] [ CrossRef ]
  • Okazaki, M.; Sugita, T.; Shimizu, M.; Ohode, Y.; Iwamoto, K.; de Vrind-de Jong, E.W.; de Vrind, J.P.; Corstjens, P.L. Partial Purification and Characterization of Manganese-Oxidizing Factors of Pseudomonas Fluorescens GB-1. Appl. Environ. Microbiol. 1997 , 63 , 4793–4799. [ Google Scholar ] [ CrossRef ] [ PubMed ]
  • Wang, H.; Li, H.; Shao, Z.; Liao, S.; Johnstone, L.; Rensing, C.; Wang, G. Genome Sequence of Deep-Sea Manganese-Oxidizing Bacterium Marinobacter Manganoxydans MnI7-9. J. Bacteriol. 2012 , 194 , 899–900. [ Google Scholar ] [ CrossRef ] [ PubMed ]
  • Nakama, K.; Medina, M.; Lien, A.; Ruggieri, J.; Collins, K.; Johnson, H.A. Heterologous Expression and Characterization of the Manganese-Oxidizing Protein from Erythrobacter sp. Strain SD21. Appl. Environ. Microbiol. 2014 , 80 , 6837–6842. [ Google Scholar ] [ CrossRef ]
  • Brouwers, G.J.; Vijgenboom, E.; Corstjens, P.L.A.M.; De Vrind, J.P.M.; De Vrind-De Jong, E.W. Bacterial Mn 2+ Oxidizing Systems and Multicopper Oxidases: An Overview of Mechanisms and Functions. Geomicrobiol. J. 2000 , 17 , 1–24. [ Google Scholar ] [ CrossRef ]
  • Dick, G.J.; Torpey, J.W.; Beveridge, T.J.; Tebo, B.M. Direct Identification of a Bacterial Manganese(II) Oxidase, the Multicopper Oxidase MnxG, from Spores of Several Different Marine Bacillus Species. Appl. Environ. Microbiol. 2008 , 74 , 1527–1534. [ Google Scholar ] [ CrossRef ] [ PubMed ]
  • Barynin, V.V.; Whittaker, M.M.; Antonyuk, S.V.; Lamzin, V.S.; Harrison, P.M.; Artymiuk, P.J.; Whittaker, J.W. Crystal Structure of Manganese Catalase from Lactobacillus Plantarum . Struct. Lond. Engl. 1993 2001 , 9 , 725–738. [ Google Scholar ] [ CrossRef ] [ PubMed ]
  • Yu, H.; Chadwick, G.L.; Lingappa, U.F.; Leadbetter, J.R. Comparative Genomics on Cultivated and Uncultivated Freshwater and Marine “Candidatus Manganitrophaceae” Species Implies Their Worldwide Reach in Manganese Chemolithoautotrophy. mBio 2022 , 13 , e0342121. [ Google Scholar ] [ CrossRef ]
  • Li, D.; Li, R.; Ding, Z.; Ruan, X.; Luo, J.; Chen, J.; Zheng, J.; Tang, J. Discovery of a Novel Native Bacterium of Providencia sp. with High Biosorption and Oxidation Ability of Manganese for Bioleaching of Heavy Metal Contaminated Soils. Chemosphere 2020 , 241 , 125039. [ Google Scholar ] [ CrossRef ]
  • Liu, M.; Wang, S.; Yang, M.; Ning, X.; Nan, Z. Experimental Study on Treatment of Heavy Metal–Contaminated Soil by Manganese-Oxidizing Bacteria. Environ. Sci. Pollut. Res. 2022 , 29 , 5526–5540. [ Google Scholar ] [ CrossRef ] [ PubMed ]
  • Zhou, H.; Pan, H.; Xu, J.; Xu, W.; Liu, L. Acclimation of a Marine Microbial Consortium for Efficient Mn(II) Oxidation and Manganese Containing Particle Production. J. Hazard. Mater. 2016 , 304 , 434–440. [ Google Scholar ] [ CrossRef ] [ PubMed ]
  • He, Z.; Wei, Z.; Zhang, Q.; Zou, J.; Pan, X. Metal Oxyanion Removal from Wastewater Using Manganese-Oxidizing Aerobic Granular Sludge. Chemosphere. 2019 , 236 , 124353. [ Google Scholar ] [ CrossRef ] [ PubMed ]
  • Forrez, I.; Carballa, M.; Verbeken, K.; Vanhaecke, L.; Schluesener, M.; Ternes, T.; Boon, N.; Verstraete, W. Diclofenac Oxidation by Biogenic Manganese Oxides. Environ. Sci. Technol. 2010 , 44 , 3449–3454. [ Google Scholar ] [ CrossRef ]
  • Kim, S.S.; Bargar, J.R.; Nealson, K.H.; Flood, B.E.; Kirschvink, J.L.; Raub, T.D.; Tebo, B.M.; Villalobos, M. Searching for Biosignatures Using Electron Paramagnetic Resonance (EPR) Analysis of Manganese Oxides. Astrobiology. 2011 , 11 , 775–786. [ Google Scholar ] [ CrossRef ]

Click here to enlarge figure

RankCountryCountRankCountryCentrality
1China1971USA0.38
2USA1282China0.34
3Japan333Germany0.15
4Germany204Netherlands0.14
5India 185England0.09
6Canada116Japan0.04
7England107South Korea0.04
8France98Pakistan0.04
9Australia89Mexico0.04
10South Korea910France0.03
RankCountCentralityInstitutionCountry
1410.19Chinese Academy of ScienceChina
2280.06Harbin Institute of TechnologyChina
3270.23Oregon Health and Science UniversityUSA
4200.07Huazhong Agricultural UniversityChina
5140.00University of Chinese Academy of SciencesChina
6120.00Xi’an University of Architecture and TechnologyChina
790.05Hiroshima University Japan
880.04Woods Hole Oceanographic InstitutionUSA
980.03Smithsonian InstitutionUSA
1080.00Beijing University of TechnologyChina
RankCategoryCountRankCategoryCentrality
1Environmental Sciences & Ecology1511Environmental Sciences & Ecology0.41
2Environmental Sciences1222Chemistry0.41
3Engineering873Biotechnology & Applied Microbiology0.39
4Microbiology734Biochemistry & Molecular Biology0.34
5Engineering, Environmental725Environmental Sciences0.32
6Biotechnology & Applied Microbiology526Engineering0.18
7Water Resources397Chemistry0.18
8Geology328Microbiology0.15
9Geosciences289Agriculture0.14
10Biochemistry & Molecular
Biology
2510Toxicology0.09
RankTop Ten Productive AuthorCountRankTop Ten Co-Cited AuthorCitation
1Tebo BM221Tebo BM212
2Bai YH132Francis CA104
3Qu JH123Learman DR94
4Zhang J104Villalobos M89
5Pan XL95Geszvain K87
6Hansel CM86Dick GJ80
7Liu F87Webb SM79
8He ZF78Miyata N74
9Santelli CM79Anderson CR71
10Wei Z710Brouwers GJ69
RankCitationCited JournalIF JCRCountry
1301Applied and Environmental Microbiology4.32Q2USA
2232Environmental Science & Technology11.09Q1USA
3223Water Research12.75Q1England
4214Geochimica et Cosmochimica Acta4.97Q1USA
5205Geomicrobiology Journal2.30Q3USA
6188Journal of Bacteriology3.06Q3USA
7180Proceedings of the National Academy of Science of the United States of America10.71Q1USA
8168Annual Review of Earth and Planetary Sciences14.29Q1USA
9158Chemosphere8.80Q1England
10153PLoS One3.64Q2USA
TitleAuthorsYearCitation Frequency
Synergistic effects of biogenic manganese oxide and Mn(II)-oxidizing bacterium Pseudomonas putida strain MnB1 on the degradation of 17 α-ethinylestradiolTran TN et al. [ ]201830
A novel manganese oxidizing bacterium-Aeromonas hydrophila strain DS02: Mn(II) oxidization and biogenic Mn oxides generationZhang Y et al. [ ]201929
Elimination of Manganese(II,III) Oxidation in Pseudomonas Putida GB-1 by a Double Knockout of Two Putative Multicopper Oxidase GenesGeszvain K et al. [ ]201327
Mn(II, III) oxidation and MnO mineralization by an expressed bacterial multicopper oxidaseButterfield CN et al. [ ]201323
Diverse manganese(II)-oxidizing bacteria are prevalent in drinking water systemsMarcus DN et al. [ ]201722
Effective start-up biofiltration method for Fe, Mn, and ammonia removal and bacterial community analysisCai YN et al. [ ]201522
Extracellular haem peroxidases mediate Mn(II) oxidation in a marine Roseobacter bacterium via superoxide productionAndeer PF et al. [ ]201521
CotA, a multicopper oxidase from Bacillus pumilus WH4, exhibits manganese-oxidase activitySu JM et al. [ ]201321
Formation of manganese oxides by bacterially generated superoxideLearman DR et al. [ ] 201120
Identification of a third Mn(II) oxidase enzyme in Pseudomonas putida GB-1Geszvain K et al. [ ]201620
RankKeywordFrequencyCentrality
1Mn(II) oxidation1040.08
2oxidation920.16
3iron810.19
4identification650.10
5removal620.09
6multicopper oxidase610.04
7water420.06
8oxides420.07
9spores380.07
10mechanisms380.06
11manganese oxidation380.05
12biogenic manganese oxides340.09
13microbial community320.11
14bacteria320.08
15adsorption320.13
The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

Mo, W.; Wang, H.; Wang, J.; Wang, Y.; Liu, Y.; Luo, Y.; He, M.; Cheng, S.; Mei, H.; He, J.; et al. Advances in Research on Bacterial Oxidation of Mn(II): A Visualized Bibliometric Analysis Based on CiteSpace. Microorganisms 2024 , 12 , 1611. https://doi.org/10.3390/microorganisms12081611

Mo W, Wang H, Wang J, Wang Y, Liu Y, Luo Y, He M, Cheng S, Mei H, He J, et al. Advances in Research on Bacterial Oxidation of Mn(II): A Visualized Bibliometric Analysis Based on CiteSpace. Microorganisms . 2024; 12(8):1611. https://doi.org/10.3390/microorganisms12081611

Mo, Wentao, Hang Wang, Jianghan Wang, Yue Wang, Yunfei Liu, Yi Luo, Minghui He, Shuang Cheng, Huiting Mei, Jin He, and et al. 2024. "Advances in Research on Bacterial Oxidation of Mn(II): A Visualized Bibliometric Analysis Based on CiteSpace" Microorganisms 12, no. 8: 1611. https://doi.org/10.3390/microorganisms12081611

Article Metrics

Article access statistics, further information, mdpi initiatives, follow mdpi.

MDPI

Subscribe to receive issue release notifications and newsletters from MDPI journals

COMMENTS

  1. A critical period for second language acquisition: Evidence from 2/3 million English speakers

    A critical period for second language acquisition: Evidence from 2/3 million English speakers ... As inspection of the figures indicates, any such effect is inconsistent and small. 4.1.2. Test modality . ... On the issue of completeness in second language acquisition. Second Language Research. 1990; 6 (2):93-124. doi: 10.1177/026765839000600201.

  2. Language Acquisition Theory In Psychology

    Language acquisition refers to the process by which individuals learn and develop their native or second language. It involves the acquisition of grammar, vocabulary, and communication skills through exposure, interaction, and cognitive development. This process typically occurs in childhood but can continue throughout life.

  3. The social brain of language: grounding second language learning in

    The study of language learning focused on the individual might have had its origin in the tradition of generative linguistics 2,3, according to which linguistics as a science should study the ...

  4. Cognitive and behavioral approaches to language acquisition: Conceptual

    The past 20 years have seen research on language acquisition in the cognitive sciences grow immensely. The current paper offers a fairly extensive review of this literature, arguing that new cognitive theories and empirical data are perfectly consistent with core predictions a behavior analytic approach makes about language development. The review focuses on important examples of productive ...

  5. A review of theoretical perspectives on language learning and acquisition

    Abstract. This paper reviews three main theoretical perspectives on language learning and acquisition in an attempt to elucidate how people acquire their first language (L1) and learn their second language (L2). Behaviorist, Innatist and Interactionist offer different perspectives on language learning and acquisition which influence the ...

  6. PDF Understanding language acquisition: Neural theory of language

    3. Neural substrates of language acquisition. 3.1. Neural substrates of phonetic learning. Language acquisition research especially in infancy focuses mostly on phonetic perception. Phonetic perception at infancy refers to infants' perceiving vowels and consonant terms that build up a word.

  7. Early language acquisition: cracking the speech code

    Recent neuropsychological and brain imaging work indicates that language acquisition involves ... Further research will continue to explore which aspects of infants' language-processing skills are ...

  8. The acquisition of language by children

    The parsing process is therefore an essential component of the language comprehension device, because it allows children to assemble strings of elements in such a way as to compute crucial, and even novel, relational conceptions of the world. Adults are quite adept at parsing sentences to determine relational meaning.

  9. Language Acquisition and Brain Development

    Abstract. Language acquisition is one of the most fundamental human traits, and it is obviously the brain that undergoes the developmental changes. During the years of language acquisition, the brain not only stores linguistic information but also adapts to the grammatical regularities of language. Recent advances in functional neuroimaging ...

  10. Language Acquisition

    The research published in Language Acquisition makes a clear contribution to linguistic theory by increasing our understanding of how language is acquired. The journal focuses on the acquisition of syntax, semantics, phonology, and morphology, and considers theoretical, experimental, and computational perspectives. ...

  11. How diverse is child language acquisition research?

    Abstract. A comprehensive theory of child language acquisition requires an evidential base that is representative of the typological diversity present in the world's 7000 or so languages. However, languages are dying at an alarming rate, and the next 50 years represents the last chance we have to document acquisition in many of them.

  12. (PDF) Second Language Acquisition: A Framework and Historical

    2.1 Second Language Acquisition Research dur ing the 1950s and 1960s. As stated above, the area of SLA did not initiate as a sepa rate area of study with its distinctiveness but as an. addition to ...

  13. Language acquisition

    t. e. Language acquisition is the process by which humans acquire the capacity to perceive and comprehend language. In other words, it is how human beings gain the ability to be aware of language, to understand it, and to produce and use words and sentences to communicate. Language acquisition involves structures, rules, and representation.

  14. Cognitive Neuroscience Perspectives on Language Acquisition and

    Since individual differences (for example, the age of acquisition of a particular word/structure) are not always included as a factor/controlled for, Mkrtychian and colleagues (contribution 9) focused on both the behavioral and neural (EEG) aspects of the acquisition and processing of concrete and abstract words while tightly controlling for ...

  15. The Littlest Linguists: New Research on Language Development

    Specifically, caregivers' language is often fine-tuned to children's current linguistic knowledge and vocabulary, providing an optimal level of complexity to support language learning. In their new research, Leung and colleagues add to the body of knowledge involving how caregivers foster children's language acquisition.

  16. Pre-eminence of determining factors in second language learning: An

    1.1. Factors impacting on second language learning and their connection to the learning process. Scientific evidence clearly shows the heterogeneity of factors that condition the acquisition of a second language and its relationship with the learning and teaching process (Atkinson et al., 2018; Chen et al., 2020; Dewaele and Dewaele, 2018; Saville-Troike and Barto, 2016).

  17. Ch. 5 Flashcards

    Research on language acquisition indicates that. a. the right hemisphere of the brain is biased for language processing. b. sing language can be learned equally well at any age. c. language learning is optimal after brain lateralization has occurred. d. childhood is a sensitive period for language acquisition.

  18. The Critical Period Hypothesis in Second Language Acquisition: A ...

    In second language acquisition research, the critical period hypothesis (cph) holds that the function between learners' age and their susceptibility to second language input is non-linear. This paper revisits the indistinctness found in the literature with regard to this hypothesis's scope and predictions. Even when its scope is clearly delineated and its predictions are spelt out, however ...

  19. PDF Language Acquisition

    The most ambitious attempts to synthesize large amounts of data on language development into a cohesive framework are Brown (1973), Pinker (1984), and Slobin (1985b). Clark (1993) reviews the acquisition of words. Locke (1993) covers the earliest stages of acquisition, with a focus on speech input and output.

  20. Understanding language acquisition: Neural theory of language

    Acceptance Date: 06/05/2021. Abstract. This paper aims to discuss old and contemporary perspectives in understanding language acq uisition taking into. account the n eural th eory of languag e ...

  21. PDF LANGUAGE ACQUISITION AND LANGUAGE LEARNING

    Language acquisition is based on the neuro-psychological processes (Maslo, 2007: 41). Language acquistion is opposed to learning and is a subconscious process similar to that by which children acquire their first language (Kramina, 2000: 27). Hence, language acquisition is an integral part of the unity of all language (Robbins, 2007: 49).

  22. Chapter 5 Quiz Flashcards

    Research on language acquisition indicates that. childhood is a sensitive period for language acquisition. Compared with referential children, toddlers who use an expressive style. produce many more social formulas and pronouns. Miranda says "more apple." This two-word utterance is an example of.

  23. Love, Language, and Learning: The Role of Relationships in Developing

    Research indicates that the frequency and quality of interactions between caregivers and young children directly correlate with the children's language acquisition and literacy skills. ... Recent findings from a 2024 study published in Early Childhood Research Quarterly revealed that when caregivers used culturally relevant materials and ...

  24. A Review of Research on Technology-Supported Language Learning and 21st

    According to Figure 8 (and Appendix 1 ), researchers pointed out that technology-supported language learning can also promote 21st century skills. These skills relate to the following three categories: 4C (communication, collaboration, critical thinking, and creativity), digital literacy, and career and life skills.

  25. Ambidextrous Learning, Resource Acquisition, and Venture Performance

    In addition, the entrepreneurial ecosystem (EE) is a meaningful entrepreneurial context that cannot be ignored in ambidextrous learning. However, existing EE literature mainly focuses on macro-level research, such as the element composition, evolution, development (E. Stam & Van de Ven, 2021; Wurth et al., 2022), and governance of EE, which weakens the connection between new ventures and EEs ...

  26. Safety and Risk Assessment of No-Prescription Online Semaglutide

    FIP indicates International Pharmaceutical Federation. Table. Online Vendor Characteristics and Semaglutide Products Offered Online ... FDA Center for Drug Evaluation and Research. Warning letter: www.semaspace.com—MARCS-CMS 665848. October 2, 2023. Accessed July 3, 2024. ... Acquisition, analysis, or interpretation of data: All authors.

  27. Advances in Research on Bacterial Oxidation of Mn(II): A Visualized

    Manganese (Mn) pollution poses a serious threat to the health of animals, plants, and humans. The microbial-mediated Mn(II) removal method has received widespread attention because of its rapid growth, high efficiency, and economy. Mn(II)-oxidizing bacteria can oxidize toxic soluble Mn(II) into non-toxic Mn(III/IV) oxides, which can further participate in the transformation of other heavy ...

  28. S. Rept. 118-207

    s. rept. 118-207 - departments of labor, health and human services, and education, and related agencies appropriation bill, 2025 118th congress (2023-2024)