šŸ§  The Real Effect of Duolingo

Over 8 million learners have achieved a 365-day streak or more. Yet, its design choices spark debate about effectiveness versus engagement.

TL;DR: Gamification motivates learners through streaks, leaderboards, and rewardsā€”but we need to prioritise learning outcomes over engagement to achieve deep, meaningful learning.

Who is this relevant for? Professionals in Education, Sustainability, Strategy, Marketing, Finance, Design, Policy, Health and Technologyā€”anyone aiming to apply gamification for higher engagement.

šŸŽ“ Researchers

  • Mitchell Shortt, Ohio State University

  • Shantanu Tilak, Ohio State University

  • Irina Kuznetcova, Ohio State University

  • Bethany Martens, Ohio State University

  • Babatunde Akinkuolie, Ohio State University

šŸ“š The Evidence

A systematic review of studies (2012ā€“2020) highlighted Duolingoā€™s gamified approach as both a motivator and a limitation. The review identified that while the app boosts initial engagement and helps users build basic skills like vocabulary, it struggles with enabling advanced language skills or practical application.

Citation: Shortt, M. et al. (2023). Gamification in mobile-assisted language learning: A systematic review of Duolingo literature. Computer Assisted Language Learning, 36(3), 517ā€“554.

šŸ“Š Key Results

  • Gamification elements like streaks and leaderboards were highly motivating, with 85% of surveyed users citing these features as reasons to continue using the appā€‹.

  • Heavy reliance on repetitive exercises and translation drills limited development of speaking and writing skills. Studies revealed that only 35% of users felt confident applying their language skills in real-world scenarios after completing lessonsā€‹.

  • While 70% of participants appreciated Duolingoā€™s feedback on mistakes, many noted the lack of depth in grammatical explanations, limiting its usefulness for advanced learnersā€‹.

šŸ‘‰šŸ¾ Vishalā€™s Evidence-Based Strategy

1ļøāƒ£ Balancing Gamification & Connection

Combine short, game-like drills with activities that promote real-world connections, such as, conversation with a language buddy to support deep learning.

2ļøāƒ£ Flexible Learning Streaks

Allow occasional streak breaks without penalty to reduce stress and sustain motivation. Drawing inspiration from the "emergency reserves" research, Duolingo has adopted ā€˜Streak Repairā€™ and ā€˜Streak Freezeā€™ features so that learners maintain engagement.

3ļøāƒ£ Personalised Learning Outcomes

Create more personal learning outcomes, such as, facilitating deeper emotional conversations for romantic partners speaking different first languagesā€”designed to better align language lessons with learnersā€™ motivations.

šŸ§Ŗ Footnote

Evidence evolves over time and will NOT work across all contextsā€”start with a small experiment to find out what works for your specific challenge and audience. Try our FREE Behavioural by Design toolkit to start your own behavioural science project.

ā

ā€œOne of the greatest pleasures games offer is a certain existential balmā€”a momentary shelter from the existential complexities of ordinary life. In a game, for once in my life, I know exactly what it is that Iā€™m supposed to be doing.ā€

C. Thi Nguyen, Games: Agency As Art