Methodological gaps and domain imbalances in flipped learning reviews: A critical umbrella review
INTERNATIONAL JOURNAL OF ASSESSMENT TOOLS IN EDUCATION, vol.13, no.1, pp.21-44, 2026 (ESCI, TRDizin)
- Publication Type: Article / Review
- Volume: 13 Issue: 1
- Publication Date: 2026
- Doi Number: 10.21449/ijate.1692300
- Journal Name: INTERNATIONAL JOURNAL OF ASSESSMENT TOOLS IN EDUCATION
- Journal Indexes: Emerging Sources Citation Index (ESCI), Central & Eastern European Academic Source (CEEAS), Education Abstracts, ERIC (Education Resources Information Center), Directory of Open Access Journals, TR DİZİN (ULAKBİM)
- Page Numbers: pp.21-44
- Open Archive Collection: AVESIS Open Access Collection
- Akdeniz University Affiliated: Yes
Abstract
This critical umbrella review (UR) examined methodological rigor and outcome assessment practices in flipped learning (FL) research syntheses. A systematic analysis of 41 reviews (2017-2023) spanning STEM, medical/health sciences, and social sciences identified significant methodological concerns and domain imbalances in reported outcomes. The analysis revealed widespread inconsistencies in primary source selection, with most reviews excluding grey literature. Inadequate quality assessment practices were evident, with over half lacking formal risk of bias evaluation. The analysis also found variable approaches to publication bias assessment and potential language bias, with most reviews limiting inclusion to English-language publications. The analysis further reveals a pronounced imbalance in outcome domains. Cognitive outcomes dominated, particularly academic achievement. The affective and interpersonal domains received substantially less attention despite their theoretical importance to FL pedagogy. The paucity of specified cognitive metrics in numerous reviews was a matter of particular concern, whilst the near absence of metric reporting for affective and interpersonal outcomes was even more concerning. In addition, the psychometric properties of instruments were rarely critically evaluated. Although reviews consistently identified active learning, self-paced instruction, and increased interaction as key mechanisms for FL effectiveness, many failed to provide substantive exploration of how these mechanisms operate within specific disciplinary contexts. This critical synthesis highlights the need for methodological improvements in FL reviews, including comprehensive literature sourcing, rigorous quality assessment, expanded domain focus beyond cognitive outcomes, and deeper mechanism exploration to strengthen the evidence base guiding educational practice.