Validation of Meta-Synthesis Research with Emphasis on the ConQual Validation Method

Document Type : علمی - پژوهشی

Authors

1 Ph.D. in Information Technology Management, University of Tehran, Tehran, Iran

2 Assistant Professor, Department of Management, Faculty of Economics and Administrative Sciences, University of Qom, Qom, Iran

3 Associate Professor, Department of Management, Faculty of Management, University of Tehran, Tehran, Iran

Abstract

Extended Abstract
 
Introduction and Objectives: In recent years, qualitative research has witnessed remarkable growth and increasing recognition among researchers across various disciplines, particularly within the humanities and social sciences. Alongside this growing interest, significant critiques and concerns have also emerged regarding the procedures, reliability, and credibility of qualitative methods. While validity and reliability have long held central importance in quantitative research, they are equally critical—albeit more challenging—to establish in qualitative inquiry.
Given that qualitative research typically provides deeper, more meaningful insights than quantitative approaches, it inherently possesses greater potential to gain the trust of its audience. This makes the evaluation of qualitative research validity all the more essential. The present study aims to design a systematic and process-oriented model for evaluating the validity and reliability of qualitative research—referred to as the ConQual (Confidence in Qualitative Research) method.
ConQual operates through a clear, structured framework beginning with a series of guiding questions used to assess the rigor of a qualitative study. The more precisely and comprehensively a study answers these questions, the higher its validity and reliability are considered to be. To demonstrate the practical implementation of this approach, the ConQual process was applied step-by-step to one form of meta-synthesis—meta-ethnography—thus allowing readers to better understand the operational logic of the ConQual method.
Methodology: This study is grounded in the interpretivist paradigm, which views social phenomena as contextually situated and meaningful. Within this paradigm, the researcher seeks to understand and interpret meaningful social actions rather than to explain them through causal generalizations.
The logic of this research is inductive, as it aims to infer a framework, pattern, or conceptual model from existing data. It follows a fundamental research orientation, seeking to generate a new evaluative model rather than to apply an existing one. The research is qualitative in nature, focusing on the understanding and interpretation of phenomena and their associated meanings.
It employs a library-based approach, utilizing documented and credible sources—books, articles, and research reports. The purpose of this study is explanatory, aiming to identify and clarify the interrelations among the components of qualitative validation. Accordingly, its main strategy is documentary analysis, meaning that research data are derived from written and archival materials. The researchers prioritized consulting primary and recent sources to accurately delineate and operationalize the ConQual process, which was then demonstrated through its application in meta-ethnographic research.
Results: ConQual provides a systematic framework for examining the factors that enhance or diminish the credibility of qualitative findings. Among the four key criteria commonly used to assess trustworthiness in qualitative research—dependability, transferability, credibility, and confirmability—this study focuses primarily on dependability and credibility.
The evaluation process begins with a pre-ranking stage, classifying qualitative studies into four levels of rigor: strong, moderate, weak, and very weak. Studies demonstrating coherent design and methodological transparency are ranked higher, whereas those presenting only ideas or narratives without methodological grounding are placed in lower categories.
After this preliminary classification, each study is assessed for dependability and credibility. Dependability is determined through a checklist of guiding questions examining the logical coherence between research objectives, processes, and results. Credibility, in the ConQual method, is evaluated by identifying the proportion of qualitative findings that fall within three interpretive levels: explicit, ambiguous, and unsupported.
This process allows for an objective, stepwise appraisal of qualitative research trustworthiness, thereby introducing a replicable method for evaluating qualitative evidence.
Discussion and Conclusion: The findings of this study underscore several key insights. First, there is a fundamental distinction between quantitative and qualitative research paradigms. Quantitative studies can often be evaluated using standardized techniques and computational methods with minimal researcher involvement. In contrast, qualitative research inherently relies on the deep engagement of the researcher with the phenomenon under study—its strength derives precisely from this involvement.
Thus, qualitative inquiry should not be assessed merely through observable structures, metrics, or positivist criteria. The study highlights that the selection of appropriate validation tools in qualitative research—based on the nature of the data and research questions—can significantly enhance both the rigor and comprehensibility of findings, facilitating more effective implementation in practice.
In quantitative research, validity and reliability are well-defined strengths; however, in qualitative research, they have often been perceived as areas of ambiguity and weakness. The present study seeks to address this gap by introducing a clear and structured validation process—ConQual—which offers a coherent approach for assessing and enhancing the credibility of qualitative studies.
By systematizing the evaluation of qualitative findings, the ConQual method contributes to strengthening methodological transparency, fostering trust in qualitative research outcomes, and promoting a more balanced integration of qualitative approaches within the broader scientific community.

Keywords


اسکندری، علی؛ مانیان، امیر؛ سلطانی، مرتضی و یزدانی، حمیدرضا . (1403). ارائه فرامدل خط‌مشی‌گذاری توسعه هوش مصنوعی در صنعت فینتک. مطالعات مدیریت دولتی ایران، 7(3)، 1-49. doi: 10.22034/jipas.2024.440482.1691
اسلامی، روح‏الله و ذکایی، محمدسعید . (1400). اعتباریابی در پژوهش کیفی: تطبیق گونه‏ شناسی‏های دینداری در ایران با گفتمان‏های اربعین. دوفصلنامه علمی پژوهشی دین و سیاست فرهنگی، 8(2)، 33-60.
اکبری، مرتضی. (1397). اعتبارسنجی و سنجش کیفیت در پژوهش‌های کمّی، کیفی و آمیخته. روش شناسی علوم انسانی، 24(94)، 23-45. doi: 10.30471/mssh.2018.1448
پرهوده، فرزاد ؛ عرفانی، نصراله و پرهوده، فریاد . (1401). تأملی بر رویکرد پژوهش کیفی با تأکید بر روایی و پایایی. پویش در آموزش علوم انسانی، 8(28)، 19-44.
رضاپورنصرآباد، رفعت. (1396). معیارهای اعتبار و پایایی در پژوهش‏های کیفی. تحقیقات کیفی در علوم سلامت، 6(4 )، 493-499. SID. https://sid.ir/paper/215481/fa
عباس‏زاده، محمد و عباس‏زاده، محمد . (1391). تأملی بر اعتبار و پایایی در تحقیقات کیفی. جامعه‏شناسی کاربردی، 23(1)، 19-34.
عباسی، عباس؛ محمدی، لیلا و محمدی، خدیجه . (1403). روایی و پایایی در تحقیقات کیفی: مرور نظام‏مند. پژوهشنامه پردازش و مدیریت اطلاعات، 40(2)، 375-412. doi: 10.22034/jipm.2024.717062
References
abbasi, A., Mohammadi, L. and mohammadi, K. (2024). Validity and Reliability in Qualitative Research: A Systematic Review. Iranian Journal of Information Processing and Management, 40(2), 375-412. doi: 10.22034/jipm.2024.717062. [In Persian].
Abbaszadeh, M. and Abbaszadeh, M. (2012). Validity and reliability in qualitative researches. Journal of Applied Sociology, 23(1), 19-34. [In Persian].
Ahmed, Sirwan. (2024). The pillars of trustworthiness in qualitative research. Journal of Medicine Surgery and Public Health. 2. 100051. 10.1016/j.glmedi.2024.100051.
Akbari, M. (2018). Validation and Quality Assessment in QUAN, QUAL, and Mixed Method Research. Methodology of Social Sciences and Humanities, 24(94), 23-45. doi: 10.30471/mssh.2018.1448. [In Persian].
Bang, Truong. (2024). Ensuring Credibility and Trustworthiness in Qualitative Inquiries. In applied linguistics and language education research methods: Fundamentals and innovations (pp. 70-85). IGI Global.10.4018/979-8-3693-2603-9.ch006.
Bhardwaj, Rohit & Srivastava, Saurabh. (2024). Dynamic Capabilities of Social Enterprises: A Qualitative Meta-Synthesis and Future Agenda. Journal of Social Entrepreneurship. 15. 1-29. 10.1080/19420676.2021.1972030.
Chrastina, J. (2018). Meta-Synthesis of Qualitative Studies: Background, Methodology and Applications. NORDSCI. 10.32008/NORDSCI2018/B1/V1/13.
Creswell, J. W., & Miller, D. L. (2000). Determining validity in qualitative inquiry. Theory into practice, 39(3), 124-130.
Eskandari, A. , Manian, A. , Soltani, M. and Yazdani, H. (2024). A Framework for AI Policy Development in the Fintech Industry. Journal of Iranian Public Administration Studies, 7(3), 1-49. doi: 10.22034/jipas.2024.440482.1691. [In Persian].
Finfgeld_Connett, D. (2018). A Guide to Qualitative Meta_Synthesis (1st ed.). New York, NY: Routledge.
Frankel, K. K., Brooks, M. D., & Learned, J. E. (2025). Teachers’ perspectives on the structure of reading intervention classes in secondary schools: A meta-synthesis of qualitative research. Teaching and Teacher Education, 162, 105029. Doi: 10.1177/01614681211048624.
Golafshani, N. (2015). Understanding Reliability and Validity in Qualitative Research. The Qualitative Report, from http://dx.doi.org/10.46743/2160_3715/2003.1870.
Gunawan, J. (2015). Ensuring trustworthiness in qualitative research. Belitung Nursing Journal, 1(1), 10-11. https://doi.org/10.33546/bnj.4.
Haq, Z. U., Rasheed, R., Rashid, A., & Akhter, S. (2023). Criteria for assessing and ensuring the trustworthiness in qualitative research. International Journal of Business Reflections, 4(2). https://doi.org/10.56249/ijbr.03.01.44.
Humphreys, L., N. A. Lewis Jr, K. Sender, & A. S. Won. 2021. Integrating qualitative methods and open science: Five principles for more trustworthy research. Journal of Communication 71 (5): 855-874.
Islami, Ruhollah and Zakaei, Mohammad Saeed. (1400). Validation in qualitative research: matching typologies of religiosity in Iran with Arbaeen discourses. Journal of Religion and Cultural Policy, 8(2), 33-60. https://www.jrcp.ir/article_146856.html. [In Persian].
Joanna Briggs Institute. (2014). Joanna Briggs Institute reviewers’ manual: 2014 edition. Australia: The Joanna Briggs Institute, 88-91.
Khoeini, S., Noruzi, A., Naghshineh, N., & Sheikhshoaei, F. (2024). Developing a model of digital transformation of university libraries based on meta-synthesis. The electronic library, 42(4), 681-699. 42. 681-699. 10.1108/EL-02-2024-0046.
Lincoln, Y. S., & Guba, E. G. (1985). Naturalistic Inquiry; Sage Publications: Newbury Park.‏
Mirchi, S., Vedadi, A., & Gholamzadeh, D. (2024). Applying a Meta-synthesis Approach to Present a Blended Learning Model for Talent Development. J Med Educ, 22(1). https://doi.org/10.5812/jme-142760.
Munn, Z., Porritt, K., Lockwood, C., Aromataris, E., & Pearson, A. (2014). Establishing confidence in the output of qualitative research synthesis: The ConQual approach. BMC medical research methodology, 14, 108. DOI: 10.1186/1471-2288-14-108.
Noblit, G. W., & Hare, R. D. (1988). Meta-ethnography: Synthesizing qualitative studies:Vol. 11. Qualitative research methods. Newbury Park, CA: Sag
parhoodeh, F. , erfani, N. and parhoodeh, F. (2022). A reflection on the qualitative research approach with emphasis on validity and reliability. Pouyesh in Humanities Education, 8(28), 19-44. [In Persian].
Patton, M. Q. (2014). Qualitative research & evaluation methods: Integrating theory and practice. Sage publications.
Pawson, R. (2006). Evidence-based policy: a realist perspective. Sage Publications
Pearson, A., Robertson_Malt, S., & Rittenmeyer, L. (2011). Synthesizing Qualitative Evidence: Lippincott Williams & Wilkins; Australia.
Rezapour Nasrabad, R. (2018). Criteria of Validity and Reliability in Qualitative Research. Journal of Qualitative Research in Health Sciences, 7(4), 493-499. [In Persian].
Sandelowski, M., & Leeman, J. (2012). Writing usable qualitative health research findings. Qualitative Health Research, 22(10), 1404–1413.  DOI: 10.1177/1049732312450368.
Sandelowski, M., Barroso, J., & Voils, C. I. (2007). Using qualitative metasummary to synthesize qualitative and quantitative descriptive findings. Research in nursing & health, 30(1), 99-111. doi: 10.1002/nur.20176.
Sere, Y., Roman, N. V., & Ruiter, R. A. C. (2021). Coping with the Experiences of Intimate Partner Violence Among South African Women: Systematic Review and Meta_Synthesis. Frontiers in psychiatry, 12, 655130. doi: 10.3389/fpsyt.2021.655130. DOI: 10.3389/fpsyt.2021.655130.
Tong, A., Flemming, K., McInnes, E., Oliver, S., & Craig, J. (2012). Enhancing transparency in reporting the synthesis of qualitative research: ENTREQ. BMC medical research methodology, 12, 1-8. DOI: 10.1186/1471-2288-12-181.
Walsh, D., & Downe, S. (2005). Meta‐synthesis method for qualitative research: a literature review. Journal of advanced nursing, 50(2), 204-211. DOI: 10.1111/j.1365-2648.2005.03380.x
Willig, C., & Wirth, L. (2018). A meta-synthesis of studies of patients’ experience of living with terminal cancer. Health Psychology, 37(3), 228. DOI: 10.1037/hea0000581.