Beyond a Meta-Analysis: Applications of Meta-Meta-Analysis in the Behavioral Sciences

Document Type : Promotional scientific article

Authors

1 Alzahra University, Master’s Student, Tehran, Iran

2 University of Isfahan, PhD Candidate, Isfahan, Iran

3 Professor, Department of Psychology and Education of People with Special Needs, University of Isfahan, Isfahan, Iran

Abstract

Extended Abstract
 
Introduction and Objectives: The contemporary age must be conceived as an age of complexities that continuously disclose new domains and dimensions. It is, precisely, an age in which the limits of enclosure are laid bare. These terminal boundaries of enclosure, however, become intelligible only through a careful apprehension of their manifest and latent linkages with non-teleological foundations. Such foundations confront the closure of this essence and its bounds in a manner that instantiates a fundamental duality: these foundations which used to define the essence as “the Other” in a context which continually reproduced “the Other,” are now re-defined as the origins of the relations that, in the contemporary configuration, have become determinative and that circumscribe human agency in ways that are without close precedent. Accordingly, the emergence and consolidation of an epistemic domain capable of answering these new epistemic exigencies becomes imperative. Since sociology occupies the epistemic fulcrum among disciplines whose vocation is the epistemic adaptation to socially complex conditions, and since sociology, if it is to assume a role that cannot be fulfilled except “through” another field of knowledge, requires a disciplinary “threshold”, this paper advances “the continental philosophy of sociology” as such an intervening agent. This agent, first, renders possible the preparation of scientific communities for the explication and clarification of the epistemic transformation that the contemporary age makes unavoidable; and second, it brings the epistemic structure of sociology into a fundamental reflexivity that can only be properly understood in relation to what we have called an “immanent transcendence”.
Methodology: Accordingly, this study approaches a distinct epistemic domain known as the continental philosophy of sociology as a mediating “agent” that brings the boundaries of the enclosure into focal view due to its epistemic functions. To this end, the present research adopts a distinctly “ideal-type methodology”. It aims to generate a novel conceptual formulation that answers the epistemic demands placed upon sociology when confronting the complexities of our “complex” age. This is accomplished by analytically disentangling the constitutive elements that render the present epoch distinctive, both in terms of its overarching ontological totality and the hierarchical organization of its constituent parts, and reconceiving them through ideal types that embody sociology’s epistemic requisites. Each constitutive element, considered at general and at particular levels, is thereby rendered as an ideal type that justifies, by its very logic, the necessity of that “type”. Indeed, what resolves, or places on the path toward resolving, the problem of sociology’s entry into the interwoven domains of indeterminacy is nothing other than the provision of an ideal type for the variegated social world as a whole and for each of its core and peripheral components. The gravitational points that render salient the linkages among these “types” must be situated with respect to certain nodal points that highlight the commonalities among the ideal types and that constitute the theoretical prerequisites for approaching and engaging the said world. The present article pursues this trajectory in such a manner that these gravitational and nodal points disclose the thresholds of closure.
Results: From this standpoint, the epistemic constraints that inhere in efforts to apprehend the modern epoch can only be transcended through the recognition and articulation of these gravitational and nodal points. Sociology’s intrinsic epistemic limitations mean that it cannot, unaided, mount the radical theoretical interventions required to address the perplexities of contemporary complexity; it therefore needs recourse to a mediating domain whose vital function is precisely to provide that point of entry. The paper demonstrates that understanding both the totality and the discrete constituents of the intervening discipline becomes possible only through the disclosure of an affirmative necessity embedded in the specific functions of this discipline. Consequently, this paper foregrounds the said epistemic branch not merely because it furnishes a robust theoretical perspective for a domain of scholarship charged with addressing the pressing problems of contemporary complex societies, but also because it is itself the very theoretical insight under consideration. Thus, we are confronted with an epistemic branch that, in addition to providing a stable foundation for sociology and simultaneously affirming its own foundationality, not only articulates its theoretical novelties and innovations on the basis of the “omnipresence” of the essential and through constant reference to this very domain, but also advances its exegetical and conceptual elaborations in order to sustain and consolidate the foundational logic according to which any movement toward the exteriority of the inner realm is realized precisely through continual reference back to that very realm.
Discussion and Conclusion: Hence, insofar as sociology is intrinsically bound to the vexed, contingent realities of lived social existence ــــ realities that can be grasped only by attending to their immanent complexities ـــ the discipline requires a philosophical domain that secures its adaptability to novel epistemic imperatives. The philosophy of sociology fulfills this role by (a) articulating and elaborating those specific epistemic functions that distinguish it from parallel domains such as the philosophy of the social sciences and social philosophy and hence clarifying on a theoretical plane that the expansive boundaries of contemporary society and its profound entanglement with the twin principles of “diversity” and “plurality” serve as immediate indicators of the indispensability of its role; (b) revealing that the limits and boundaries of the society under consideration are indeterminate, indistinct, and unstable, and by foregrounding that the aforementioned diversity and plurality can only be apprehended through direct recourse to the principle of “regularity in dispersion”, the essay substantiates the vital cleavage between the “Continental” and the “Analytic” modes of inquiry and aligns the former with an epistemic terrain devoid of certitude and saturated with aporia, a terrain in which ontological discontinuities are exposed and articulated within the unfolding of historical time; and (c) establishing that, in consonance with a society structured by complexity, this epistemic domain constitutes, intrinsically, a substantive theoretical insight: it does not merely enable the production of “social knowledge” about particular problems, but primarily fashions the foundational principles whose appropriation is indispensable for grasping the constitutive structures of the social whole and rendering possible the acquisition of “societal knowledge”.
Acknowledgement: The authors gratefully acknowledge the anonymous reviewers for their helpful comments.
Conflict of Interests: The authors declare that they have no conflicts of interests.

Keywords


منابع
Afonso, J., Ramirez-Campillo, R., Clemente, F. M., Büttner, F. C., & Andrade, R. (2024). The perils of misinterpreting and misusing “publication bias” in meta-analyses: An education review on funnel plot-based methods. Sports medicine, 54(2), 257-269. https://doi.org/10.1007/s40279-023-01927-9
Brooke, B. S., Schwartz, T. A., & Pawlik, T. M. (2021). MOOSE reporting guidelines for meta-analyses of observational studies. JAMA surgery, 156(8), 787-788. https://doi.org/10.1001/jamasurg.2021.0522
Carr, A., Finneran, L., Boyd, C., Shirey, C., Canning, C., Stafford, O.,... & Burke, T. (2024). The evidence-base for positive psychology interventions: a mega-analysis of meta-analyses. The Journal of Positive Psychology, 19(2), 191-205. https://doi.org/10.1080/17439760.2023.2168564
Cleophas, J. T., & Zwinderman, H. A. (2017). Modern meta-analysis: Review and update of methodologies. Springer International Publishing Switzerland. https://doi.org/10.1007/978-3-319-55895-0
Gharoun, H., Momenifar, F., Chen, F., & Gandomi, A. (2023). Meta-learning approaches for few-shot learning: A survey of recent advances. ACM Computing Surveys.‏ https://doi.org/10.48550/arXiv.2303.07502
Glass, G. V. (1976). Primary, secondary, and meta-analysis of research. Educational Researcher, 5(10), 3-8.https://doi.org/10.2307/1174772
Hackenberger, B. K. (2020). Bayesian meta-analysis now–let’s do it. Croatian Medical Journal, 61(6), 564. https://doi.org/10.3325/cmj.2020.61.564
Hedges, L. V., Olkin, I. (1985). Statistical Methods for Meta-Analysis. United Kingdom: Elsevier Science. https://doi.org/10.1016/C2009-0-03396-0
Higgins, J. P., Altman, D. G., Gøtzsche, P. C., Jüni, P., Moher, D., Oxman, A. D.,... & Sterne, J. A. (2011). The Cochrane Collaboration’s tool for assessing risk of bias in randomised trials. Bmj, 343. https://doi.org/10.1136/bmj.d5928
Kazrin, A., Durac, J., & Agteros, T. (1979). Meta–meta analysis: A new method for evaluating therapy outcome. Behaviour Research and Therapy. https://doi.org/10.1016/0005-7967(79)90011-1
Khoee, A. G., Yu, Y., & Feldt, R. (2024). Domain Generalization through Meta-Learning: A Survey. arXiv preprint arXiv:2404.02785.‏ https://doi.org/10.48550/arXiv.2404.02785
Leclercq V., Beaudart C., Ajamieh S., Rabenda V., Tirelli E., Bruyère O. (2019). Meta-analyses indexed in PsycINFO had a better completeness of reporting when they mention PRISMA. J Clin Epidemiol, 115, 46- 54. https://doi.org/10.1016/j.jclinepi.2019.06.014
Light, R. J., & Pillemer, D. B. (1984). Summing up: The science of reviewing research. Harvard University Press. https://doi.org/10.2307/j.ctvk12px9
Moher, D., Liberati, A., Tetzlaff, J., Altman, D.G., (2009). PRISMA Group. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. Ann Intern Med, 151, 264-9, W64. https://doi.org/10.1371/journal.pmed.1000097
Page, M. J., McKenzie, J. E., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D.,... & Moher, D. (2021). The PRISMA 2020 statement: an updated guideline for reporting systematic reviews. bmj, 372. https://doi.org/10.1136/bmj.n71.
Page, M. J., & Moher, D. (2017). Evaluations of the uptake and impact of the Preferred Reporting Items for Systematic reviews and Meta-Analyses (PRISMA) Statement and extensions: a scoping review. Systematic reviews, 6, 1-14. https://doi.org/10.1186/s13643-017-0663-8.
Paul, J., & Barari, M. (2022). Meta-analysis and traditional systematic literature reviews—What, why, when, where, and how? Psychology & Marketing, 39(6), 1099-1115.http://dx.doi.org/10.1177/2167696815617076.
Pollock, M., Fernandes, R. M., Pieper, D., Tricco, A. C., Gates, M., Gates, A., & Hartling, L. (2019). Preferred Reporting Items for Overviews of Reviews (PRIOR): a protocol for development of a reporting guideline for overviews of reviews of healthcare interventions. Systematic reviews, 8, 1-9. https://doi.org/10.1136/bmj-2022-070849.
Reis, D. J., Kaizer, A. M., Kinney, A. R., Bahraini, N. H., Holliday, R., Forster, J. E., & Brenner, L. A. (2023). A practical guide to random-effects Bayesian meta-analyses with application to the psychological trauma and suicide literature. Psychological trauma: theory, research, practice, and policy, 15(1), 121. https://doi.org/10.1037/tra0001316.
Rosenberger, K. J., Xing, A., Murad, M. H., Chu, H., & Lin, L. (2021). Prior choices of between-study heterogeneity in contemporary Bayesian network meta-analyses: an empirical study. Journal of general internal medicine, 36(4), 1049-1057. https://doi.org/10.1007/s11606-020-06357-1
Rebar, A. L., Stanton, R., Geard, D., Short, C., Duncan, M. J., & Vandelanotte, C. (2015). A meta-meta-analysis of the effect of physical activity on depression and anxiety in non-clinical adult populations. Health psychology review, 9(3), 366-378. https://doi.org/10.1080/17437199.2015.1022901.
Röver, C., Bender, R., Dias, S., Schmid, C. H., Schmidli, H., Sturtz, S.,... & Friede, T. (2020). On weakly informative prior distributions for the heterogeneity parameter in Bayesian random-effects meta-analysis. Research Synthesis Methods, 12(4), 448-474. https://doi.org/10.1002/jrsm.1475
Sterne, J. A., Savović, J., Page, M. J., Elbers, R. G., Blencowe, N. S., Boutron, I.,... & Higgins, J. P. (2019). RoB 2: a revised tool for assessing risk of bias in randomised trials. bmj, 366. https://doi.org/10.1136/bmj.l4898
https://psycnet.apa.org/doi/10.1093/med/9780199685219.001.0001
Shea, B. J., Reeves, B. C., Wells, G., Thuku, M., Hamel, C., Moran, J.,... & Henry, D. A. (2017). AMSTAR 2: a critical appraisal tool for systematic reviews that include randomised or non-randomised studies of healthcare interventions, or both. bmj, 358. https://doi.org/10.1136/bmj.j4008
External validation of a measurement tool to assess systematic reviews (AMSTAR). PloS one, 2(12), e1350. https://doi.org/10.1371/journal.pone.0001350
Turner, R. M., Davey, J., Clarke, M. J., Thompson, S. G., & Higgins, J. P. (2012). Predicting the extent of heterogeneity in meta-analysis, using empirical data from the Cochrane Database of Systematic Reviews. International journal of epidemiology, 41(3), 818-827. https://doi.org/10.1093/ije/dys041
Van Aert, R. C., Wicherts, J. M., & Van Assen, M. A. (2019). Publication bias examined in meta-analyses from psychology and medicine: A meta-meta-analysis. PloS one, 14(4), e0215052. https://doi.org/10.1371/journal.pone.0215052.
ROBIS: a new tool to assess risk of bias in systematic reviews was developed. Journal of clinical epidemiology, 69, 225-234. https://doi.org/10.1016/j.jclinepi.2015.06.005.
Whiting, P., Savović, J., Higgins, J. P., Caldwell, D. M., Reeves, B. C., Shea, B.,... & Churchill, R. (2016). ROBIS: a new tool to assess risk of bias in systematic reviews was developed. Journal of clinical epidemiology, 69, 225-234. https://doi.org/10.1016/j.jclinepi.2015.06.005