Table 3 Mixed Method Appraisal Tool quality appraisal for the included studies
| Â | Screening questions | Â | 2. Randomised controlled trials | Â | Â | Â | Â |
|---|---|---|---|---|---|---|---|
Paper | S1. Are there clear research questions? | S2. Do the collected data allow to address the research questions? | 2.1. Is randomisation appropriately performed? | 2.2. Are the groups comparable at baseline? | 2.3. Are there complete outcome data? | 2.4. Are outcome assessors blinded to the intervention provided? | 2.5 Did the participants adhere to the assigned intervention? |
Bharti et al. (2016) [24] | Yes | Yes | Yes | Yes | Yes | Yes | Yes |
Fegley (1988) [25] | Yes | Yes | Yes | Yes | Yes | Yes | Yes |
Gebarski et al. 2013 [26] | Yes | Yes | Yes | Cannot tell | Cannot tell | Yes | No |
Han et al. (2019) [27] | Yes | Yes | Yes | Yes | Yes | Yes | Yes |
Hartman et al. (2009) [28] | Yes | Yes | Cannot tell | Yes | Yes | No | Yes |
Hogan et al. (2018) [29] | Yes | Yes | Yes | Yes | Yes | No | Yes |
Johnson et al. (2014) [30] | Yes | Yes | Cannot tell | Cannot tell | Yes | Yes | No |
Ong et al. (2018) [31] | Yes | Yes | Yes | Yes | Yes | Cannot tell | No |
Rothmann et al. (2016) [32] | Yes | Yes | Yes | Yes | Yes | Yes | No |
| Â | Screening questions | Â | 3. Non-randomised studies | Â | Â | Â | Â |
|---|---|---|---|---|---|---|---|
First author | S1. Are there clear research questions? | S2. Do the collected data allow to address the research questions? | 3.1. Are the participants representative of the target population? | 3.2. Are measurements appropriate regarding both the outcome and intervention (or exposure)? | 3.3. Are there complete outcome data? | 3.4. Are the confounders accounted for in the design and analysis? | 3.5. During the study period, is the intervention administered (or exposure occurred) as intended? |
Carter et al. (2010) [55] | Yes | Yes | Yes | Yes | Yes | Cannot tell | Yes |
Cavarocchi et al. (2019) [38] | Yes | Yes | Yes | Yes | Yes | Yes | Yes |
Cedja et al. (2012) [56] | Yes | Yes | Yes | Yes | No | Cannot tell | Yes |
deAmorin e Silva (2006) [57] | Yes | Yes | Yes | Yes | Yes | Cannot tell | Yes |
Johnson et al. (2009) [46] | Yes | Yes | Yes | Yes | Yes | No | Yes |
Karakas et al. (2015) [40] | Yes | Yes | Cannot tell | Yes | Yes | No | Yes |
Mastro et al. (2019) [58] | Yes | Yes | Yes | Yes | Yes | Cannot tell | Yes |
McGlashan et al. (2017) [4] | Yes | No | Yes | Cannot tell | No | No | Yes |
Morel et al. (2020) [47] | Yes | Cannot tell | Cannot tell | Cannot tell | Yes | No | Yes |
Thung et al. (2018) [51] | Yes | Yes | Yes | Yes | Yes | Yes | Yes |
Tornqvist et al. (2015) [42] | Yes | Yes | Yes | Yes | Yes | No | Yes |
Train et al. (2006) [43] | Yes | Yes | Yes | No | Yes | No | Yes |
Waitayawinyu & Wankan (2016) [52] | Yes | Yes | Yes | Yes | Yes | Cannot tell | Yes |
Williams & Green (2015) [44] | Yes | Yes | Yes | Yes | Yes | Cannot tell | Yes |
| Â | Screening questions | Â | 4. Quantitative descriptive studies | Â | Â | Â | Â |
|---|---|---|---|---|---|---|---|
First author | S1. Are there clear research questions? | S2. Do the collected data allow to address the research questions? | 4.1. Is the sampling strategy relevant to address the research question? | 4.2. Is the sample representative of the target population? | 4.3. Are the measurements appropriate? | 4.4. Is the risk of nonresponse bias low? | 4.5. Is the statistical analysis appropriate to answer the research question? |
Ashmore et al. (2019) [34] | No | Cannot tell | Yes | Yes | Yes | Cannot tell | Can't tell |
Barnea-Goraly et al. (2014) [35] | Yes | Yes | Yes | Yes | Yes | Yes | Yes |
Capurso et al. (2020) [36] | Yes | Yes | Yes | Yes | Yes | Yes | Yes |
de Bie et al. (2010) [37] | Yes | Yes | Yes | Yes | Yes | Yes | Yes |
Durand et al. (2015) [45] | Yes | Yes | Yes | Yes | Yes | Yes | Yes |
Fraser et al. (2019) [39] | Cannot tell | Cannot tell | Cannot tell | Yes | Cannot tell | Cannot tell | Cannot tell |
Hallowell et al. (2008) [54] | Yes | Yes | Yes | Yes | Yes | Yes | Yes |
Nordahl et al. (2016) [48] | Cannot tell | Yes | Yes | Yes | Yes | Yes | Yes |
Pressdee et al. (1997) [59] | No | Cannot tell | Yes | Yes | Cannot tell | Yes | Cannot tell |
Pua et al. (2020) [49] | Yes | Yes | Yes | Yes | Yes | Yes | Yes |
Yamada | Yes | Yes | Yes | Yes | Cannot tell | Yes | Yes |
| Â | Screening questions | Â | 5. Mixed methods studies | Â | Â | Â | Â |
|---|---|---|---|---|---|---|---|
First author | S1. Are there clear research questions? | S2. Do the collected data allow to address the research questions? | 5.1. Is there an adequate rationale for using a mixed methods design to address the research question? | 5.2. Are the different components of the study effectively integrated to answer the research question? | 5.3. Are the outputs of the integration of qualitative and quantitative components adequately interpreted? | 5.4. Are divergences and inconsistencies between quantitative and qualitative results adequately addressed? | 5.5. Do the different components of the study adhere to the quality criteria of each tradition of the methods involved? |
Szerzak et al. (2016) [50] | Yes | Yes | Yes | Yes | Yes | Cannot tell | Cannot tell |