QUALITATIVE RESEARCH CHALLENGES IN ASSESSING RAINWATER HARVESTING IMPLEMENTATION FIDELITY FOR RELIABLE DATA
DOI:
https://doi.org/10.21837/pm.v22i31.1463Keywords:
Implementation Fidelity Assessment, Rainwater Harvesting, Research Methods, PolicyAbstract
Assessing local councils’ adherence to rainwater harvesting policy regulated in the by-laws is critical to the success of water conservation efforts. However, there are certain challenges that must be addressed in this assessment. This paper highlights the aforementioned challenges and provides recommendations for future research. The research used a qualitative approach, employing six distinct methods to obtain more robust and reliable data: (i) desk study, (ii) document review, (iii) interviews, (iv) observation, (v) self-analysis questions and (vi) focus group discussion. The success of the implementation-focused research was based on a defined direction of assessment, eligible participants and sites, suitable methods, access to reliable data, robust analysis and writing proficiency. This paper suggests that future search should focus on establishing relevant skills, building relationships with the participants, defining concepts and exploring alternative data sources. Assessing implementation fidelity was not easy because it necessitated substantial resources to draw meaningful conclusions about the extent to which the rainwater harvesting policy was delivered. Addressing qualitative research challenges in assessing rainwater harvesting implementation could enable researchers to suggest implementers on making more informed decisions in attaining Sustainable Development Goal 6.
Downloads
References
Allen, J. D., Linnan, L. A., & Emmons, K. M. (2012). Fidelity and Its Relationship to Implementation Effectiveness, Adaptation, and Dissemination. In Dissemination and implementation research in health: Translating science into practice (pp. 213–222). Oxford University Press. doi:10.1093/acprof:oso/9780199751877.001.0001. DOI: https://doi.org/10.1093/acprof:oso/9780199751877.003.0014
An, M., Dusing, S. C., Harbourne, R. T., Sheridan, S. M., & START-Play Consortium. (2020). What Really Works in Intervention? Using Fidelity Measures to Support Optimal Outcomes. Physical Therapy, 100(5), 757–765. https://doi.org/10.1093/ptj/pzaa006 DOI: https://doi.org/10.1093/ptj/pzaa006
Azis, S. S. A., Razali, M. N. M., Maimun, N. H. A., Yusoff, N. S. M., Rahman, M. S. A., & Zulkifli, N. A. A. (2021). AN ANALYSIS ON THE EFFICIENCY OF GREEN ROOF IN MANAGING URBAN STORMWATER RUNOFF. PLANNING MALAYSIA, 19. https://doi.org/10.21837/pm.v19i17.991 DOI: https://doi.org/10.21837/pm.v19i17.991
Carroll, C., Patterson, M., Wood, S., Booth, A., Rick, J., & Balain, S. (2007). A conceptual framework for implementation fidelity. Implementation Science, 2(1), 40. https://doi.org/10.1186/1748-5908-2-40 DOI: https://doi.org/10.1186/1748-5908-2-40
Colquhoun, H., Leeman, J., Michie, S., Lokker, C., Bragge, P., Hempel, S., McKibbon, K. A., Peters, G.-J. Y., Stevens, K. R., Wilson, M. G., & Grimshaw, J. (2014). Towards a common terminology: A simplified framework of interventions to promote and integrate evidence into health practices, systems, and policies. Implementation Science, 9(1), 781. https://doi.org/10.1186/1748-5908-9-51 DOI: https://doi.org/10.1186/s13012-014-0154-4
Dane, A. V., & Schneider, B. H. (1998). Program integrity in primary and early secondary prevention: Are implementation effects out of control? Clinical Psychology Review, 18(1), 23–45. DOI: https://doi.org/10.1016/S0272-7358(97)00043-3
DeCarlo, M. (2018). Scientific Inquiry in Social Work. Open Social Work Education, ROanoke, VA. https://pressbooks.pub/scientificinquiryinsocialwork/chapter/7-3-unit-of-analysis-and-unit-of-observation/
Durlak, J., & DuPre, E. (2008). Implementation Matters: A Review of Research on the Influence of Implementation on Program Outcomes and the Factors Affecting Implementation. American Journal of Community Psychology, 41, 327–350. https://doi.org/10.1007/s10464-008-9165-0 DOI: https://doi.org/10.1007/s10464-008-9165-0
Etchells, E., & Woodcock, T. (2018). Value of small sample sizes in rapid-cycle quality improvement projects 2: Assessing fidelity of implementation for improvement interventions. BMJ Quality & Safety, 27(1), 61–65. https://doi.org/10.1136/bmjqs-2017-006963 DOI: https://doi.org/10.1136/bmjqs-2017-006963
Fiske, K. (2008). Treatment Integrity of School-Based Behavior Analytic Interventions: A Review of the Research. Behavior Analysis in Practice, 1, 19–25. https://doi.org/10.1007/BF03391724 DOI: https://doi.org/10.1007/BF03391724
Habibullah, N., Sahrir, S., & Ponrahono, Z. (2023). INTEGRATING RAINWATER HARVESTING AND GREYWATER RECYCLING TO INCREASE WATER EFFICIENCY IN OFFICE BUILDINGS. PLANNING MALAYSIA, 21. https://doi.org/10.21837/pm.v21i29.1369 DOI: https://doi.org/10.21837/pm.v21i29.1369
Hanson-DeFusco, J. (2023). What data counts in policymaking and programming evaluation – Relevant data sources for triangulation according to main epistemologies and philosophies within social science. Evaluation and Program Planning, 97, 102238. https://doi.org/10.1016/j.evalprogplan.2023.102238 DOI: https://doi.org/10.1016/j.evalprogplan.2023.102238
Miles, M. B., Huberman, A. M., & Saldana, J. (2018). Qualitative Data Analysis: A Methods Sourcebook. SAGE Publications.
Mowbray, C., Holter, M., Teague, G., & Bybee, D. (2003). Fidelity Criteria: Development, Measurement, and Validation. American Journal of Evaluation - AM J EVAL, 24, 315–340. https://doi.org/10.1016/S1098-2140(03)00057-2 DOI: https://doi.org/10.1177/109821400302400303
Nguyen, H. N., Trujillo, C. M., Wee, K., & Bowe, K. A. (2021). Interactive Qualitative Data Visualization for Educational Assessment. The 12th International Conference on Advances in Information Technology, 1–9. https://doi.org/10.1145/3468784.3469851 DOI: https://doi.org/10.1145/3468784.3469851
Noell, G. H., Witt, J. C., Slider, N. J., Connell, J. E., Gatti, S. L., Williams, K. L., Koenig, J. L., Resetar, J. L., & Duhon, G. J. (2005). Treatment Implementation Following Behavioral Consultation in Schools: A Comparison of Three Follow-up Strategies. School Psychology Review, 34(1), 87–106. https://doi.org/10.1080/02796015.2005.12086277 DOI: https://doi.org/10.1080/02796015.2005.12086277
O’Donnell, C. L. (2008). Defining, Conceptualizing, and Measuring Fidelity of Implementation and Its Relationship to Outcomes in K–12 Curriculum Intervention Research. Review of Educational Research, 78(1), 33–84. https://doi.org/10.3102/0034654307313793 DOI: https://doi.org/10.3102/0034654307313793
Patino, C. M., & Ferreira, J. C. (2018). Inclusion and exclusion criteria in research studies: Definitions and why they matter. Jornal Brasileiro de Pneumologia, 44(2), 84. https://doi.org/10.1590/S1806-37562018000000088 DOI: https://doi.org/10.1590/s1806-37562018000000088
Pinnock, H., Barwick, M., Carpenter, C. R., Eldridge, S., Grandes, G., Griffiths, C. J., Rycroft-Malone, J., Meissner, P., Murray, E., Patel, A., Sheikh, A., & Taylor, S. J. C. (2017). Standards for Reporting Implementation Studies (StaRI) Statement. BMJ, 356. https://doi.org/10.1136/bmj.i6795 DOI: https://doi.org/10.1136/bmj.i6795
Roller, M. R., & Lavrakas, P. J. (2015). Applied Qualitative Research Design: A Total Quality Framework Approach (1st edition). The Guilford Press.
Stikeleather, J. (2013, March 27). When Data Visualization Works—And When It Doesn’t. Harvard Business Review. https://hbr.org/2013/03/when-data-visualization-works-and
Suki, N. M., Latif, H. M., & Zainol, H. (2022). A Systematic Literature Review on Rainwater Harvesting Implementation Fidelity. IOP Conference Series: Earth and Environmental Science, 1067(1), 012022. https://doi.org/10.1088/1755-1315/1067/1/012022 DOI: https://doi.org/10.1088/1755-1315/1067/1/012022
Downloads
Published
How to Cite
Issue
Section
License
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 3.0 Unported License.
Copyright & Creative Commons Licence
eISSN: 0128-0945 © Year. The Authors. Published for Malaysia Institute of Planners. This is an open-access article under the CC BY-NC-ND license.
The authors hold the copyright without restrictions and also retain publishing rights without restrictions.
