Criteria for selecting experts in the evaluation of educational technologies in Nursing: an integrative review

Authors

DOI:

https://doi.org/10.15253/2175-6783.20242592942

Keywords:

Evaluation Study; Educational Technology; Nursing.

Abstract

Objective: to analyze the criteria for selecting experts in studies evaluating the validity of educational technologies in nursing. Methods: an integrative review was carried out in five databases. Full publications from the last five years in Portuguese, English, and Spanish were included. The analysis was carried out by two independent researchers, with the help of a third reviewer. Results: 29 studies were included. The majority chose to adopt criteria drawn up by the authors themselves (n = 18; 62.1%); followed by using other methodological references (n = 7; 24.1%); and the original Fehring or with adaptations (n=4; 13.8%). The criteria analyzed referred to the domains of academic training, professional performance/experience, and productions. Conclusion: most of the studies did not cite a reference to determine the criteria for selecting experts, nor did they establish a minimum score for selecting experts. Contributions to practice: the need for standardization in the selection of experts and the development of new, comprehensive, and up-to-date criteria such as the one proposed is essential to guide researchers and health professionals in the selection of experts for the evaluation of educational technologies in the field of nursing.

References

Cassiano AN, Silva CJDA, Nogueira ILA, Elias TMN, Teixeira E, Menezes RMPD. Validation of educational technologies: bibliometric study in nursing theses and dissertations. Rev Enfer Cen O Min. 2020;10:e3900. doi: http://doi.org/10.19175/recom.v10i0.3900

Torres FBG, Gomes DC, Dhein MM, Cardoso AMR, Hino AAF, Cubas MR. Selection of experts for the development of terminological subsets of ICNP: a methodological research. Online Braz J Nurs. 2023;22:e20236675. doi: https://dx.doi.org/10.17665/1676-4285.20236675

Fehring RJ. Methods to validate nursing diagnoses. Heart Lung [Internet]. 1987 [cited Mar 1, 2024];16(6):625-9. Available from: https://core.ac.uk/download/pdf/213076462.pdf

Jasper MA. Expert: a discussion of the implications of the concept as used in nursing. J Adv Nurs. 1994;20(4):769-76. doi: http://doi.org/10.1046/j.1365-2648.1994.20040769.x

Manley K, Garbett R. Paying Peter and Paul: reconciling concepts of expertise with competency for a clinical career structure. J Clin Nurs. 2000;9(3):347-59. doi: https://doi.org/10.1046/j.1365-2702.2000.00408.x

Mendes KDS, Silveira RCCP, Galvão CM. Use of the bibliographic reference manager in the selection of primary studies in integrative reviews. Texto Contexto Enferm. 2019;28:e20170204. doi: https://doi.org/10.1590/1980-265X-TCE-2017-0204

Page MJ, McKenzie JE, Bossuyt PM, Boutron I, Hoffmann TC, Mulrow CD, et al. The PRISMA 2020 statement: an updated guideline for reporting systematic reviews. BMJ. 2021;372:71. doi: https://doi.org/10.1136/bmj.n71

Brasil GB, Rodrigues ILA, Nogueira LMV, Palmeira IP. Educational technology for people living with HIV: validation study. Rev Bras Enferm. 2018;71(Suppl 4):1657-62. doi: https://dx.doi.org/10.1590/0034-7167-2017-0824

Saraiva NCG, Medeiros CCM, Araújo TL. Serial album validation for promotion of infant body weight control. Rev Latino-Am Enfermagem. 2018;26:e2998. doi: https://dx.doi.org/10.1590/1518-8345.2194.2998

Pinheiro DGM, Coelho TPB, Silva CFA, Silva LA, Chiesa AM, Fracolli LA. Content validation of a home visit program for mothers and children. Cogitare Enferm. 2018;23(2):e54055. doi: https://dx.doi.org/10.5380/ce.v23i2.54055

Alvarez AG, Sasso GTMD, Iyengar MS. Mobile persuasive technology for the teaching and learning in surgical safety: Content validation. Nurse Educ Today. 2018;71:129-34. doi: https://dx.doi.org/10.1016/j.nedt.2018.09.030

Pinto TRC, Castro DS, Bringuente MEO, Sant’ Anna HC, Souza TV, Primo CC. Educational animation about home care with premature newborn infants. Rev Bras Enferm. 2018;71(Suppl 4):1604-10. doi: https://dx.doi.org/10.1590/0034-7167-2017-0401

Salvador PTCO, Mariz CMS, Vítor AF, Ferreira Jr MA, Fernandes MID, Martins JCA, et al. Validation of virtual learning object to support the teaching of nursing care systematization. Rev Bras Enferm. 2018;71(1):11-9. doi: https://dx.doi.org/10.1590/0034-7167-2016-0537

Oliveira LL, Mendes IC, Balsells MMD, Bernardo EBR, Castro RCMB, Aquino PS, et al. Educational hypermedia in nursing assistance at birth: Building and validation of content and appearance. Rev Bras Enferm. 2019;72(6):1471-8. doi: http://dx.doi.org/10.1590/0034-7167/2018-0163

Barbosa RC. Validação de um vídeo educativo para a promoção do apego entre mãe soropositiva para o HIV e seu filho [Tese]. Fortaleza: Universidade Federal do Ceará; 2008.

Freitas LV, Teles LMR, Lima TM, Vieira NFC, Barbosa RCM, Pinheiro AKB, et al. Physical examination during prenatal care: construction and validation of educational hypermedia for nursing. Acta Paul. Enferm. 2012;25(4):581-588. doi: https://dx.doi.org/10.1590/S0103-21002012000400016

Alves MG, Batista DFG, Cordeiro ALPC, Silva MD, Canova JCM, Dalri MCB. Production and validation of a video lesson on cardiopulmonary resuscitation. Rev Gaúcha Enferm. 2019;40:e20190012. doi: https://dx.doi.org/10.1590/1983-1447.2019.20190012

Vale JMM, Marques Neto AC, Santana ME, Mendes CP. Validation of a technology for self-care of family caregivers of cancer patients in home-baosed palliative care. Rev Rene. 2019;20:e40957. doi: https://doi.org/10.15253/2175-6783.20192040957

Silva CSG, Lisboa SD, Santos LM, Carvalho ESS, Passos SSS, Santos SSB. Development and validation of the content and appearance of the “peripheral venous cannulation for families booklet”. Rev Cuid. 2019;10(3):e830. doi: https://dx.doi.org/10.15649/cuidarte.v10i3.830

Perdigão MMM, Rodrigues AB, Magalhães TL, Freitas FMC, Bravo LG, Oliveira PP. Educational technology for fatigue management related to antineoplastic chemotherapy. Rev Bras Enferm. 2019;72(6):1519-25. doi: https://dx.doi.org/10.1590/0034-7167-2018-0505

Cherubim DO, Padoin SMM, Paula CC. Musical educational technology for lactation physiology learning: knowledge translation. Rev Bras Enferm. 2019;72(Suppl 3):220-6. doi: http://dx.doi.org/10.1590/0034-7167-2018-0528

Rosa BVC, Girardon-Perlini NMO, Gamboa NSG, Nietsche EA, Beuter M, Dalmolin A. Development and validation of audiovisual educational technology for families and people with colostomy by cancer. Texto Contexto Enferm. 2019;28:e20180053. doi: https://10.1590/1980-265X-TCE-2018-0053

Santiago JCS, Moreira TMM. Booklet content validation on excess weight for adults with hypertension. Rev Bras Enferm. 2019;72(1):95-101. doi: http://dx.doi.org/10.1590/0034-7167-2018-0105

Joventino ES, Oriá MOB, Sawada NO, Ximenes LB. Apparent and content validation of maternal self-efficiency scale for prevention of childhood diarrhea. Rev Latino-Am Enfermagem. 2013;21(1):371-9. doi: https://doi.org/10.1590/S0104-11692013000100012

Galindo Neto NM, Alexandre ACS, Barros LM, Sá GGM, Carvalho KM, Caetano JÁ. Creation and validation of an educational video for deaf people about cardiopulmonary resuscitation. Rev Latino-Am Enfermagem. 2019;27:e3130. doi: https://dx.doi.org/10.1590/1518-8345.2765.3130

Barbosa CP, Belian RB, Araújo CM. Continuing education in the child health handbook: an educationalsoftware for primary care. J Pediatr (Rio J). 2020;97:80-7. doi: https://dx.doi.org/10.1016/j.jped.2019.12.003

Wild CF, Nietsche EA, Salbego C, Teixeira E, Favero NB. Validation of educational booklet: an educational technology in dengue prevention. Rev Bras Enferm. 2019;72(5):1318-25. doi: http://dx.doi.org/10.1590/0034-7167-2018-0771

Oliveira PMP, Pagliuca LMF. Assessment of an educational technology in the string literature about breastfeeding. Rev Esc Enferm USP. 2013;47(1):205-12. doi: http://doi.org/10.1590/S0080-62342013000100026

Galdino YLS, Moreira TMM, Marques ADB, Silva FAA. Validation of a booklet on self-care with the diabetic foot. Rev Bras Enferm. 2019;72(2):780-7. doi: https://dx.doi.org/10.1590/0034-7167-2017-0900

Maia SF, Fagundes DM, Carneiro ALL. Patient self-care with double catheter lumen for hemodialization: validation of instructional folder. Acta Sci Health Sci. 2019;41(1):e47558. doi: https://doi.org/10.4025/actascihealthsci.v41i1.47558

Souza Junior VD, Mendes IAC, Tori R, Marques LP, Mashuda FKK, Hirano LAF, et al. VIDA-Nursing v1.0: immersive virtual reality in vacuum blood collection among adults. Rev Latino-Am Enfermagem. 2020;28:e3263. doi: https://dx.doi.org/10.1590/1518-8345.3685.3263

Bittencourt MN, Flexa RS, Santos ISR, Ferreira LD, Nemer CRB, Pena JLC. Validation of content and appearance of an educational manual to promote children’s mental health. Rev Rene. 2020;21:e43694. doi: https://doi.org/10.15253/2175-6783.20202143694

Bernardes RM, Caliri MH. Construction and validation of a website about pressure injuries. Acta Paul Enferm. 2020;33:eAPE20190130. doi: http://doi.org/10.37689/acta-ape/2020AO01305

Jesus GJ, Caliari JS, Oliveira LB, Queiroz AAFLN, Figueiredo RM, Reis RK. Construction and validation of educational material for the health promotion of individuals with HIV. Rev Latino-Am Enfermagem. 2020;28:e3322. doi: https://dx.doi.org/10.1590/1518-8345.3748.3322

Mello NC, Góes FGB, Pereira-Ávila FMV, Moraes JRMMM, Silva LF, Silva MA. Construction and validation of an educational booklet for mobile devices on breastfeeding. Texto Contexto Enferm. 2020;29:e20180492. doi: http://dx.doi.org/10.1590/1980-265X-TCE-2018-0492

Sena JF, Silva IP, Lucena SKP, Oliveira ACS, Costa IKF. Validation of educational material for the care of people with intestinal stoma. Rev Latino-Am Enfermagem. 2020;28:e3269. doi: https://dx.doi.org/10.1590/1518-8345.3179.3269

Cruz FOAM, Faria ET, Reis PED. Validation of an educational manual for breast cancer patients undergoing radiotherapy. Rev Latino-Am Enfermagem. 2020;28:e3384. doi: https://dx.doi.org/10.1590/1518-8345.3197.3384

Melo RP, Moreira RP, Fontenele FC, Aguiar ASC, Joventino ES, Carvalho EC. Criteria for selection of experts for validation studies of nursing phenomena. Rev Rene. 2011;12(2):424-31. doi: https://doi.org/10.15253/2175-6783.20110002000024

Rodrigues LN, Santos AS, Gomes PPS, Silva WCP, Chaves EM. Construction and validation of an educational booklet on care for children with gastrostomy. Rev Bras Enferm. 2020;73(3):e20190108. doi: https://doi.org/10.1590/0034-7167-2019-0108

Santos AS, Rodrigues LN, Andrade KC, Santos MSN, Viana MCA, Chaves EMC. Construction and validation of an educational technology for mother-child bond in the neonatal intensive care unit. Rev Bras Enferm. 2020;73(4):e20190083. doi: https://dx.doi.org/10.1590/0034-7167-2019-0083

Santiago RF, Andrade EMLR, Mendes IAC, Viana MCA, Nery IS. Evaluation of a prenatal virtual learning object for pregnant adolescents in primary care. Acta Paul Enferm 2020;33:eAPE20190063. doi: http://doi.org/10.37689/acta-ape/2020AO0063

Rissi M, Garcia R. Gestão e avaliação da pós-graduação: um estudo bibliométrico. Rev Bras Pós-Grad. 2022;17(38):1-21. doi: https://rbpg.capes.gov.br/rbpg/article/view/1779

Dijk EE, Tartwijk J, Schaaf MF, Kluijtmans M. What makes an expert university teacher? A systematic review and synthesis of frameworks for teacher expertise in higher education. Educ Res Rev. 2020;31:100365. doi: https://doi.org/10.1016/j.edurev.2020.100365

Laustsen CE, Petersson P, Westergren A, Haak M. Involvement of professionals in research: knowledge integration, development of practice, and challenges: a group concept mapping study. Health Res Policy Syst. 2021;19(1):115. doi: https://doi.org/10.1186/s12961-021-00763-5

Lopes JL, Bohomol E, Avelar AF, Monreal FO, Roza BA, Pedreira ML. Scientific production and activities of graduates from a doctoral nursing program. Acta Paul Enferm. 2020;eAPE20190133. doi: https://dx.doi.org/10.37689/acta-ape/2020AO0133

Souza CJ, Silvino ZR, Souza DF. Analysis of patent registries in Brazilian nursing and its relationship with the professional master’s degree. Rev Gaúcha Enferm. 2020;41:e20190358. doi: https://doi.org/10.1590/1983-1447.2020.20190358

Ferreira SL, Barbosa IV, Alexandre SG, Abreu RNDC, Mota CFA, Cabral JFF, et al. Construction and validation of educational technology for family members of people with venous ulcers. Rev Bras Enferm. 2022;75(5):e20210555. doi: https://doi.org/10.1590/0034-7167-2021-055

Silva MY, Partelli ANM, Oliveira JD, Lopes MSV, Moreira MRL, Martins AKL. Almanac for preventing the use of alcohol and other drugs among adolescents: construction and validity. Rev Bras Enferm. 2022;75(3):e20220118. doi: https://doi.org/10.1590/0034-7167-2022-0118

Published

2024-06-20

How to Cite

Melo, E. S. J., Silva, M. J. N. da, Silva, A. P. do N., Braga, H. F. G. M., Oliveira, B. S. B. de, Monteiro, F. P. M., & Barbosa, L. P. (2024). Criteria for selecting experts in the evaluation of educational technologies in Nursing: an integrative review. Rev Rene, 25, e92942. https://doi.org/10.15253/2175-6783.20242592942

Issue

Section

Review Article

Most read articles by the same author(s)