Design and Validation of an Instrument to Evaluate the Learning Acquired by Nursing Students from a Brief Tobacco Intervention (BTI-St©)

Abstract

The aim of this study was to design and validate an instrument, based on the WHO 5As+5Rs model, to test the acquisition by nursing students of a brief tobacco intervention (BTI) learning. A validation design of an instrument following the criterion referenced tests model using videos of simulated BTIs in the primary care setting was carried out. The study included 11 experts in smoking prevention/care and 260 second-year nursing students. The study was in two stages: (1) selection and recording of clinical simulations (settings), and (2) test construction. Content was validated by applying the Delphi consensus technique and calculating the Content Validity Ratio (CVR) and Content Validity Index (CVI). A pilot test was conducted for item analysis. Reliability was evaluated as internal consistency (Kuder-Richardson [KR-20]) and test-retest temporal stability (intraclass correlation coefficient [ICC]). Three simulation settings were recorded. An instrument (BTI-St®) was developed with 23 items for dichotomous (yes/no) response. CVR was >70% for all items, KR-20 of 0.81–0.88, and ICC between 0.68 and0.73 (p < 0.0001). The BTI-St® is a robust and reliable instrument that is easily and rapidly applied. It follows the WHO 5As+5Rs model and offers objective criterion-referenced evaluation of BTI learning in nursing students.