Measuring program fidelity in case management for high risk families

Abstract Summary: Program fidelity instruments are a key ingredient for clinical supervision and implementation as well as effectiveness studies. This study examines the factor structure of the Functional Family Parole services Global Rating Measure (FFP-GRM); the program fidelity instrument of Functional Family Parole services for case management in youth parole, child protection and child welfare services. Between October 2012 and February 2015, program fidelity was measured with the FFP-GRM by Functional Family Parole supervisors. Confirmatory factor analysis was performed on 380 cases and internal consistency reliability coefficients were calculated. Findings: Confirmatory factor analyses showed that the 33-item and four-factor model of the FFP-GRM achieved a good fit to the data. Internal validity testing results showed that subscale Cronbach’s a ranged between .82 and .90. Applications: Findings affirm a good fit to the data and a good-to-excellent internal consistency of the FFP-GRM, which is considered sufficient to justify its use. The results are discussed with regard to the use of fidelity instruments for both clinical and research purposes.