The following answers/responses are the results of the survey offered after the viewing of the CYD training video. Thank you.
- QUESTION: “Do you currently have a computer program that evaluates each pre and post-test, or are individual CYD coordinators required to manually compare the 2?”
ANSWER: The PEIS database has a function that evaluates the pre/post tests for each contractor.
- QUESTION: “Can you send the evaluation results to each coordinator and can the video presentation be shared with the contractors since they are the ones providing direct service delivery to youth? This is the first time we’ve actually seen evaluation results for the CYD.
ANSWER: The evaluation report will be available through DFPS to CYD contractors. Subcontractors can access the CYD training video on the Texas Juvenile Crime Prevention Center website at: www.pvamu.edu/pages/7491.asp
- QUESTION: “Is this report available in printed form? If so, where?”
ANSWER: PEI will make the report available after review.
- QUESTION: “There was a reference to gathering of school data in September. What information will that add to the analysis?”
ANSWER: The school records are important as an indicator of success of the CYD program. They will also be used to validate the new PFS surveys for children 6 to 9 and youth 10 to 17 year olds.
- QUESTION: “How long does PVAMU think it will take to gather the consents from the parents and the assent from the youth and is there any concern of time spent gathering the consents/assents impinging on services, especially in the crucial 1-2 months of school?”
ANSWER: Ideally, the consent/assent forms could be sent out with the initial registration packets. If this is possible, then the amount of time spent gathering them should be minimal.
- QUESTION: “Was there any consideration in the study of “survey fatigue” by the CYD participants? Many of the youth are required to complete multiple versions of the post-test within a 12-month period.”
ANSWER: Survey Fatigue, while a significant methodological concern, was not controlled for in this study. We thank the participants for this feedback and will address this concern in future research. CYD participants should only be administered the newest version of the PFS for children (6-9) and older youth (10-17 year olds). Any previous versions of the instrument are no longer to be used. It is important that program staff members present the survey with a positive attitude and emphasize the importance of accurate responding will strengthen the reliability of the assessment.
- QUESTION: “The discrepancy between number of Pre and Post surveys is problematic. We are serving a very mobile population, and we do not know if a client has left the program until THEY STOP ATTENDING. AT THAT TIME IT IS USUALLY NOT POSSIBLE TO OBTAIN POST TESTS. The program staff is needed at the program sites and if the clients cannot be reached by phone, or refuse to attend, or in many cases have moved away, it is just not possible to obtain post surveys. Are there any suggestions for this?”
ANSWER: It is recommended that each program keep attendance for the duration of the program, especially when participants are taking the pre-test and post-test. If clients are unavailable to take the post-test due to early termination from the program, program staff should note the last day of attendance. This will assist in the data analysis process as well as track attrition rates for each program.
- QUESTION: “There did not appear to be a clear connection between a) change in protective factors and b) rates of referral to TJPC. Is that because the rate of referral to TJPC was so low? If that is the case, is the PFS telling us anything?”
ANSWER: The rate is low, but we are looking into the specific relationship between test scores and referrals this Fall.
Responses to other Comments/ Concerns
COMMENT: “If a service provider does not administer the correct test, it is impossible to still use the data (cannot be entered in database). Therefore, they have to go back to the child and have them complete the correct test. This becomes very time consuming and frustrating, especially when working with large groups. Administering the wrong test can be attributed to many factors: child doesn’t know their correct age or data of birth, child has turned 10 since initial registration date (could be just a couple of days or weeks), etc. It is difficult to keep up with which test to give to which child/youth, and then match the post-test (especially for kids turning 10 during programming).”
COMMENT: “Not clear as to what, other than post-tests, needs to be implemented.”
REPONSE: There are no other instruments that need to be administered to CYD participants.
COMMENT: “For data entry, it is much more time consuming to enter letters rather than numbers.”
REPONSE: You will still be entering numbers rather than letters.