EXAMPLE ANNUAL SUMMARY REPORT
Annual Summary Reports: All used Risk & Needs Assessments, Inc. (Risk & Needs) diskettes are returned to Risk & Needs when used. The test data contained on these diskettes (no names) is downloaded into that test's expanding database. Risk & Needs can then access each of its tests' built-in databases for statistical analysis (database research) and summarization (annual summary reports) of all tests administered in the past year.
Annual Summary Reports are prepared for state, department, agency and even some individual providers -- at no cost to them. These reports are provided as a professional courtesy to large volume test users. These Summary Reports include demographics, court-history when relevant, and test statistics (reliability, validity and accuracy). Has anyone offered to summarize your testing program? Annually? At no additional cost to you? Minimum testing volume for annual reports is 350 tests. There is no maximum limit. Risk & Needs' annual reports range in size from 350 tests to over 50,000 tests annually. An example Annual Report is presented below.
EXAMPLE ANNUAL SUMMARY REPORT
Driver Risk Inventory-II
SUMMARY REPORT
A COMPOSITE SUMMARY OF ALABAMA DUI OFFENDERS DRI-II SHORT FORM RESULTS FROM 10-1-00 THROUGH 9-16-01
Behavior Data Systems, Ltd. P.O. BOX 44256 Phoenix, Arizona 85064-4256
|
PREFACE
This special report summarizes Alabama’s CRO assessments of DUI offender evaluations from October 1, 2000 to September 16, 2001. These DRI-II Short Form test results have not been included in prior reports. There are 8,145 Alabama DUI offenders test data included in this report. This Alabama DUI Program report is dedicated to the Alabama Administrative Office of the Courts. Copies can be obtained from Ms. Elizabeth Upshaw, State Coordinator. This document shall also be distributed at the Court Referred In-Service program on Thursday, September 27, 2001.
Special report contents are located on the following pages:
This special report describes the DUI offenders that were assessed or screened with the Driver Risk Inventory-II Short Form or DRI-II Short Form throughout the state of Alabama. This report is provided as a professional courtesy by Behavior Data Systems, Ltd. and its distribution is not restricted. It is set forth in a concise yet readable manner that should be of interest to anyone concerned with or engaged in Alabama’s DUI program. The DUI offender assessment information that is contained herein was obtained from Alabama’s CRO’s statewide. Hopefully, this report will be both informative and interesting to Alabama’s DUI program staff, CRO’s, judges, court personnel, probation and correctional departments as well as intervention and treatment staff. Annual summary reports of Alabama’s statewide DUI offender assessments are provided to Alabama Administrative Office of the Courts each October. The next annual report is scheduled for completion on October 31, 2001. This date is subject to change upon the recommendation of Alabama Administrative Office of the Courts. These annual statewide reports also include individual CRO agency testing summaries. Additional information can be provided upon request. Behavior Data Systems’ toll free telephone number is 1-800-231-2401 and our e-mail address is bds@bdsltd.com.
Donald D. Davignon, Ph.D. Senior Research Analyst
|
DRIVER RISK INVENTORY – II SHORT FORM This report summarizes Driver Risk Inventory-II Short Form test results for 8,145 Alabama DUI offenders. All DRI-II Short Form diskettes received from October 1, 2000 are included. Two diskettes contained test data from 1998 but the diskettes were only recently received. Accuracy of the DRI-II Short Form The accuracy of the four DRI-II Short Form measurement scales is presented in the graph and table below. Percentages of offenders scoring in the four risk categories (low, medium, problem and severe problem) are compared to predicted percentages for each of the measurement scales. Predicted percentages are shown in the top row of the table below the graph. The differences between obtained and predicted percentages are shown in parentheses in the table below the graph. The closeness of obtained scale scores and the predicted determine accuracy. The Substance Abuse/ Dependency Scale is a classification scale (offenders meet criteria or they do not) rather than a measurement scale. For this reason it is not included in the following risk assessment analyses. There are 8,145 DRI-II Short Form test results summarized in the following analysis. DRI-II Short Form Accuracy (73 Items, N=8,145)
Note: The Substance Abuse/Dependency Scale is a classification, not a measurement scale and is not included in this analysis. The differences between obtained percentages and predicted percentages are given in parentheses. The percentage of DUI offenders falling into each risk range for each of the four DRI-II Short Form scales are presented above. As shown in this graph, the DRI-II Short Form results are very accurate. Offenders’ objectively obtained scale scores are accurate to within 2.7 percentage points of predicted. Moreover, in 14 of 16 of these comparisons obtained percentages were within two percentage points of the predicted. These results confirm again that the Alabama DRI-II Short Form accurately assesses Alabama DUI offender risk. Accurate risk range percentile scores means that the DUI offenders’ DRI-II Short Form 1 |
test results accurately measured offenders’ problems. For example, an Alcohol Scale score in the problem risk range (70 to 89th percentile) means that these offenders have a drinking problem. The offender’s DRI-II Short Form scale scores accurately represent offenders’ actual risk. How accurate are these scores? The DRI-II Short Form is nearly 98 percent accurate. This percent was shown in the above table for each of the 16 comparisons. The numbers in parentheses were almost all less than two percent. In summary, the DRI-II Short Form is again demonstrated to be a very accurate test. Measurement scales are accurate, trustworthy and dependable. Reliability of the DRI-II Short Form Within-test reliability, or inter-item reliability coefficient alphas for the DRI-II Short Form are presented in the table below. Alpha levels of .75 are generally accepted for test reliability. Alpha coefficients above .85 are considered very reliable. There are 8,145 DUI offenders included in this analysis.
*The Substance Abuse/Dependency Classification Scale is a classification as opposed to a measurement scale derived from DSM-IV criteria. Dependency and abuse items do not measure the extent to which predicted criteria are met. However, the Substance Abuse/Dependency Scale’s coefficient alpha is included here because it demonstrates that DSM-IV dependency and abuse items as incorporated in the DRI-II are also reliable. All DRI-II Short Form scales have Alpha coefficients that are well above the professionally accepted standard of .75. Indeed, four scales are between .85 and .86, and one scale is at .91. High reliability coefficients have been demonstrated by DRI-II and DRI-II Short Form scales consistently year after year. These reliability coefficients are very impressive. Tests must be statistically reliable before they can be considered accurate. These results show that the DRI-II Short Form is a highly reliable DUI risk assessment instrument. In summary, the DRI-II Short Form has again been demonstrated to be a reliable assessment instrument. Scale scores Alpha Coefficients are at or above .85 which means they are trustworthy and dependable. Validity of the DRI-II Short Form Validity refers to the ability of a test to measure what it is designed to measure. It is important to consider a test’s validity. There would be no advantage in using a test that is not valid. A test that purports to measure drinking problems must accurately measure an individual’s drinking problem just as an instrument for measuring blood pressure must 2 |
accurately measure blood pressure. If the test is not valid it is not useful as a measuring instrument. DRI-II Short Form scales represent areas of inquiry while scale scores measure severity of problems. Test validity is commonly measured by administering a second criterion test that purports to measure the same thing. This was done in the DRI-II and DRI-II Short Form normative standardization studies, which are reported in the document DRI-II: An Inventory of Scientific Findings. However, it is not practical to administer criterion tests during ongoing operations because it is too time consuming. That is why unique database validity measures are utilized in this report. DRI-II and DRI-II Short Form validity has been studied in the past using criterion measures that are summarized in the DRI-II: An Inventory of Scientific Findings. Measures of severity must accurately differentiate between problem and non-problem clients. A comparison between groups selected on the basis of a known problem is a statistical validation method commonly referred to as discriminant validity. It is expected that offenders having problems would have higher scores than offenders who do not have problems. For these analyses offenders with two or more DUI arrests (multiple offenders) were defined as offenders with problems. It is predicted that multiple offenders would have higher scale scores than first offenders. The answer sheet item "Number of DUI arrests in your lifetime" was used to operationally define first offenders (1 DUI arrest) and multiple offenders (2 or more DUI arrests). The t-test comparisons between first offenders and multiple offenders for each DRI-II Short Form scale are presented in the table below. The Substance Abuse/Dependency Scale is not a measurement scale, consequently, it is not included in this analysis. DRI-II Short Form t-test comparisons between first offenders and multiple offenders. Offender status defined by number of DUI arrests.
The above table shows that mean (average) scale scores of first offenders were lower than scores for multiple offenders on all DRI-II Short Form scales except the Truthfulness Scale. As expected, multiple offenders scored significantly higher on the Alcohol, Driver Risk and Drugs Scales than did first offenders. Higher scores for multiple offenders means they have higher risk or that their problems are more severe than first offenders. With regards to the Truthfulness Scale, first offenders scored statistically higher than did multiple offenders. This result has been demonstrated many times over the years with different tests. One explanation of this result suggests that first offenders try to minimize their problems more than do multiple offenders who may be more sensitized to the availability of their court records. In other words, multiple offenders are more candid about their DUI histories or first offenders are more naïve and attempt to minimize their DUI histories. The Truthfulness Scale was demonstrated to be reliable as shown above and validity was well established in validation studies that are reported in the DRI-II: An Inventory of Scientific Findings. 3 |
This analysis shows that the Alcohol, Driver Risk and Drugs Scales results support the discriminant validity of the DRI-II Short Form. These results are important because they show that the Alcohol, Driver Risk and Drugs Scales do measure level of severity. The offenders who are thought to have more severe problems (multiple offenders) score significantly higher on these scales than the first-time offenders. These results strongly support the discriminant validity of the Alcohol, Driver Risk and Drugs Scales. Predictive validity To be considered accurate a DUI test must accurately identify problem offenders (drinkers or drug abusers). The criterion in this analysis for identifying offenders as problem drinkers or drug abusers is having been in treatment (alcohol or drug). Having been in treatment identifies DUI offenders as having had an alcohol or drug problem. If a person has never had an alcohol or drug problem it is likely they have not been treated for an alcohol or drug problem. In the DRI-II Short Form, treatment information is directly obtained from DUI offenders. Thus, offenders can be separated into two groups, those who had treatment and those who have not had treatment. It is predicted that DUI offenders with an alcohol or drug treatment history will score in the problem risk range or above (70th percentile and above) on the Alcohol and Drugs Scales, respectively. Alcohol and Drugs Scale scores in the Low, Problem and Severe Problem risk ranges were used to represent no problem and problem groups, respectively. Substance abuse treatment information is obtained from offender answers to DRI-II Short Form test items (#26, #49 & #70) regarding alcohol and drug treatment. For the Drugs Scale item #49 refers to attendance at Narcotics Anonymous or Cocaine Anonymous. The Alcohol Scale correctly identified over 93 percent of DUI offenders who have alcohol problems. There were 1,871 offenders who reported having been in alcohol treatment. These offenders are classified as problem drinkers. Of these 1,871 offenders, 1,740 individuals (93%) had Alcohol Scale scores at or above the 70th percentile. The Alcohol Scale correctly identified over 93 percent of the offenders categorized as problem drinkers. This high rate of correct identification represents accurate assessment of offenders who have had alcohol treatment. These results strongly support the validity of the DRI-II Short Form Alcohol Scale. The DRI-II Short Form Drugs Scale is also very accurate in identifying offenders who have drug problems. There were 820 offenders who reported having attended NA or CA meetings because of their drug problem, of these, 812 offenders, or 99 percent, had Drugs Scale scores at or above the 70th percentile. These results represent very accurate assessment. The DRI-II Short Form Drugs Scale is valid and accurate. Predictive validity of the DRI-II Short Form is demonstrated by the correct identification of problem prone offenders. In summary, the DRI-II Short Form has again been demonstrated to be a valid assessment instrument. Measures accurately differentiate between problem and non-problem DUI offenders, first and multiple offenders and the correct identification of DUI offenders that have and have not been in treatment for alcohol as well as drugs. 4 |
Substance Abuse/Dependency Scale The DRI-II Short Form Substance Abuse/Dependency Scale classifies offenders according to their responses to DSM-IV substance abuse and substance dependency criteria. If one or more of the four abuse criteria (symptoms) is answered (admission) positively the offender is classified as a substance abuser. If three or more of the seven dependency criteria (symptoms) are answered positively the offender meets the classification of substance dependency. These DSM-IV criteria are discussed in the DRI-II Orientation and Training Manual. The results of this analysis show that 18.1 percent or 1,477 offenders (18.9% of males and 14.4% of females) meet the criteria for substance dependency as defined by the DSM-IV items contained in the DRI-II Short Form. There are 4,857 offenders or 59.6 percent (60.2% of males and 56.7% of females) classified as substance abuse. 1,811 (22.2%) offenders (20.9% of males and 29.0% of females) do not meet the criteria of substance dependency or abuse. There are 721 (8.9%) offenders (9.0% of males and 8.2% of females) who reported having been diagnosed dependent in the past. In the DSM-IV if a person is once diagnosed "dependent" they are always considered dependent thereafter. The Substance Abuse/Dependency Scale classifies offenders according to DSM-IV criteria, whereas DRI-II Short Form test items measure severity or the degree to which a problem exists. Severity level lies along a continuum from low severity to high severity. In contrast, the Substance Abuse/Dependency Scale is a classification, which means offenders meet criteria or they don’t. These two elements can be contrasted by reviewing clients’ self-perceptions of their problems and desires for remediation. Objective DRI-II Short Form scale scores (e.g., Alcohol and Drugs) measure severity of use or abuse, whereas client opinions (as reflected in Section 3: items 68 through 73) are subjective and biased. The Diagnostic and Statistical Manual, 4th Edition (DSM-IV) is used throughout the United States to diagnose substance abuse (alcohol and other drugs) disorders. Since many CRO’s are not certified/licensed mental health providers, diagnostic terms are used very carefully in the DRI-II and DRI-II Short Form. These tests (DRI-II) classify DUI offenders as problem prone, e.g., abuse, dependent or non-pathological. The CRO can then decide whether or not to refer classified offenders to certified/licensed mental health providers for a more comprehensive evaluation, diagnosis (when appropriate) and written treatment plan. DRI-II Short Form Client Self-Perceptions The clients’ responses presented in the table below represent the client's own opinions (along with their biases) about his or her problems, as well as their motivation for help. There were 8,145 clients included in this analysis (6,788 males and 1,357 females). As noted above, these percentages represent offender opinions (with all of their biases). Consequently we can anticipate problem minimization, particularly in court-related settings. Nearly two-thirds of the offenders were first time offenders. Their DUI arrest could be an isolated event or it could be an indication that the individual has a drinking or drug problem. That is why screening for substance (alcohol and other drugs) abuse is so important. There is no doubt all DUI offenders are a driver risk. For these offenders, 35.1% of the males and 26.6% of the females stated their drinking was either a serious, moderate or mild problem. 11.1% of the males and 8.5% of the females stated their drug use was a serious, moderate or mild 5 |
Substance Abuse/Dependency Scale The DRI-II Short Form Substance Abuse/Dependency Scale classifies offenders according to their responses to DSM-IV substance abuse and substance dependency criteria. If one or more of the four abuse criteria (symptoms) is answered (admission) positively the offender is classified as a substance abuser. If three or more of the seven dependency criteria (symptoms) are answered positively the offender meets the classification of substance dependency. These DSM-IV criteria are discussed in the DRI-II Orientation and Training Manual. The results of this analysis show that 18.1 percent or 1,477 offenders (18.9% of males and 14.4% of females) meet the criteria for substance dependency as defined by the DSM-IV items contained in the DRI-II Short Form. There are 4,857 offenders or 59.6 percent (60.2% of males and 56.7% of females) classified as substance abuse. 1,811 (22.2%) offenders (20.9% of males and 29.0% of females) do not meet the criteria of substance dependency or abuse. There are 721 (8.9%) offenders (9.0% of males and 8.2% of females) who reported having been diagnosed dependent in the past. In the DSM-IV if a person is once diagnosed "dependent" they are always considered dependent thereafter. The Substance Abuse/Dependency Scale classifies offenders according to DSM-IV criteria, whereas DRI-II Short Form test items measure severity or the degree to which a problem exists. Severity level lies along a continuum from low severity to high severity. In contrast, the Substance Abuse/Dependency Scale is a classification, which means offenders meet criteria or they don’t. These two elements can be contrasted by reviewing clients’ self-perceptions of their problems and desires for remediation. Objective DRI-II Short Form scale scores (e.g., Alcohol and Drugs) measure severity of use or abuse, whereas client opinions (as reflected in Section 3: items 68 through 73) are subjective and biased. The Diagnostic and Statistical Manual, 4th Edition (DSM-IV) is used throughout the United States to diagnose substance abuse (alcohol and other drugs) disorders. Since many CRO’s are not certified/licensed mental health providers, diagnostic terms are used very carefully in the DRI-II and DRI-II Short Form. These tests (DRI-II) classify DUI offenders as problem prone, e.g., abuse, dependent or non-pathological. The CRO can then decide whether or not to refer classified offenders to certified/licensed mental health providers for a more comprehensive evaluation, diagnosis (when appropriate) and written treatment plan. DRI-II Short Form Client Self-Perceptions The clients’ responses presented in the table below represent the client's own opinions (along with their biases) about his or her problems, as well as their motivation for help. There were 8,145 clients included in this analysis (6,788 males and 1,357 females). As noted above, these percentages represent offender opinions (with all of their biases). Consequently we can anticipate problem minimization, particularly in court-related settings. Nearly two-thirds of the offenders were first time offenders. Their DUI arrest could be an isolated event or it could be an indication that the individual has a drinking or drug problem. That is why screening for substance (alcohol and other drugs) abuse is so important. There is no doubt all DUI offenders are a driver risk. For these offenders, 35.1% of the males and 26.6% of the females stated their drinking was either a serious, moderate or mild problem. 11.1% of the males and 8.5% of the females stated their drug use was a serious, moderate or mild 6 |
problem. This is a substantial number of people admitting to having alcohol and drug problems. Similarly a large percentage of offenders indicated they were interested in getting help for their drinking (16.7% males and 14.9% females) and drug use (10.0% males and 8.1% females) problems. These statistics reflect a growing number of offenders that consider their drinking and drug use serious enough to want help.
Nearly one-fourth of the males (18.1%) and 14.1 percent of the females reported having been in an alcohol treatment program (#26). Comparing these percentages with the percentages that admitted to a drinking problem (#38) there is fairly close agreement. However, there were also 37.6 percent of the offenders that had 2 or more DUI arrests (multiple offenders). The percentage of offenders who admit to having a drinking problem is less than half of the percentage of offenders who have two or more DUI arrests. Many multiple offenders are reluctant to admit to a drinking problem, particularly in court-related settings. 7 |
Summary The DRI-II Short Form was administered to 8,145 Alabama DUI offenders. There were 6,788 males (83.3%) and 1,357 females (16.7%). The offender population is broadly defined as Caucasian (74.9%) or Black (21%), 21 through 40 years of age (58.3%), High School Graduate or better (64.6%) and single (44.3%). DRI-II Short Form Accuracy, Reliability and Validity DUI Arrests (DUI offender self-report) Blood Alcohol Concentration Level at Time of Arrest (DUI offender self-report) Alcohol and Drug Problems (DUI offender self-report) 8.8% of males and 9.6% of females indicate they are recovering drug abusers or both recovering drug abusers and recovering alcoholics 8 |
Summary, continued
Number of DUI Offenders There were a total of 8,145 DUI offenders tested with the Driver Risk Inventory-II Short Form (DRI-II Short Form) contained on returned diskettes. These test diskettes were returned from October 1, 2000 to September 16, 2001. These test results have not been included in any prior report.
Demographics The average age of all of the offenders tested was 34.7 years of age. The males average age was 34.8 and the average age of the females was 34.4. Nearly two-thirds of the offenders had a high school education or better. 41.4 percent graduated from high school, 17.2 percent attended college and 5.9 percent of the offenders graduated from college. Over 35 percent of the offenders did not complete high school.
DUI Arrests by Offender Status First offenders are defined as offenders who were
arrested for DUI for the first time, whereas multiple offenders have been
arrested for DUI two or more times. For the 6,788 male offenders tested 4,075 or 60.0 percent were first offenders. 2,713 or 40.0 percent of the males were multiple offenders. Of the 1,357 females tested 1,009 (74.4%) were first time offenders. 348 or 25.6 percent of the females were multiple offenders.
Summary, continued 9 |
Number of DUI Arrests The number of DUI arrests that the offenders had in their lifetime is shown in the following graph. This information is provided by the offenders on their DRI-II Short Form answer sheets. There were 90 tests for which the offenders did not provide the number of DUI arrests information on their answer sheets and these tests were left out of this analysis.
Blood Alcohol Content Levels The average BAC or Blood Alcohol Content level for the DUI offenders tested who reported their BAC at the time of their arrest is shown in the following graph. The average BAC for the males was 0.1378 and 0.1382 for the females. For all offenders the average BAC was 0.138. The number of offenders that reported their BAC is 5,124. 10.9% (or 887 offenders) of the offenders stated they refused the BAC test at the time of their arrest and 26.2 percent (or 2,132 offenders) of the offenders did not provide their BAC level at the time they completed the DRI-II Short Form.
The average BAC of 0.138 is well above the legal limit for intoxication. 32% of the offenders who reported BAC had levels between .08 and .14. Over 14 percent of the offenders had BAC at .18 or higher. That is over 14 percent of the DUI offenders who reported their BAC had a high BAC level.
10 |
Appendix
DRI-II Short Form Client Demographics and Self-Reported Court History
Note: There were 176 cases with missing education information.
Note: There were 1,329 cases with missing information. 11 |
DRI-II Short Form Offender
Court-Related History, continued
Note: There were 90 cases with missing DUI arrest information. Number of First Offenders and Multiple Offenders
Note: A Multiple Offender is an offender who reported two or more DUI arrests.
Note: There were 50 cases with missing information. Note: There were 57 cases with missing information. 12 |
DRI-II Short Form Offender
Court-Related History, continued
Note: There were 6,583 cases with missing information. Note: There were 6,040 cases with missing information.
Note: There were 233 cases with missing information. Note: There were 139 cases with missing information.
Note: There were 131 cases with missing accidents information. Note: There were 131 cases with missing information.
Note: There were 133 cases with missing information. Note: There were 127 cases with missing information.
13 |
DRI-II Short Form Offender
Court-Related History, continued
Note: There were 115 cases with missing DUI school attendance information.
Note: There were 159 cases with missing information. Note: There were 155 cases with missing information.
Note: There were 102 cases with missing information. Note: There were 63 cases with missing information.
Note: There were 4,389 cases with missing information.
The above information was provided by Alabama DUI offenders on their DRI-II Short Form answer sheets at the time they completed the test. All information was contained on returned DRI-II Short Form diskettes from Alabama DUI providers. There are diskettes still in use that have not been returned and those tests are not included in this report. 14 |
Annual Summary Reports are prepared for a variety of tests in different assessment settings: courts, probation departments, correctional settings, prisons, agencies, substance (alcohol and other drugs) treatment settings, state DUI/DWI programs, group practices and health care providers offices.
If interested in obtaining an annual summary report, contact Risk & Needs by mail, telephone (602) 234-3506, fax (602) 266-8227 or e-mail hhl@riskandneeds.com.
We hope this Annual Summary Report webpage was both interesting and helpful.
How to
Order Tests |
New Client Orders |
Agreement and Proposals |
Test Unit Fee (Cost) |
Tests Functionally Grouped |
Home | About BDS
Unique Features |
Tests Functionally Grouped
Frequently Asked Questions |
Agreement and Proposals
Guest Log -
Contact Us
Copyright 2003 - Risk & Needs Assessment, Inc. - All Rights Reserved