SELF ASSESSMENT INDEX

SELF-ASSESSMENT INDEX (SAI)

The Self-Assessment Index (SAI) differs from other tests in that it was designed specifically for welfare-to-work recipient screening. What other test measures cloaked issues like recipients' truthfulness, substance (alcohol and other drugs) use, barriers to employment and recipients' abilities to handle stress? The SAI has empirically demonstrated reliability, validity, and accuracy. And, the SAI is affordable.

Developed Specifically for Welfare-Recipient Screening

The Self-Assessment Index (SAI) is designed to screen welfare recipients applying for welfare-to-work programs. The SAI has 103 items and takes 30 minutes to complete. Automated (computer-scored) reports are available on-site within two minutes of data entry. The SAI has five measures (scales): 1. Truthfulness Scale, 2. Alcohol Scale, 3. Drugs Scale, 4. Work Index Scale and 5. Stress Coping Abilities Scale. The SAI measures recipient truthfulness, quantifies substance (alcohol and other drugs) use or abuse, evaluates work attitudes and assesses stress coping abilities. The SAI is much more than just another alcohol or drug test.

Two versions of the SAI
SAI and SAI-c

Some employment program directors wanted to use the SAI, but wanted to replace terms like "welfare recipient" or "welfare-to-work" with words like "client," "individual, " "person" or "program." Consequently, a second version of the SAI was developed, and it is called the SAI-c. The lowercase "c" refers to the word "client." The modified vocabulary applies primarily to the wording of the report. Interested parties are provided example SAI or SAI-c reports. They then specify which version (SAI or SAI-c) they want when ordering. The SAI is recommended for welfare-to-work programs; whereas, the SAI-c is recommended for more generic job skills programs. To review the SAI report, click on the SAI Example Report link. To review the SAI-c report, click on the SAI-c Example Report link. Although the remainder of this webpage refers to this Self-Assessment Index (SAI), it should be understood that it applies both to the SAI and SAI-c.  The only difference between these two tests is how their reports print.  One (SAI) refers to welfare recipients, whereas the other (SAI-c) refers to clients.

Applications
** Self-Assessment Index **
  • Assessment of welfare recipients in welfare-to-work programs.
     
  • Screening people in job training programs.
     
  • Job placement programs' applicant screening.

Five Scales (Measures)

The five Self-Assessment Index (SAI) scales are described as follows:

1. Truthfulness Scale: Measures how truthful the client (welfare recipient will be used throughout this manual) was while completing the SAI. It identifies denial, guardedness, minimization and faking. It identifies attempts to fake good.

2. Alcohol Scale: Measures the severity of alcohol use or abuse. Alcohol refers to beer, wine and other liquor.

3. Drugs Scale: Measures the "other drugs" use and abuse. Drugs refer to marijuana, crack, ice, cocaine, amphetamines, barbiturates and heroin. This scale measures the severity of illicit drug use or abuse.

4. Work Index Scale: Measures attitude and motivational factors that influence welfare recipients’ work-related attitudes and behavior.

5. Stress Coping Abilities Scale: Measures how effectively the welfare recipient handles stress. Aside from alcohol and drugs, a common relapse trigger is stress -- or more specifically, how the individual copes with stress (anxiety and pressure).

Many of these factors (expense, transportation, family support, child care responsibilities, etc.) are subtle but important barriers to job training and employment. Other factors are more visible (substance abuse and stress coping) and equally important.

The SAI assesses attitudes and behaviors yielding a welfare recipient profile. The SAI was developed specifically for welfare-to-work evaluation. The SAI is much more than just another alcohol or drug test; consequently, it measures important attitudes/behaviors missed by other tests. It is brief (103 items) yet effective when screening barriers to employment.

* * * * *

Why use the SAI? Early detection of welfare recipients’ barriers to employment facilitates quicker intervention, which increases the probability of successful employment. This type of information can also help in selecting job skill training objectives.

At one sitting of approximately 15 to 20 minutes' duration (testing time), staff can acquire a vast amount of welfare recipient information, which facilitates timely intervention and improves job placement success.

TOPICS FOR EASY REFERENCE
The following links provide quick access to some of the unique features of the Self-Assessment Index (SAI) that will be described later in this webpage.
Truthfulness Scale Free Examination Kit
Confidentiality Scale Interpretation
Reliability & Validity Test Comparison Checklist
3 Ways to Administer Example SAI-c Report
SAI Interpretation Example SAI Report
Test Unit Fee
(Cost)
SAI Research Study
Reading Impaired
Assessment
Free Annual Summary Reports

 

"Comprehensive Yet Affordable Screening"

Advantages of Screening. Assessment or screening instruments (tests) filter out individuals with serious problems that represent barriers to employment. Serious or severe problems may warrant referral for intervention (e.g., AA, NA or CA meetings or stress management groups) or treatment (e.g., counseling). This filtering system works as follows:

SAI Risk Ranges
Risk Category Risk Range Percentile Total Percentage
Low Risk 0-39% 39%
Medium Risk 40-60% 30%
Problem Risk 70-89% 20%
Severe Risk 90-100% 11%

Reference to the above table shows that a problem is not identified until a scale score is at or above the 70th percentile. These risk range percentiles are based upon the SAI’s expanding database. This procedure is fair and avoids extremes, i.e., over-identification or under-identification of problems.

A department or agency's policy might refer clients with  "severe" problem (11%) for further evaluation, intervention or treatment services. In this case, eleven percent (11%) of the people screened (Severe Problem, 90th  to 100th percentile score) would be referred. 

Or, contingent upon staff adopted policy, people with problems and severe problems might be referred. In this case, thirty-one percent (31%) of the people screened (Problem Risk and Severe Problem) would be referred.

In these examples, 89% or 69% (contingent upon adopted policy) of the people screened would not be referred for additional (and expensive) services. Budgetary savings (dollars) would be large with no compromises in clients receiving appropriate evaluation and/or treatment services. Indeed, more welfare recipients would receive needed help. Without a screening program, there is usually more risk of over or under-utilization of additional professional services.

Test Booklets. SAI test booklets are provided free. These booklets contain 103 items (true/false and multiple choice) and are written at a 5th to low 6th grade reading level. If a person can read the newspaper, they can read the SAI.

Reports. In brief, SAI reports summarize the welfare recipient’s self-report history, explain what attained scale scores mean and offer score-related recommendations.

Within two (2) minutes of test data entry, automated (computer-scored) 3-page reports are printed on-site. These reports summarize a lot of information in an easily understood format. For example, reports include an SAI profile (graph), which summarizes scale scores at a glance. Also included are attained scale scores, an explanation of what each score means and specific score-related recommendations. In addition, significant items (direct admissions) are highlighted, and answers to a built-in interview (last sequence of questions) are presented. Emphasis is placed on having meaningful reports that are helpful and easily understood.

To go directly to the example SAI report, click on the SAI Report link. After reviewing the report, you can return to this section by clicking on the "Return to SAI Reports Section" link.

Reliability, Validity and Accuracy. The SAI has a built-in database that insures inclusion of all administered tests in a confidential database (no names) manner. This database facilitates annual database analysis of the SAI, and this includes reliability, validity and accuracy determinations. Research and statistical findings are reported in a separate document titled "SAI: An Inventory of Scientific Findings." Annual database analysis further demonstrates that SAI scales have high reliability and validity.

For example, internal consistencies (coefficient alphas) for SAI scales are reported in the following table for some welfare recipients (N=510) screened in the year 2002. This is one among several samples.

An SAI research study is presented at the end of this webpage. To go directly to this research, click the SAI Research Study link.

"Demonstrated Reliability, Validity and Accuracy"

SAI Reliability (N=510, 2002)
SAI Scales Coefficient Alpha Significant Level
Truthfulness .85 p<.001
Alcohol .88 p<.001
Drugs .86 p<.001
Work Index .84 p<.001
Stress Coping Abilities .84 p<.001

All SAI scales have alpha coefficients well above the professionally accepted standard of .75 and are very reliable. All coefficient alphas are significant at the p<.001 level.

Early validity studies used criterion measures, and SAI scales were validated with other tests, e.g., MMPI L-Scale and F-Scale. Much of this research is summarized in the document titled "SAI: An Inventory of Scientific Findings." Subsequently, additional database research has been completed that supports SAI reliability, validity and accuracy.

Fairness goes beyond reliability and validity. The term applies to accuracy for demographic groups like gender and ethnicity. This research is ongoing. The SAI is a fair test.

Software. The SAI is available on MS-DOS or Windows diskettes. MS-DOS diskettes contain all their own software. Windows diskettes require a one-time computer setup procedure after which SAI data diskettes are used to score and print reports. Training manuals are provided free. New test users can be walked through the scoring procedure over Risk & Needs Assessment, Inc.'s (Risk & Needs') telephone line.

Proprietary SAI diskettes contain 25 or 50 test applications. These 3½" or 5¼" diskettes score, interpret and print reports on-site. Once an SAI account is established, ordered diskettes are mailed to users. Approximately 97% of orders are mailed back to users the same day. When all test applications are used, that diskette is returned to Risk & Needs where the demographics are downloaded into the SAI database for subsequent database analysis. The proprietary "delete names" program is activated by the test user with a few keystrokes to delete all welfare recipient names from the diskette before it is returned. Deleting all recipient names insures protection of each welfare recipient’s confidentiality and compliance with HIPAA (federal regulation 45 C.F.R. 164.501).

The "SAI: Orientation and Training Manual" explains how the SAI works and should be read by staff. The "SAI: Computer Operating Guide" explains how to score tests, print or store reports and discusses other unique SAI computer-related functions.

Database. The SAI system contains a proprietary built-in database. Earlier, it was noted that all used SAI diskettes are returned to Risk & Needs, and the test data is downloaded into the SAI database. This expanding database allows ongoing research and annual summaries of testing programs -- features that were not possible before. Ongoing research ensures quality control. Annual testing program summaries provide for program self-evaluation. The SAI Research link gives access to an SAI research study; whereas the Annual Summary Reports link takes you to an example summary report. Both the ongoing research and summary reports are provided to test users free.

Built-in Database. The SAI system contains a proprietary built-in database. And, the SAI permits ongoing research and annual program summary -- at no additional cost. As discussed earlier, when the 25 or 50 tests on a diskette are used, used diskettes are returned to Risk & Needs, checked for viruses and downloaded into the expanding SAI database. Advantages of this proprietary database are many and include database (research) analysis and annual summary reports.

Returned diskettes can be summarized on a state, department or agency basis -- at no additional cost to users. Annual summary reports provide information that permits testing program review. The Annual Summary Reports link takes you to an example summary report.

In summary, all returned SAI diskettes' test data is centrally filed in the SAI database at Risk & Needs' offices. This database has many advantages. Database analysis permits ongoing cost-efficient research that includes scale alpha coefficients, ANOVA, frequency distributions, correlations, cross-tab statistics along with reliability, validity and accuracy determinations. The Research Study link takes you to an SAI research study.

Annual Summary Reports

Risk & Needs can access each of its tests' built-in databases for statistical analysis and summarization of all tests administered in a year. Annual Summary Reports are prepared for state, department, agency and even some individual providers -- at no cost to them. These reports are provided as a professional courtesy to large volume test users. Summary reports include demographics, court-history when relevant, and test statistics (reliability, validity and accuracy). Has anyone offered to summarize your testing program? Annually? At no additional cost to you? Minimum testing volume for annual reports is 350 tests. There is no maximum limit. Risk & Needs' annual reports range in size from 350 tests to over 55,000 tests annually. An example Annual Summary Report can be viewed by clicking on this Annual Summary Reports link.

Staff Member Input. The SAI is to be used in conjunction with experienced staff judgment. Staff should also interview the welfare recipient.

For these reasons, the following statement is contained in each SAI report: "Self-Assessment Index results are confidential and are working hypotheses. No decision should be based solely upon these results. These test results are to be used in conjunction with experienced staff judgment and review of available records."

"Provides a Sound Empirical Basis for Decisions"

Why develop the SAI? Job training placement and vocational success often depends upon helping welfare recipients overcome barriers to employment. Many of these barriers to employment include substance (alcohol and other drugs) abuse, self-defeating work attitudes and poorly developed stress coping abilities. Welfare-to-work programs are most effective with early identification of barriers to work so that staff can help participants overcome these obstacles. The SAI was designed specifically to meet these needs -- early identification of barriers to work.

How do you know if the welfare recipient is minimizing problems or even lying? The SAI has a Truthfulness Scale that determines how truthful the recipient was while completing the test. This scale identifies problem minimization and detects faking. And, the SAI doesn’t stop there. Error of measurement due to untruthfulness is measured for each scale and converted to Truth-Corrected scores. Raw scores only reflect what the recipient wants staff to know. Truth-Corrected scores reveal what the recipient is trying to hide. Truth-Corrected scores are more accurate than raw scores.

Unique SAI Features

Truthfulness Scale. Measures how truthful the recipient was while completing the SAI. This scale identifies denial, problem minimization and faking. Many welfare recipients attempt to minimize their problems. The SAI Truthfulness Scale has been validated with other tests, truthfulness studies and the Minnesota Multiphasic Personality Inventory (MMPI) L and F-Scales. It consists of a number of items the majority of people in our society agree or disagree with. This important scale has been repeatedly demonstrated to be reliable, valid and accurate. Much of this research is reported in the document titled "SAI: An Inventory of Scientific Findings."

"More Accurate Assessment with Truth-Corrected Scores"

Truth-Corrected Scores. Truth-Corrected scores have proven to be important in enhancing assessment accuracy. It is important to know if the welfare recipient answered test items truthfully. The SAI Truth Correction program is comparable to the MMPI K-Scale correction methodology. The SAI Truthfulness Scale has been correlated with the other four SAI scales. The Truth Correction equation then converts raw scores to Truth-Corrected scores. As noted above, raw scores reflect what the recipient wants you to know. Truth-Corrected scores reveal what the recipient is trying to hide. Truth-Corrected scores are more accurate than raw scores.

Work Index Scale. The Work Index Scale measures attitude and motivational factors that influence welfare recipients' success in welfare-to-work programs and their subsequent employment.

Attitudes are complex products of experience and learning that include enduring preferences, aversions, prejudices and beliefs. Attitudes can be overt or covert, yet they influence our behavior. Many attitudes, such as the perceived value of work, the impact of work-related expenses, transportation concerns, the influence of family support (or the lack of it), child care responsibilities, the effort involved, welfare recipient commitment, etc. influence the success of welfare-to-work programs and subsequent employment success. Moreover, negative attitudes increase the probability of program failure because they can become barriers to program completion and employment. The Work Index Scale helps us better understand the welfare recipient’s attitudes and motivation.

Substance Abuse Screening. Substance abuse screening is important because alcohol and/or drug use is often associated with vocational rehabilitation failures. The Alcohol Scale identifies alcohol use and measure the severity of abuse. The Drugs Scale identifies illicit drugs use and measures the severity of abuse. Inclusion of these two scales helps identification of a person’s substance of choice and polysubstance abuse. Substance abuse is acknowledged as an all too common barrier to employment.

Stress Coping Abilities Scale. The Stress Coping Abilities Scale measures how well the welfare recipient handles tension, pressure and stress. This scale goes beyond establishing whether or not the welfare recipient is experiencing stress. It determines how well the welfare recipient handles or copes with stress. Stress exacerbates emotional and mental health symptoms. Consequently, this scale is a non-introversive way to screen established (diagnosable) mental health problems. A welfare recipient scoring at or above the 90th percentile on the Stress Coping Abilities Scale should be referred to a certified/licensed mental health professional for a diagnosis, prognosis and treatment plan, as warranted. This important area of inquiry is missed by other welfare-to-work tests.

More than just another alcohol or drug test. In addition to alcohol and drugs, the SAI assesses other important areas of inquiry like truthfulness, work attitudes and stress coping abilities. The SAI is designed specifically for welfare-to-work programs.

Three ways to give the SAI. The SAI can be administered in three different ways: 1. Paper-pencil test booklet format. This is the most popular testing procedure. 2. The SAI can be given directly on the computer screen. And, 3. Human voice audio involves a computer and headset. The recipient uses the up-down arrow keys. As the welfare recipient goes from question to answer with the arrow keys, that question or answer is highlighted on the monitor (screen) and simultaneously read to the client.

These three test administration modes are discussed in the "SAI: Orientation and Training Manual." Each test administration mode has advantages and some limitation. Risk & Needs offers these three test administration modes so test users can select the one that is best suited to their needs.

Reading impaired assessment. Reading impaired recipients represent 20+ percent of welfare recipients tested. This represents a serious problem to other welfare recipient tests. In contrast, Risk & Needs has developed a proprietary alternative for reading impaired assessment, which is termed "human voice audio."

Human voice audio. Human voice audio is available in English and Spanish. It helps resolve many reading and cultural difference issues. A person’s passive vocabulary (what they hear and understand) is often greater then their active (spoken) vocabulary. Hearing items read aloud often helps reduce cultural and communication problems. Human voice audio test presentation requires a computer, earphones and simple instructions regarding how to operate the up-down arrow keys on the computer keyboard. Without this "human voice audio" option, a welfare-to-work program could be limited.

Confidentiality. Risk & Needs encourages users to delete recipient names from diskettes before they are returned to Risk & Needs. This proprietary name deletion procedure involves a few keystrokes. Once welfare recipient names are deleted, they are gone and cannot be retrieved. Deleting names does not delete demographics or test data, which is downloaded into the SAI database for subsequent analysis. This procedure insures client confidentiality and compliance with HIPAA (federal regulation 45 C.F.R. 164.501).

Test data input verification. This proprietary program allows the person that inputs data from the answer sheet into the computer to verify the accuracy of their data input. In brief, test data is input twice, and any inconsistencies between the first and second data entries are highlighted until corrected. When the first and second data entries match or are the same, the staff person may continue. Use of this data input verification procedure is optional, yet strongly recommended by Risk & Needs.

Inventory of Scientific Findings. Much of the SAI research has been gathered together in one document titled "SAI: An Inventory of Scientific Findings." This document summarizes SAI research chronologically -- as the studies were completed.

"More Than Just Another Alcohol and Drugs Test"

This innovative chronological reporting format was established largely because the SAI database permits annual database analysis of all tests administered that year. It also allows the reader to observe the evolution of the SAI into a state-of-the-art welfare-to-work test.

Orientation and Training Manual. The "SAI: Orientation and Training Manual" (O&T Manual) explains how the SAI works. This manual is a must read for staff that will be using the SAI. O&T Manual content includes, but is not limited to, the following: testing instructions, an explanation of how attained scale scores are derived, an interpretation of attained scale scores, a description of unique SAI features and much more.

Computer Operating Guide. Some computer operators want more information than others. Consequently, Risk & Needs provides a One-Page Quick Start, which includes basic instructions for scoring SAI’s, and a more comprehensive Computer Operating Guide. The Computer Operating Guide contains instructions for using MS-DOS as well as Windows software. This manual discusses hardware, software, scoring, printing reports, unique program features and much more.

Staff training. Risk & Needs' staff are available to participate in SAI training programs scheduled by test users in the United States. Large departments/agencies or statewide programs often are interested in SAI training. Sometimes, smaller agencies or departments get together for a joint SAI training session. Risk & Needs gives attendees certificates attesting to their SAI training.

Staff training is also provided on Fridays at Risk & Needs' Phoenix offices from 8:30 a.m. to 11:30 a.m. or from 1:30 p.m. to 4:30 p.m. These training sessions are free. To participate, contact Risk & Needs at least ten days in advance. Participation is on a first call, first scheduled basis.

SAI-c. The SAI has been modified to be more generic. Terms such as welfare recipient and welfare-to-work programs were replaced with terms like client, individual, applicant, person and program. The SAI-c test booklet and report incorporated these changes while the test remains essentially the same as the original SAI.

In summary, there are two versions of the SAI, and these are the SAI and the SAI-c. The lowercase "c" represents "client." The SAI-c is appropriate for use in job training, employment readiness and other employment programs. Interested parties can be provided additional information upon request. The SAI is recommended for welfare-to-work programs; whereas, the SAI-c is recommended for more generic job skills and employment-related programs. Click on the SAI-c link to review the SAI-c report.  Interested SAI-c parties should call Risk & Needs to request an SAI-c 1-test demonstration diskette on a 30-day free basis.

Click on the SAI Report link to review the SAI report. Click on the SAI-c Report link to review the SAI-c report. Comparison of these two reports can help in deciding which report best meets your needs.

SAI and SAI-c scales (measures) include: 1. Truthfulness Scale, 2. Alcohol Scale, 3. Drugs Scale, 4. Work Index Scale and 5. Stress Coping Abilities Scale. Both the SAI and the SAI-c have 103 items and take 15 to 20 minutes to complete. And, SAI as well as SAI-c reports are available on-site within two minutes of data entry.

Epilogue

The Self-Assessment Index (SAI) is the product of over 25 years of licensed psychologists' experience evaluating patients, court defendants, employment disability applicants, Job Training Partnership Act (JTPA) participants, worker compensation clients and unemployment compensation recipients. This experience augments years of psychometric research.

The goal from the beginning has been to develop a practical, helpful and psychometrically sound welfare-to-work assessment and screening instrument. Practical in the sense that it is appropriate for the predominately female welfare recipient participant. The testing also needs to be completed in a timely fashion. Helpful in terms of identifying barriers to employment. And, it must be psychometrically sound with regard to reliability, validity and accuracy.

Risk & Needs' staff are proud of the SAI and believe we have attained the goals set forth above, i.e., a practical, helpful and psychometrically sound test.

SAI scales were conceptualized to address common barriers to welfare-to-work success. Five SAI scales (measures) were decided upon because they explore the most common barriers to employment. These 5 scales include: 1. Truthfulness Scale, 2. Alcohol Scale, 3. Drugs Scale, 4. Work Index Scale and 5. Stress Coping Abilities Scale.

Welfare-recipient evaluation or testing has to overcome the recipient’s worry, concern or fear that their children will be taken away from them because of their negative work attitudes, mental health problems or substance (alcohol and other drugs) abuse. In programs that do little to resolve these concerns (or inadvertently magnify them), it is difficult to get recipient test-related compliance. Consequently, welfare-to-work tests must be designed to accommodate and overcome these fears. The Self-Assessment Index (SAI) is uniquely designed to overcome such barriers to welfare-recipient compliance. Few, if any, other tests can overcome these assessment or screening concerns.

The Work Index Scale is innovative in that it acknowledges the importance of welfare recipients’ attitudes toward work, training and subsequent employment.

Hopefully, this dialogue explains why the SAI is one of the very few tests designed specifically for welfare-recipient screening. In conclusion, we know user feedback is important. We want to assure SAI users that we will listen to their suggestions. We appreciate SAI user feedback whether it be by telephone, e-mail, fax or letter.

Support Services. Risk & Needs provides a full range of support services that includes: information (descriptive materials, demo diskette and staff presentations);  telephone line (602-234-3506); staff training (manuals, high volume users' on-site presentations); first time user (telephone walk-through scoring); ongoing support (test-related software); SAI updates (no additional cost); free SAI materials (test booklets and training manuals); and other (as long as it’s SAI related) support services. Risk & Needs is committed to providing SAI support services to interested parties and test users.

Test Unit Fees (Cost): SAI cost information can be reviewed by clicking on the Test Unit Fee (Cost) link. There is only the one cost or charge, and that is the test unit fee. Everything else is included at no additional cost to the test user. This includes test booklets, answer sheets, training manuals, upgrades, ongoing database research, annual summary testing reports, staff training, and support services. Do not be misled by some test publishers' à la carte pricing like separate costs for each test administration as well as for each of the test-related items listed above. Instead of asking for the test administration cost, ask for the total cost involved in using a test. We believe Risk & Needs' one test unit fee is very affordable.

Free Examination Kit: A 1-test SAI demonstration diskette is available on a 30-day cost free basis. Demo diskettes are in MS-DOS format so that the software is contained on the diskette. This way, the one-time Windows setup program is avoided at the demo level. The examination kit contains a 1-test demo diskette, test booklet (reusable), an answer sheet (can photocopy), an "SAI: Orientation and Training Manual," One-Page Quick Start and some descriptive information. Risk & Needs does want the demonstration diskette and test booklet returned within 30 days of receipt. To request a free examination kit, click on the Free Examination Kit Request link.

How to Proceed: To become a Risk & Needs test user, click on the Agreement & Proposals link, click on the Print Client User Agreement button and fax the completed form to (602) 266-8227, or mail your completed form to Risk & Needs. Upon its receipt by Risk & Needs, you become a Risk & Needs test user and can order tests. Established Risk & Needs test users can reorder by mail, telephone, fax or e-mail.

Other related links are listed for reference. They are available as needed.

    Test Unit Fee (Cost) webpage link. Explains Risk & Needs' Test Unit Fees or Costs.
    New Client Order webpage link. Explains steps to become a "new Risk & Needs client."
    How to Order webpage link. Explains how Risk & Needs tests can be ordered.

Additional information can be provided upon request. Contact Risk & Needs Assessment, Inc., P.O. Box 44828, Phoenix, Arizona 85064-4828. Risk & Needs' telephone number is (602) 234-3506, our fax number is (602) 266-8227 and our e-mail address is hhl@riskandneeds.com.

Selecting a Welfare Recipient Assessment or Screening Instrument

If you are selecting a welfare recipient assessment instrument or test, the following Comparison Checklist should be helpful. This checklist itemizes important assessment and screening qualities. The "Other" column represents any other test you might want to compare to the Self-Assessment Index (SAI).

TEST COMPARISON CHECKLIST
COMPARISON CATEGORIES SAI Other
Designed Specifically for Welfare Recipients Yes  
Test Reliability and Validity Research Provided Yes  
Test Completed in 15 to 20 Minutes Yes  
On-Site Reports within 2 Minutes Yes  
Truthfulness Scale to Detect Faking Yes  
Truth-Corrected Scores for Accuracy Yes  
Three Test Administration Options Yes  
     1. Paper-Pencil (English and Spanish) Yes  
     2. On Computer Screen (English and Spanish) Yes  
     3. Human Voice Audio (English and Spanish) Yes  
Confidentiality (Delete Names Procedure) Yes  
HIPAA (federal regulation) Compliant Yes  
Test Data Input Verification (Accurate Scoring) Yes  
Built-in Database Yes  
Annual Database Research (free) Yes  
Annual Testing Program Summary (free) Yes  
SAI-c (More Generic Version of the SAI) Yes  
Alcohol and Drugs Scales Yes  
Work Index Scale (Measures Values and Attitudes to Work) Yes  
Stress Coping Abilities Scale Yes  
Available in MS-DOS and Windows Yes  
Standardized on Welfare-to-Work Applicants Yes  
Easily Understood and Helpful Reports Yes  
Staff Training (Free) Yes  
Examination Kits (Free) Yes  
Automated Criminogenic Structured Interview (Free) Yes  
Thirty-Day Money Back Guarantee Yes  
Very Affordable Test Unit Fee Yes  

SAI Interpretation

An example 3-page Self-Assessment Index, or SAI, report follows this discussion of the SAI interpretation. The example report is provided as a ready reference to augment this dialogue.

The following table is a starting point for interpreting SAI scores.

SAI Risk Ranges
Risk Category Risk Range
Percentile
Total
Percentage
Low Risk 0-39% 39%
Medium Risk 40-69% 30%
Problem Risk 70-89% 20%
Severe Problem 90-100% 11%

A problem is not identified until a scale score is at the 70th percentile or higher. Elevated scale scores refer to scale percentile scores that are at or higher than the 70th percentile. Severe problems are identified by scale scores at or above the 90th percentile. Problem Risk scale scores represent 20% of SAI scores. Severe Problem scores represent the highest 11% of welfare recipients evaluated with the SAI. The SAI’s normative sample continues to expand with each SAI test that is administered.

Scale Interpretation

1. Truthfulness Scale: Measures how truthful the welfare recipient was while completing the test. The Truthfulness Scale identifies guarded and defensive people who attempt to fake good. Scores at or below the 89th percentile mean that all SAI scales are accurate. Truthfulness Scale scores in the 70th to 89th percentile range are accurate because they have been Truth-Corrected. Scores at or above the 90th percentile mean that all SAI scales are inaccurate (invalid) because the recipient read things into test items that aren’t there, was minimizing problems or was faking answers. Recipients with reading impairments might also score in the 90th to 100th percentile range. If not consciously deceptive, recipients with elevated Truthfulness Scale scores are uncooperative, fail to understand test items or have a need to appear in a good light. The Truthfulness Scale score is important because it establishes whether or not the recipient was truthful while completing the SAI.

One of the first things to check when reviewing an SAI report is the Truthfulness Scale score. Truthfulness Scale scores overrule all other SAI scale scores. As noted above, Truthfulness Scale scores at or below the 89th percentile indicate that all other SAI scale scores are accurate. Truthfulness Scale scores at or above the 90th percentile do not occur by chance. Indeed, a definite pattern of deviant Truthfulness Scale item responding is necessary to obtain an elevated, let alone Severe Problem (90th to 100th percentile), score. The Truthfulness Scale can be interpreted independently.

2. Alcohol Scale: Measures alcohol use and the severity of abuse. Alcohol refers to beer, wine and other liquor. An elevated (70th to 89th percentile) Alcohol Scale score is indicative of an emerging drinking problem. An Alcohol Scale score in the Severe Problem (90th to 100th percentile) range identifies serious drinking problems.

Since a history of alcohol problems could result in an abstainer (current non-drinker) attaining a Low to Medium Risk score, precautions have been built into the SAI to correctly identify "recovering alcoholics." Several SAI items are printed in the "Significant Items" section of the SAI report for quick reference. These alcohol items include #57 (I have a drinking problem), #10 (recovering), #49 (Drinking problem), #97 (describes drinking), and #98 (recovering). In addition, the Alcohol Scale risk range paragraphs for elevated scores clearly state the recipient may be a "recovering alcoholic."

In intervention and treatment settings, the recipient’s Alcohol Scale score helps staff work through denial. The objective and standardized Alcohol Scale score is accepted by most clients, especially in comparison to a staff member's subjective opinion. It should be explained that elevated scores don’t occur by chance. A definite pattern of alcohol-related admissions is required before an elevated score can occur.

An elevated Alcohol Scale score in conjunction with other elevated scale scores indicates that alcohol use exacerbates other attitudes/behaviors, which can contribute to the other elevated SAI scores. For example, alcohol abuse can magnify attitudes/behaviors represented by an elevated Work Index Scale score. Indeed, alcohol abuse can erode and further impair a person’s stress coping abilities. In summary, the Alcohol Scale can be interpreted independently or in conjunction with other elevated scores.

3. Drugs Scale: Measures illicit drug use and the severity of abuse. Drugs refer to marijuana, cocaine, crack, amphetamines, ice, barbiturates and heroin. An elevated (70th to 89th percentile) Drugs Scale score is indicative of an emerging drug problem. A Drugs Scale score in the Severe Problem (90th to 100th percentile) range identifies serious drug abusers.

A history of drug-related problems could result in an abstainer (drug history, but not presently using drugs) attaining a Low to Medium Risk score. Precautions have been built into the SAI to correctly identify "recovering drug abusers." Several SAI items are printed in the "Significant Items" section of the SAI report for easy reference. These items include: #47 (admits drug problem), #98 (recovering), #39 (drug problem in last year), #99 (describes own drug use) and #102 (number of drug treatment programs enrolled in). In addition, the Drugs Scale risk range paragraphs for elevated scores clearly state the recipient may be a "recovering drug abuser."

In intervention and treatment settings, the recipient’s Drug Scale score helps staff work through client denial. And, an elevated Drugs Scale score in conjunction with other elevated scale scores can magnify the severity of the other elevated scores.

Concurrently elevated Alcohol Scale and Drugs Scale scores indicate polysubstance use. When both of these scale are in the Severe Problem range, polysubstance use is confirmed. The higher scale score indicates the welfare recipient's substance of choice. In summary, the Drugs Scale can be interpreted independently or in conjunction with other elevated scales.

4. Work Index Scale: Measures attitude/motivational factors that influence the welfare recipient's welfare-to-work program behavior. Many of these factors seem trivial but, when taken together, are important attitude, motivation and behavioral determinants. Some of these factors, including the welfare recipient's perceived value of work, the magnitude of work-related expenses, the need to acquire work clothes, transportation concerns, the influence or encouragement (or lack of) from significant others, family and child care responsibilities, etc. influence the welfare recipient's chances of program completion and their probability of successful employment.

An elevated Work Index Scale indicates negative or self-defeating attitudes are emerging along with motivational weakening. Work Index Scale scores in the Problem Risk (70th to 89th percentile) range are indicative of attitude and motivational problems that need to be worked through and resolved. Work Index Scale scores in the Severe Problem (90th to 100th percentile) range may warrant group or individual counseling involvement. Attitudinal change must usually occur before behavioral change.

An elevated Work Index Scale can be particularly problematic when accompanied by an elevated Alcohol or Drugs Scale score. The higher the scale scores, the more difficult the problem resolution. Substance (alcohol and other drugs) abuse tends to reinforce negativistic thinking. And, in the Severe Problem range, substance abuse can contribute to apathy, feelings of alienation, isolation, withdrawal and non-compliance.

In summary, work-related attitudes and beliefs influence welfare-to-work program success. The Work Index Scale can be interpreted independently or in conjunction with other SAI scale scores.

5. Stress Coping Abilities Scale: Measures how well the recipient copes with pressure and stress. It is now known that stress exacerbates symptoms of mental and emotional problems. Thus, an elevated Stress Coping Abilities Scale score in conjunction with other elevated SAI scale scores can help in understanding the welfare recipient’s situation. For example, when a person doesn’t handle stress well, other frustrations and concerns can be exacerbated. This problem augmentation applies to substance abuse, cooperation, attitudes, emotional conflicts and motivation.

When a Stress Coping Abilities Scale score is in the Severe Problem (90th to 100th percentile) range, it is likely that the recipient manifests an identifiable mental health problem. In these instances, referral to a certified/licensed mental health professional is warranted. In summary, the Stress Coping Abilities Scale can be interpreted independently or in conjunction with other SAI scale scores.

* * * * *

 

AN EXAMPLE SAI REPORT FOLLOWS
SAI REPORT

Self-Assessment Index (SAI) 3-page reports utilize a common outline or format, yet are highly individualized. SAI's are scored and reports printed on-site within 2½ minutes of data entry.

The first page of the SAI report begins with the recipient's name and some basic demographics (age, sex, education, etc.). The Self-Assessment Index Profile presents each scale by name, that scale's attained score and a graphic summary of SAI scale scores. A statement is made regarding the recipient's probability of program completion.  The "SAI: Orientation and Training Manual" explains how these probability statements are calculated. And, a SUMMARY paragraph is presented at the bottom of page one. This paragraph summarizes SAI findings. Page 1 concludes with a reproduction of all SAI responses (answers). Listing each client answer facilitates staff corroboration of answers to specific items.

 

SELF-ASSESSMENT INDEX
*********************
NAME: Example Report
AGE : 31   SEX: Female                              CONFIDENTIAL REPORT
ETHNICITY/RACE: Caucasian
EDUCATION/HIGHEST GRADE: 11
MARITAL STATUS: Married
DATE SCORED   : 12/11/2004


Self-Assessment Index  results are  confidential and are working hypoth-
eses.  No diagnosis  or  decision  should  be based  solely  upon  these
results. These test  results  are to be used in conjunction with experi-
enced staff judgment and review  of available records.

MEASURES          %ile                SELF-ASSESSMENT INDEX PROFILE
--------          ----         +---------------+-----------+-------+---+
                               -   LOW RISK    -   MEDIUM  -PROBLEM-MAX-
                               -               -           -       -   -
TRUTHFULNESS       39          ****************-...........-.......-...-
                               -               -           -       -   -
ALCOHOL            88          ************************************-...-
                               -               -           -       -   -
DRUGS              44          ******************..........-.......-...-
                               -               -           -       -   -
WORK INDEX         79          ********************************....-...-
                               -               -           -       -   -
STRESS COPING      45          *******************.........-.......-...-
                               +---------------+-----------+-------+---+
                               0               40          70      90 100
                               ----------- PERCENTILE SCORES -----------


               Present probability of program completion
             and obtaining or keeping a job: Below-average

                               SUMMARY
                               -------
These  SAI  results  are  accurate  and valid.  A drinking  problem  is
apparent.   A  drug  abuse   disorder  is  not   present.  Work-related
attitude,  motivation   and  people  problems  are  becoming  apparent.
Average stress coping  abilities are  established.

Elevated SAI scale scores (at or  above  the  70th  percentile)  define
difficulties,  uncertainties  and   problem  prone   behaviors.   These
problems need to be worked through  and resolved.  The  goal  continues
to be successful  vocational  rehabilitation  and  sustain  employment.
This   is   a   below-average   SAI   report.  This  client   needs  an
individualized program and help.

                    SELF-ASSESSMENT INDEX RESPONSES
                    -------------------------------
 1- 50 FTFTFFTFTF TFTFFFFFTT FTFTFFFTFF FTFTTTFTFT TFFTFTFFFT
51-103 FTFFFTFFFT T323321221 2132232131 3222232231 3333233442 444

   

 

The second page of the SAI report presents SAI scale paragraphs. Each SAI scale paragraph specifies the recipient's attained score, explains what that score means and presents score-related recommendations. SAI scales include: Truthfulness Scale, Alcohol Scale, Drugs Scale, Work Index Scale and the Stress Coping Abilities Scale.

 

NAME: Example Report          -2-           SELF-ASSESSMENT INDEX REPORT

  * * SUMMARY PARAGRAPHS EXPLAINING CLIENT'S ATTAINED SCALE SCORES * *
      ------------------------------------------------------------

TRUTHFULNESS SCALE: LOW RISK RANGE                   RISK PERCENTILE:39
This welfare recipient's Truthfulness  Scale  score  is in the low risk
(zero to 39th percentile) range.  Low  risk scorers  are usually honest
and cooperative.  They  are  sincere,  usually  truthful  and straight-
forward.  In  this evaluation milieu or setting some guardedness can be
expected, yet it is  minimal  in nature. It  is  reasonable  to  assume
that this welfare  recipient  has been telling  the  truth. This person
manifests little guile  and  communicates  straight  forwardly.   Other
scale scores are accurate.


ALCOHOL SCALE: PROBLEM RISK RANGE                    RISK PERCENTILE:88
This person's Alcohol Scale score is  in  the problem  risk (70 to 90th
percentile) range. Alcohol problems are  evident.  Either this client's
drinking is out of control or this person  is a  "recovering"  (alcohol
problem, but has  stopped drinking) alcoholic.  Relapse  risk is  high.
It  is  likely  that  drinking has a  negative effect on this  person's
work  situation,  vocational  rehabilitation and  vocational  goals. It
may be  necessary to  resolve a  drinking problem to achieve vocational
stability. Options  include chemical dependency  treatment,  outpatient
counseling or intensive outpatient  counseling  (individual or  group).
Treatment  could be  augmented by  attending Alcoholics  Anonymous (AA)
meetings.


DRUGS SCALE: MEDIUM RISK RANGE                       RISK PERCENTILE:44
Some   indicators  of drug  (marijuana,  crack, cocaine,  amphetamines,
barbiturates,  LSD,  or  heroin)  use are  present, yet an  established
pattern of abuse is not evident.  Although  drug abuse  is not a  focal
issue,  consideration  might be  given to a chemical  dependency  (drug
oriented)  educational  program, which  could head  off more  extensive
drug  involvement.  Any  drug-related court  history (e.g., arrest  for
possession or sale) would automatically upgrade    intervention  and/or
treatment  recommendations. Early  intervention  could  be advantageous
to this person's vocational or employment future.


WORK INDEX SCALE: PROBLEM RISK RANGE                 RISK PERCENTILE:79
This client's  Work  Index Scale score is in the  problem  risk  (70 to
90th percentile) range.  Many problem  risk scorers  live in  difficult
circumstances.  Money,  or the  lack of it, can  be a constant concern.
Some  family  members  may  resist  lifestyle  change.   This   welfare
recipient is attempting a very difficult thing, i.e., to  change  their
lifestyle. Group therapy (or discussion groups)  can  provide emotional
support  for  sustained  attitude   change.  Individualized  attention,
recognition of  achievements  and  help  in  clarifying  realistic  and
attainable vocational goals can also  contribute  to  program  success.
This person has some problems to overcome.



STRESS COPING SCALE: MEDIUM RISK                     RISK PERCENTILE:45
Average stress coping abilities are  evident. This  welfare recipient's
Stress Coping Abilities Scale score  is in the medium  risk (40 to 69TH

 

 

The third page of the SAI report completes the Stress Coping Abilities Scale discussion. Section 2 summarizes the recipient's "significant items," which are either direct admissions or unusual answers. Significant items are reported for the following scales: Alcohol, Drugs and Work Index. Section 3 summarizes a multiple choice items (items 97 through 103). These items are multiple choice, and the recipient's answer (with all its biases) is printed in the report. Sometimes, it helps to compare the recipient's subjective answers with the objective and empirically based scale scores. The staff member's signature and date complete page 3.

 

 NAME: Example Report              -3-      SELF-ASSESSMENT INDEX REPORT

percentile) range. This individual's ability to  cope  with  stress  and
pressure is not a focal area of  concern.  This  person  handles stress,
tension, anxiety and  pressure  adequately.  Although usually capable of
handling  stress,   situation  specific  events  (e.g., death in family,
lose  job,   etc.)  sometimes   occur  and   they  can   be  temporarily
overwhelming.  Yet,  this  client   typically   handles   stress  in  an
acceptable  manner.


SECTION 2: SIGNIFICANT ITEMS: These answers are the  welfare recipient's
self-reported responses.  They  represent  direct  admissions or unusual
answers, which  may  help in  understanding  the individual's situation.

ALCOHOL                              DRUGS
-------                              -----
2. Sometimes drinks too much         4. Many friends use drugs
20. Drinking has been a problem
35. A different person when drinks

WORK INDEX                           WORK INDEX
----------                           ----------
11. Not happy with life              72. Rarely motivated
24. Friends/relatives unemployed     73. Very often sensitive
32. States doesn't keep jobs long    78. Rarely exciting/stimulating
41. No encouragement to improve      88. Rarely satisfied with work
50. Couldn't earn enough money       100. Serious relationship problems
60. Responsibilities make it hard

SECTION 3: The welfare recipient's answers to multiple choice items are
printed below. It should be noted  that  these  answers  represent  the
recipient's opinion--with all of its  biases.  These  multiple  choice
answers allow  comparison  of  the  client's  subjective  opinions with
objective and  empirically based  scale scores.

97. States drinking a little prob.   101. States not suicidal/homicidal
98. States not a substance abuser    102. Not in any drug treatment prog
99. States drug use not a problem    103. No alcohol treatment programs
100. Serious marital/relat. prob. 

                 ADDITIONAL INFORMATION PROVIDED BY CLIENT
                 -----------------------------------------
Alcohol-related arrests...... 1 Drug-related arrests............. 0
Alcohol treatment programs... 0 Drug treatment programs.......... 0

OBSERVATIONS/RECOMMENDATIONS:__________________________________________

_______________________________________________________________________

_______________________________________________________________________

_______________________________________________________________________

_______________________________________________________________________

______________________      ______________
STAFF MEMBER SIGNATURE           DATE                   (SAI TEST # 1 )

To go back the SAI Reports section, click the Return to SAI Reports Section link. 

If you are interested in Welfare-recipient screening in 'Welfare-To-Work" programs we recommend you consider the Self-Assessment Index (SAI).  If you are interested in "Employment Program"  screening,  we recommend the SAI-c.  Clicking on the SAI-c link will take you to the SAI-c report.

TOPICS FOR EASY REFERENCE
The following links provide quick access to some of the unique features of the Self-Assessment Index (SAI) that were described above.
Truthfulness Scale Free Examination Kit
Confidentiality Scale Interpretation
Reliability & Validity Test Comparison Checklist
3 Ways to Administer Example SAI-c Report
SAI Interpretation Example SAI Report
Test Unit Fee
(Cost)
SAI Research Study
Reading Impaired
Assessment
Free Annual Summary Reports

 

We hope the SAI webpage was interesting and informative. Additional information can be provided upon request by writing Risk & Needs Assessment, Inc., P.O. Box 44828, Phoenix, Arizona 85064-4828. Our telephone number is (602) 234-3506, our fax number is (602) 266-8227, and our e-mail address is hhl@riskandneeds.com.

 

SAI
Scale
Interpretation
SAI
Research
Study
SAI-c
Example
Report
Test Comparison Checklist How To Order

 


How to Proceed
Annual Reports | Staff Training
How to Order Tests | Scroll Articles
Research Support | Power Point Tutorials | Other Website Links
Website Recommendations
Guest Log | Contact Us


Copyright 2003 - Risk & Needs Assessment, Inc. - All Rights Reserved