{"id":67,"date":"2018-02-17T16:26:58","date_gmt":"2018-02-17T16:26:58","guid":{"rendered":"https:\/\/projectsails.org\/site\/?page_id=67"},"modified":"2025-06-08T15:08:45","modified_gmt":"2025-06-08T15:08:45","slug":"the-individual-scores-test","status":"publish","type":"page","link":"https:\/\/projectsails.org\/site\/the-individual-scores-test\/","title":{"rendered":"The Individual Scores Test"},"content":{"rendered":"<p>SAILS is a knowledge test with multiple-choice questions targeting a variety of information literacy skills. The test items are based on the ACRL <a href=\"http:\/\/www.ala.org\/acrl\/standards\/informationliteracycompetency\" target=\"_blank\" rel=\"noopener\">Information Literacy Competency Standards for Higher Education<\/a>\u00a0and\u00a0<a href=\"http:\/\/www.ala.org\/acrl\/standards\/objectivesinformation\" target=\"_blank\" rel=\"noopener\">Objectives for Information Literacy Instruction<\/a>. Four of the five Standards are covered. Standard IV is not addressed by the SAILS tests because its competencies are not suitable for multiple-choice testing.\u00a0The Individual Scores test gives an overall information literacy score for each student.<\/p>\n<p>Students are directed to the SAILS web site to take the web-based test. Each student may take the test once per administration. Responses are sent to a central database where data are analyzed and reports are generated and made available for download as a spreadsheet.<\/p>\n<p>Administering and taking the SAILS assessment of information literacy requires very little technical expertise. Schools register, customize the test-delivery system, and make payment online. The test is 55 questions long and most students finish within 45 minutes. You may view the question format on the <a href=\"\/site\/sample-questions\">sample questions<\/a> page. Please also review the <a href=\"https:\/\/www.projectsails.org\/site\/terms\">Terms of Use<\/a>.<\/p>\n<h3>Reports<\/h3>\n<p>Participating institutions receive an institutional report, individual student reports, and associated files.\u00a0The institutional report is designed to help educators identify areas of strength and areas that need improvement in their students&#8217;\u00a0knowledge of and ability to implement key information literacy outcomes and objectives. The report supports evidence-based\u00a0decision-making and informs actions for strengthening student learning.<\/p>\n<p>Institutional report contents:<\/p>\n<ul class=\"tutorial-unordered\">\n<li>Overview of how students performed on the SAILS test as a whole with a single overall information literacy score for the entire testing sample and for subgroups<\/li>\n<li>Histograms that show the relative distribution of scores and provide an overall sense of how the scores fall around the mean<\/li>\n<li>Overall information literacy score for each student along with each student&#8217;s results for each item and the number correct<\/li>\n<li>Ranked list of information literacy outcomes\/objectives, in order by students&#8217; performance from the strongest to the weakest<\/li>\n<li>See <a href=\"\/files\/Sample-Individual-Scores-Report.pdf\">sample institutional report<\/a><\/li>\n<\/ul>\n<p>Student reports are\u00a0individualized analysis of each student&#8217;s performance. Based on how the student answers the SAILS test questions, student reports highlight information literacy strengths and provide recommendations for improvement.\u00a0Test managers have the option to display these reports to their students upon completion of the test. See <a href=\"\/files\/Sample-Student-Report.pdf\">sample student report<\/a>.<\/p>\n<p>Associated files:<\/p>\n<ul class=\"tutorial-unordered\">\n<li>Data file containing all the scores presented in the institutional report<\/li>\n<li>Student data file with scores for each student &#8211; see <a href=\"\/files\/Sample-Individual-Scores-BYOT-Spreadsheet.csv\">sample data file<\/a><\/li>\n<li>Student data codebook that describes the demographic options configured for the test<\/li>\n<li>Student report zip file that contains the PDF documents with an analysis of each student&#8217;s performance<\/li>\n<li>The SAILS Individual Scores test questions and answers<\/li>\n<\/ul>\n<h3>Test Versions<\/h3>\n<p>There are two versions of the individual scores assessment of information literacy. Items for each test were selected based on their difficulty level, their representation of the ACRL standards, and their content.<\/p>\n<h3>Proficiency and Mastery<\/h3>\n<p>We are providing proficiency and mastery scores to provide context for your students&#8217; performance.<\/p>\n<p>70% &#8211; Proficiency Level<\/p>\n<p>85% &#8211; Mastery Level<\/p>\n<p>Test takers scoring a 70% or better demonstrate a proficiency level of information literacy. They demonstrate knowledge of the following components of information literacy:<\/p>\n<ul class=\"tutorial-unordered\">\n<li>Research strategy development<\/li>\n<li>Searching basics, including Boolean operators and strategies for expanding and limiting searches<\/li>\n<li>Information retrieval<\/li>\n<li>Basics of information evaluation<\/li>\n<li>Finding tool selection and use<\/li>\n<li>Basic understanding of source documentation<\/li>\n<li>Basic understanding of the role of the academic library in information literacy<\/li>\n<\/ul>\n<p>Test takers scoring an 85% or better demonstrate a mastery level of information literacy. In addition to the knowledge demonstrated at the proficiency level, they demonstrate knowledge of the following components of information literacy:<\/p>\n<ul class=\"tutorial-unordered\">\n<li>Advanced searching, including the use of controlled vocabularies<\/li>\n<li>Advanced understanding of source documentation<\/li>\n<li>Basic understanding of Intellectual property issues involved in the use of information<\/li>\n<\/ul>\n<p>Students scoring above the mastery level (85%) demonstrate some additional knowledge. Higher scoring students can demonstrate knowledge of the following components of information literacy:<\/p>\n<ul class=\"tutorial-unordered\">\n<li>Advanced understanding of intellectual property issues involved in the use of information<\/li>\n<li>Advanced information evaluation<\/li>\n<li>Advanced understanding of the role of the academic library in information literacy<\/li>\n<\/ul>\n<p>If you are interested in using SPSS to analyze your Individual Scores data, you can download our <a href=\"https:\/\/www.projectsails.org\/files\/Moving_SAILS_Data_into_SPSS.pdf\">Basic Guide to Analyzing Individual Scores Data with SPSS<\/a> PDF document.<\/p>\n<h4>Determination of Cut Scores<\/h4>\n<p>The Bookmark standard setting method was used to set cut scores for performance levels on the SAILS Individual Scores Test. The method is based in item response theory analysis and is widely accepted as a valid approach for determining cut scores when the item difficulties are known. We calculated item difficulties using the Rasch model of item response theory.<\/p>\n<p>We used a modified Bookmark standard-setting procedure. Rather than use two rounds of rater point-setting and discussion, we established a preliminary line in the test based on the mean plus one standard deviation. We were able to make that decision because the item difficulties were normally distributed.<\/p>\n<p>We then arranged the items and corresponding objectives in descending order of item difficulty, and used the data-driven cut line as a starting point for what is traditionally the third-round discussion regarding which of the objectives should be demonstrated to show proficiency and then mastery. Once we reached agreement on the cut scores, we examined a sample of test-taker data to see what impact the cut scores would have on the test takers. These conversations and analyses reflect the typical determinations made during the third round of bookmark standard-setting.<\/p>\n<p><i>Next Up:<\/i> <a href=\"\/site\/skill-sets\">Project SAILS Skill Sets<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>SAILS is a knowledge test with multiple-choice questions targeting a variety of information literacy skills. The test items are based on the ACRL Information Literacy Competency Standards for Higher Education\u00a0and\u00a0Objectives for Information Literacy Instruction. Four of the five Standards are covered. Standard IV is not addressed by the SAILS tests because its competencies are not&#8230;  <a class=\"excerpt-read-more\" href=\"https:\/\/projectsails.org\/site\/the-individual-scores-test\/\" title=\"ReadThe Individual Scores Test\">Read more &raquo;<\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"footnotes":""},"class_list":["post-67","page","type-page","status-publish","hentry"],"_links":{"self":[{"href":"https:\/\/projectsails.org\/site\/wp-json\/wp\/v2\/pages\/67","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/projectsails.org\/site\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/projectsails.org\/site\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/projectsails.org\/site\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/projectsails.org\/site\/wp-json\/wp\/v2\/comments?post=67"}],"version-history":[{"count":12,"href":"https:\/\/projectsails.org\/site\/wp-json\/wp\/v2\/pages\/67\/revisions"}],"predecessor-version":[{"id":552,"href":"https:\/\/projectsails.org\/site\/wp-json\/wp\/v2\/pages\/67\/revisions\/552"}],"wp:attachment":[{"href":"https:\/\/projectsails.org\/site\/wp-json\/wp\/v2\/media?parent=67"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}