Sam Houston State University | SACSCOC Fifth Year Interim Report

Assessment : 2013 - 2014 : Educational Programs :
Library Science MLS

2 Goals 2 Objectives 2 Indicators 2 Criteria 2 Findings 2 Actions

GOAL: Master Texas Educator Standards For School Librarians

Objective

Candidate Knowledge, Skills, And Dispositions

Candidates will demonstrate their knowledge, skills, and dispositions by successfully completing the TExES School Librarian (150) test that is designed to assess examinees according to the prescribed domains that include the following: Domain I - Teaching, Learning, and the School Library Environment; Domain II - Program Management, Leadership, and Connections to the Community; and Domain III - Librarianship, Information Science, and Technology.

Indicator

TExES

All candidates seeking school librarian certification must take the TExES (Texas Examination of Educator Standards) for school librarians. This exam directly corresponds to the state content competencies that are designed to measure the candidates' level of mastery as it relates to the field. Results of candidate scores on the TExES test for school librarians determine the pass rate for each testing period.

Criterion

TExES Scores

Candidates will pass the TExES Exam for School Librarian, and 80% of candidates will succeed upon their first effort. A scaled score of 240 is required for passing. The overall pass rate, with those who have to retake the exam, will exceed 90% of candidates.

In 2012-2013, the candidates pass rate was 73% for first effort success; thus, the 80% criterion will remain for 2013-2014. The faculty moved from the online webinar that proved unsuccessful in supporting our candidates. Currently, the department is requiring that candidate interns successfully complete the pretest prior to the end of the semester. Also, the faculty developed a glossary list to aid the candidates as they prepared for the pretest and the TExES certification examination. For those who require remedial support, a faculty member will work with the individual candidate until the candidate experiences success in passing the TExES.

Finding

Candidate Knowledge, Skils, And Dispositions Findings

The program was not successful in meeting the 80% criterion for candidates to succeed upon their first effort of passing the state's certification examination. In 2013-2014, the candidates pass rate for the examination was 71% for the first effort; thus, the 80% criterion will remain for 2014-2015. In addition, the overall pass rate for the certification examination that includes first time test takers and repeaters was 83%, which doesn't meet the criterion of 90%.

Actions for Objective:

Action

Candidate Knowledge, Skills, And Dispostions Action

GOAL: Portfolio Demonstrating Mastery Of Standards

Objective

Candidate Preparedness

Candidates will demonstrate mastery of their knowledge, skills, and dispositions gained in the Library Science program on the final assessment of portfolio. The portfolio is governed by the ALA/AASL Standards for Initial Preparation of School Librarians (2010). The five standards include: Standard 1 - Teaching for Learning; Standard 2 - Literacy and Reading; Standard 3 - Information and Knowledge; Standard 4 - Advocacy and Leadership; and Standard 5 - Program Management and Administration.

Indicator

Final Assessment Portfolio

Every graduate program requires a final product for its course of study. The Department of Library Science has determined that the electronic portfolio is currently the best method of providing evidence that the candidate is prepared for the world of school librarianship. The electronic portfolio is designed for candidates to demonstrate through artifacts and reflection their completion and mastery of the American Association of School Librarians (AASL) and National Council for Accreditation of Teacher Education (NCATE) Standards.

The candidate must meet acceptable or target evaluations of their final assessment portfolio. Professors review the portfolios using rubrics developed by faculty for this purpose.

Criterion

Pass Rates For Portfolio

All candidates will obtain an assessment of either acceptable or target as indicated by department rubrics on the final portfolio. Since candidates met the desired ratio of 30% Acceptable and 70% Target, the new percentages will be 20% Acceptable and 80% Target. This ratio has been adjusted to align the goal with the 2012-2013 results.

Finding

Portfolio Demonstrating Mastery Of Standards Findings

Pass rates for Portfolio for 2013-2014 were as follows: 0% Unacceptable; 47% Acceptable; and 53% Target.

Actions for Objective:

Action

Portfolio Demonstrating Mastery Of Standards Action

While the 100% pass rate was maintained for Portfolio, the percentage of candidates who scored Target was 53%, which is a drop when compared to last academic year's pass rate. The remainder of the 47% of candidates scored at the Acceptable level. In support of the candidates' success with Portfolio, edits were made to the Anecdotal Resume to provide clarification to the suggestions, recommendations, and requirements that are included in the document. These changes were made and in place for Fall 2013. When reviewing the Portfolio scores, Fall 2013 scores are comparatively lower than the Spring 2014 scores. With the edits in place for the first time in Fall 2013, this may have resulted in the lower scores when compared with the Spring 2014 scores where candidates had more time to become familiar with the edits. This may have been one factor contributing to candidate's not meeting the criterion. The program will maintain the current criterion of 20% Acceptable and 80% Target for the 2014-2015 academic year.

Previous Cycle's "Plan for Continuous Improvement"

Based on the first attempt pass rate of 73% for the TExES exam, the Department recognizes that preparation for the exam must include an online component in order to accommodate candidates who live throughout Texas since the MLS program is currently totally online. In order to accomplish this, the Department will pilot an interactive online platform to engage graduates and graduate candidates in a study session with materials related to the TExES examination. The session will be recorded for later viewing.

For 2013-2014 the Department will adjust the pass rates for Portfolio to 20% Acceptable and 80% Target. The ratio will be adjusted to better reflect and provide a more realistic goal based on the results of 2012-2013. In addition, the Department plans to implement more course discussions surrounding the ALA/AASL Standards for Initial Preparation of School Librarians (2010)* and how assignments are related to those standards and their elements. In doing so, the graduate candidates will be encouraged to make authentic decisions as they create artifacts for assignments that may be included in their Portfolio.

*The ALA/AASL Standards for Initial Preparation of School Librarians were developed by American Association of School Librarians (AASL), a division of the American Library Association (ALA).

Update on Previous Cycle's "Plan for Continuous Improvement"

For the online component that was attempted in order to accommodate the online library science candidates who live throughout Texas, the program did not experience significant results. Attendance was very low at the live session without any candidates stating that later viewing of the recording was beneficial.

In 2013-2014, for the TExES certification examination the candidates pass rate was 71% for first effort success; thus, the 80% criterion will remain for 2014-2015. The overall score which includes first time test takers and repeaters was 83%, which doesn't meet the criterion of 90%.

Faculty members increased discussion and inclusion of the ALA/AASL Standards for the Initial Preparation of School Librarians (2010). This is most apparent in the LSSL 5366 Library Internship course where interns are expected to have documented experiences related to all five of the standards and their elements. These standards and elements are a core component for the development of the Portfolio. Pass rates for Portfolio for 2013-2014 were as follows: 0% Unacceptable; 47% Acceptable; and 53% Target.

Plan for Continuous Improvement

Currently, the department is requiring that candidates successfully complete a pretest prior to the end of their coursework in the program. The faculty will continue to use the glossary list to aid the candidates as they prepare for the pretest and the TExES certification examination. The faculty created several scenarios for each course that would provide candidates with the opportunity to encounter problem-solving opportunities similar to those that might be found on the certification test. The scenarios will be introduced into courses in Fall 2014. For those who require remedial support, a faculty member will work with the individual candidate until the candidate experiences success in passing the TExES. The program will maintain the criterion of 80% pass rate for first time test takers and an overall score of 90%.

While the 100% pass rate was maintained for Portfolio, the percentage of candidates who scored Target was 53%, which is a drop when compared to last academic year's pass rate. This left 47% scoring at the Acceptable level. The program will maintain the current criterion of 20% Acceptable and 80% Target for the 2014-2015 academic year.

Sub Content Box