Assessment : 2013 - 2014 : Educational Programs :
Psychology MA
2 Goals 2 Objectives 2 Indicators 2 Criteria 2 Findings 2 Actions
GOAL: Research Competence
|
|
|
Objective
|
|
|
|
|
|
Students demonstrate knowledge and skills related to competency in research methodology and statistical analyses.
|
Indicator
|
|
|
|
|
Students' production of original research. This program is considered to be a research-oriented program. Therefore, all students in the program will either complete a research thesis or will have been engaged in a faculty member's program of original research along with having taken Psychology 5388, Advanced Experimental Design.
|
Criterion |
|
Research Project
|
|
|
|
|
Students will demonstrate research competency when they either have completed a thesis or have enrolled in PSY 5388, Graduate Experimental Design. A common rubric will be used to rate the thesis; students will be required to reach a score of at least 80/100 to be considered thesis-complete. In the 5388 course, one of the requirements is to write three papers in APA format. The first two are intended to train the student in the proper format and written comments are supplied to the students to this end. The third paper is written in APA format and submitted for evaluation by the instructor and by an independent examiner using the attached rubric. The paper is scored with respect to particular sections with a minimum score of 80 being the threshold for the designation "Acceptable." A copy of the rubric for this assignment is attached.
|
Finding |
|
|
|
|
All of the students in the cohort of 11 successfully passed the Psychology 5388 course. The average score for the course was 82.1%. Six of the cohort of 11 had a total score of 80+ on the final paper.
|
Actions for Objective:
Action |
|
|
|
|
We are pleased that 100% of our student successfully completed the capstone course, Psychology 5388. The average score of 82.1% in the course with six students scoring higher than 80 on the final paper is a new high for the program. What is somewhat disconcerting is that five of the eleven students in the course failed to complete the final paper, reaching the 80+ criterion. Those students were able make up their weaknesss in other portions of the class which enabled them to complete the course. We are reviewing particular sections of the students papers to note common areas of deficiency and try to correct those as the semester progresses.
|
GOAL: Foundation Competence
|
|
|
Objective
|
|
|
|
|
|
Students demonstrate competency in the areas of general psychology through synthesis and integration of scientific, methodological, and theoretical foundations.
|
Indicator
|
|
|
|
|
Students demonstrate through a written comprehensive examination their ability to integrate the areas of general psychology.
|
Criterion |
|
Pass Comprehensive Examination
|
|
|
|
|
100% of students must pass comprehensive examination prior to graduation. Students are given a written exam of which they must complete 5 of 7 questions listed. Criteria for passing are: the student must provide integrative responses that reveal an understanding of the information and experiences to which they have been exposed; they must provide complete references for all works cited using proper APA style; they must demonstrate their knowledge of the science in the field and support their answers, arguments, theories, logic, etc. with scientific research studies when applicable. Each question will be scored using a rubric for each question by two faculty members who have expertise in the particular area. An example of the comprehensive examination and the question rubric is attached.
|
Finding |
|
Comprehensive Examinations
|
|
|
|
|
A total of six students in the MA General program took the comprehensive examination this past academic year and all passed. The average score of the comprehensive as 3.0 which is up from the 2.6 for the previous year.
|
Actions for Objective:
Action |
|
|
|
|
We were pleased that all six students taking the comprehensive exam this past academic year performed well enough to pass the exam. In looking at the scores for each student and for the cohort overall, we are trying to discern if there are any areas of weakness that need to be addressed. Once we have discovered those weaknesses we will look at the question(s) and the course(s) and make a determination as to why students are having a difficult time in those areas.
|
Previous Cycle's "Plan for Continuous Improvement"
|
We are revising our research criteria to only include those students at the Huntsville campus, as students at TWC do not readily have research opportunities available to them. The students at TWC invariably choose the non-thesis option for the degree. In addition, they typically express a lack of interest in being involved in research.
We developed a rubric that identifies specific types of information that must be addressed the in answers provided by the students. This information was developed by faculty members who are experts in the fields and who generated those questions that are on the comprehensive exams.
Last year, in this Closing the Loop Summary section, we expressed concern about the lack of students involved in original research in this program. The number students engaged in these opportunities is on the rise and we fully expect these increases to continue. One of the main problems has been, in the past, a paucity of students enrolled in the program. This fall, we will have an incoming class of 4 students. This is discouraging as the numbers are down from the previous year. We will meet with the University Graduate Office to determine what steps to take to increase our numbers and discuss ways of better advertising our program to the general public. This coming fall, we also will present programs for our better undergraduates to make them aware of the graduate school opportunities available in our department at SHSU.
As for Foundational Competency, the credentials of the incoming class of MA General students are quite impressive: Mean GPA = 3.4; Mean GRE score = 1117. The numbers are down a little from the previous year but the reduction is not statistically significant. As last year, we have nothing but the highest expectations for these students and for our program.
|
Update on Previous Cycle's "Plan for Continuous Improvement"
|
Six of the 11 students of the cohort successfully demonstrated research competence which means that five did not. For those not reaching the 80+ mark on the final paper, several were very close to criterion but made dumb but maddening mistakes on their papers. Thus, the problem may be for some that they are just not careful enough and don't wish to be careful. This will be stressed throughout the upcoming semesters.
It is the case that our students, as a group, did well on the comprehensive exams. An issue, though, is that one or two students barely squeaked by with scores that just made criterion. So, we made need to take additional steps to identify students who may perform below standards and we should consider the nature of the comprehensive questions with respect to how the respective classes were taught.
Again, our numbers for the incoming class in the MA-General program are low, four at this point. We have recently spoken with Dr. Tayebi, along with Dean Zink with respect to the SSP program and will use some of the strategies discussed with respect to that program. That may include visits to traditionally minority institutions to speak with them about our programs and having the chair send information to the several undergraduate institutions to try to make seniors more aware of our offerings.
|
Plan for Continuous Improvement
|
1. Prior to comprehensive exams, students will be given instruction on what to expect and various strategies in handling the quesitons. This should enable them to better focus on, and better handle, the way they approach the exam. 2. During the course of the semester in which Psychology 5388, APA style and vigilance will be stressed on the research portion of the papers. 3. There is a concern about the numbers of students applying and being accepted into tis program; this year only one, an Hispanic male, was admitted. Dr. Crosby, when he speaks of the School Psychology program at Prairie View A&M Univeristy and Lamar University, will put in a pitch for our other MA programs as well. The department will be hosting graduate school information programs for our undergraduate students who appear to qualify for entrance into our program.
|