Assessment : 2012 - 2013 : Educational Programs :
Management Information Systems BBA
1 Goal 2 Objectives 2 Indicators 2 Criteria 2 Findings 2 Actions
Objective Supports Another 's Goals
|
|
|
Objective
|
|
|
|
|
|
Students who complete the BBA in Management Information Systems will demonstrate an understanding of basic computer technology (MGIS3310) In particular, the students should have:- An understanding of fundamental computer technology concepts and the role and use of information systems in organizations
- Be a more effective and efficient end users of information systems for business operations and decision making.
Supports : Management Information Systems BBA
|
Indicator
|
|
Information Systems Pre-Test And Post-Test
|
|
|
|
|
Assessment will be made using pre-test and post- test performance on computer technology and the role of information systems in organizations. (MGIS3310)
|
Criterion |
|
Information Systems: Improvement On Post-Test Scores
|
|
|
|
|
The target class average on post-test questions will be 75% correct. (MGIS3310)
|
Finding |
|
Findings For MGIS3310 - Intro To MIS
|
|
|
|
|
This course is part of the business core requirement. The assessment instrument used for this course was a pre-test/post-test along with observations made by the instructor. Assessment results indicate that students are understanding computer technology concepts and the role of information systems in organizations at an acceptable level with an average of greater than 75% on the post-test score.
While the assessment results indicate that learning occurred at an acceptable level (i.e. 75% or great average on the post-test score), following a qualitative assessment by the instructor resulted in the determination that improvements can still be made, particularly in the area of information system usage for decision making. This primarily refers to the use of Excel.
|
Actions for Objective:
Action |
|
Actions For MGIS3310 - Intro To MIS
|
|
|
|
|
A possible reason for the student’s low performance in the use of Excel may be the high expectations in their experience level with Excel on entering the class. A review of where the students are taking the required prerequisite Computer Literacy course and what they are covering will be conducted.
|
Objective Supports Another 's Goals
|
|
|
Objective
|
|
Systems Analysis And Design
|
|
|
|
|
|
Students who complete the BBA in Management Information Systems will demonstrate an understanding of the design and application of information systems in business and a knowledge of the tools and processes used in systems analysis and design. (MGIS3360)
Supports : Management Information Systems BBA
|
Indicator
|
|
Systems Analysis And Design Pre-Test, Post-Test, And Rubric
|
|
|
|
|
Assessment will be made using pre-test and post-test performance on the design and application of information systems and the tools and processes used to achieve such designs. A rubric will be used to assess skills in systems analysis and design. (MGIS3360)
|
Criterion |
|
Systems Analysis And Design: Improvement On Post-Test And Rubric Scores
|
|
|
|
|
Students will average at least a 50% improvement over the pre-test. The class average on individual post-test questions will be 75% correct. Post-test questions will be included on each unit examination. Seventy five percent of Management Information Systems majors will receive a score of at least acceptable on the Management Information Systems rubric. (MGIS3360)
|
Finding |
|
Findings For MGIS3360 - Systems Analysis & Design
|
|
|
|
|
This course is for MIS majors. The overall average for three exams during the semester was 81.3 indicating that the students did achieve an acceptable score of 75% or greater. In addition, 76.6% of the students achieved a 75% or better score on the exams exceeding the target of 75%.
Overall the evidence indicates achieving the current assessment targets.
|
Actions for Objective:
Action |
|
Actions Planned For MGIS3360 - Systems Analysis & Design
|
|
|
|
|
Attention can now be placed on the application of the conceptual knowledge gained. The course uses an actual client for a project throughout the semester. This area of learning will be the focus of future assessments.
The instructor determined that a qualitative assessment of the course number (MGIS3360) was needed based on a review of student input contained in reflective papers completed as part of the course's ACE requirements. The qualitative assessment consisted of a discussion with all MIS faculty and the department chair and concluded that the rigor of the material covered in the course was a more advanced than was indicated by the current course number. The change for the course number to a 4000 level course has been submitted.
|
Previous Cycle's "Plan for Continuous Improvement"
|
The year-end MIS faculty assessment review meeting was held at the end of the Spring semester with Dr. Roger Abshire, the Department Chair, in attendance. We discussed the course assessments for the core MIS course (388/3310) and e-Commerce (431/4320) course and discussed the results as presented above.
Progress for both courses was assessed with the comparison of pre-test exam taken at the beginning of the semester and post-test performance using s the pre-test questions that were embedded in the examinations taken throughout the semester. The questions used on the pre-test and subsequently on the post-tests throughout the semester were selected as representative of the main concepts identified as foundational for an understanding of basic technology concepts and the development and use of information systems in organizations. A qualitative assessment was made by the instructor for the MGIS4320 course resulting in the decision to have more one-on-one time with each student to enhance in the learning process.
We discussed the possibility of using certification exams as a third party assessment tool. The Microsoft MTA certifications have been made available for the database (MIS390/MGIS3330) and networking (MIS485/MGIS4350) courses. These courses will be assessed during the next academic year, Fall 2013 and Spring 2014.
|
Update on Previous Cycle's "Plan for Continuous Improvement"
|
The two elements identified in the previous cycle were implemented - 1)more one-on-one time with each student to enhance the learning process in MGIS4320, and 2) Using certifications as a third party assessment tool in the database MGIS3330 and MGIS4350 courses. MGIS3330 will be assessed Spring 2014 and MGIS4320 will be assessed in a future cycle.
|
Plan for Continuous Improvement
|
The MIS faculty assessment review meeting for 2012-2013 was held with Dr Gerald Kohers, the Department Chair, in attendance. Course Assessments for the core MIS course (MGIS3310) and Systems Analysis & Design (MGIS3360) were covered and the results of the assessments, as detailed above, were discussed.
Both courses were found to have made satisfactory progress based on the post-test averages meeting or exceeding the 75% score goal. However, further assessment in the form of qualitative reviews by the instructors identified areas for improvement. The results of the qualitative assessments are as follows.
In the core MIS course (MGIS3310) it was determined that skills for decision making, specifically with the Excel tool, may be lacking. The instructor's assessment included input from students, department faculty, other COBA department faculty, COBA administration and alumni. The plan for further assessment in this area will begin with an analysis of the current Excel skill learning path, pedagogy and development of goals.
In the System Analysis and Design course (MGIS3360) two items were planned. First, it was determined that the course level that is currently assigned to the course does not properly reflect the level of material or level of execution expected on the real world client project that is covered in the course. Therefore, a change request to revise the course number to a 4000 level has been submitted. By identifying a higher course level students should be better informed and consequently better prepared as to the rigor and course work load required of a course with a real world client project when planning their own course load.
Second, with the satisfactory results obtained for the conceptual material (results of 75% score or greater on the post-test) a plan to assess the project material covered in the course is needed. An analysis will be completed in the next assessment cycle to develop the approach for this assessment.
|