Assessment : 2013 - 2014 : Educational Programs :
Management Information Systems BBA
1 Goal 6 Objectives 6 Indicators 6 Criteria 4 Findings 4 Actions
|
GOAL: Management Information Systems- A Broad Base Of Knowledge
|
|
|
Objective
|
|
|
|
|
|
Students who complete the BBA in Management Information Systems will demonstrate an understanding of telecommunications services and networking technologies and skills in installing and managing networks within business organizations. (MGIS4350)
|
|
Indicator
|
|
|
Tests And Networking Project
|
|
|
|
|
|
Assessment will be made using test performance on understanding of telecommunications services and networking technologies. A project will be used to assess skills in working as a team to install and manage a network. (MGIS4350)
|
| Criterion |
|
|
Tests And Networking Project
|
|
|
|
|
|
The class average on individual test questions will be 75% correct. Test questions will be included on each unit examination. Seventy five percent of Management Information Systems majors will receive a score of at 75% on the Test and the Networking Project. Last year we handily met the criterion for the networking project but not the test. We will be particularly interested to determine whether our interventions helped raise performance on the common test questions. (MGIS4350)
|
|
GOAL: Management Information Systems- A Broad Base Of Knowledge
|
|
|
Objective
|
|
|
|
|
|
Students who complete the BBA in Management Information Systems will demonstrate an understanding of basic computer technology concepts and the development and use of information systems in organizations. (MGIS3310)
|
|
Indicator
|
|
|
Information Systems Pre-Test And Post-Test
|
|
|
|
|
|
Assessment will be made using pre-test and post- test performance on computer technology and the role of information systems in organizations. (MGIS3310)
|
| Criterion |
|
|
Information Systems: Improvement On Post-Test Scores
|
|
|
|
|
|
The target class average on post-test questions will be 75% correct.(MGIS3310)
|
| Finding |
|
|
|
|
To Be Assessesd in Spring 2015
|
Actions for Objective:
There are no actions for this objective.
|
GOAL: Management Information Systems- A Broad Base Of Knowledge
|
|
|
Objective
|
|
|
|
|
|
Students who complete the BBA in Management Information Systems will demonstrate the ability to analyze and define business problems from a programming perspective and an understanding of the basic concepts of programming, problem solving, and program logic. This includes the understanding of fundamental concepts of procedural, object-oriented, and event-driven programming paradigms and the ability to apply them to solve business problems. (MGIS2320)
|
|
Indicator
|
|
|
Programming Pre-Test, Post-Test, And Rubric
|
|
|
|
|
|
Assume that students have little or no prior knowledge of the topics; assessment will be made using three examinations to evaluate both the understanding of fundamental concepts of the three programming paradigms (procedural, object-oriented, and event-driven) and the ability to apply them to solve business problems. Common multiple-choice questions will be used to assess the understanding, while coding problems will be used to assess the ability to apply. (MGIS2320)
|
| Criterion |
|
|
Programming: Improvement On Post-Test And Rubric Scores
|
|
|
|
|
|
The average across class sections on each exam will be 75% correct. The class average on the section testing the understanding of fundamental concepts of both procedural and object-oriented paradigms will be 75% correct. Also, the class average on the section testing the ability to apply the concepts of concepts of both procedural and object-oriented paradigms will be 75% correct. The class average on the exam on event-driven paradigm will be 75% correct; this last exam contains one coding problem, combining the understanding and application. We are particularly interested to determine whether our interventions are working with the procedural paradigm, a weakness that emerged in 2010-2011. (MGIS2320)
|
| Finding |
|
|
Improvement In The Majority Of Targeted Material
|
|
|
|
|
For the procedural paradigm exam, the overall class average falls slightly below the criterion (73.3%) but is an improvement from the last assessment period (71.5%); For object-oriented paradigm exam, the overall class average also falls below the criterion (66.9%), which is a drop from the last assessment period (79.3%) ; For event-driven paradigm exam, the overall class average exceeds the criterion (91.7%) and is an increase from the last assessment period (87.35). (MGIS2320)
|
Actions for Objective:
| Action |
|
|
Developing A More Detailed Rubric
|
|
|
|
|
It is noted that the procedural paradigm went up slightly while the object oriented paradigm results went down. Since these results are based on a small sample size, it is not conclusive that the results are significantly different. Therefore, we are trying the actions described subsequently to gather more detailed information about weaknesses and will adjust our action plan accordingly.
A more detailed rubric is under development to help pinpoint specific areas of weakness in both the procedural and object oriented paradigm areas such as conditional statements, variable definitions, recognizing variable types, creating a class and understanding arrays. Additional tutoring support and exercises covering identified areas of weakness will then be added in future semesters based on the results from using the new rubric.
|
|
GOAL: Management Information Systems- A Broad Base Of Knowledge
|
|
|
Objective
|
|
|
Systems Analysis And Design
|
|
|
|
|
|
Students who complete the BBA in Management Information Systems will demonstrate an understanding of the design and application of information systems in business and a knowledge of the tools and processes used in systems analysis and design. (MGIS4340)
|
|
Indicator
|
|
|
Systems Analysis And Design Pre-Test, Post-Test, And Rubric
|
|
|
|
|
|
Assessment will be made using pre-test and post-test performance on the design and application of information systems and the tools and processes used to achieve such designs. A rubric will be used to assess skills in systems analysis and design. (MGIS4340)
|
| Criterion |
|
|
Systems Analysis And Design: Improvement On Post-Test And Rubric Scores
|
|
|
|
|
|
Students will average at least a 50% improvement over the pre-test. The class average on individual post-test questions will be 75% correct. Post-test questions will be included on each unit examination. Seventy five percent of Management Information Systems majors will receive a score of at least acceptable on the Management Information Systems rubric. (MGIS4340)
|
| Finding |
|
|
No Findings For This Cycle
|
|
|
|
|
To Be Assessed in Spring 2015
|
Actions for Objective:
There are no actions for this objective.
|
GOAL: Management Information Systems- A Broad Base Of Knowledge
|
|
|
Objective
|
|
|
|
|
|
Students who complete the BBA in Management Information Systems will demonstrate an understanding of the design and implementation of database applications and how database software works and its inclusion in design solutions. (MGIS3330)
|
|
Indicator
|
|
|
Database Pre-Test, Post-Test, And Rubric
|
|
|
|
|
|
Assessment will be made using post-test performance on design and implementation of database applications and how database software works. The first two tests also include problems that will reflect performance on two specific learning objectives, specifically design and SQL programming. (MGIS3330)
|
| Criterion |
|
|
Database: Improvement On Post-Test And Rubric Scores
|
|
|
|
|
|
Students are assumed to have no previous knowledge of database design and implementation skills and are not given a pretest. The class average on individual post-test questions will be 75% correct. Post-test questions will be included on each unit examination. In addition, there are two problems in the first two tests and students should score at least 75% on them. Last year we determined that increasing the value of the SQL homework might encourage students to complete it. We are anxious to determine whether this intervention increased the SQL score. (MGIS3330)
|
| Finding |
|
|
SQL And Additional Database Topics
|
|
|
|
|
On the design principle homework, the class average exceeds the criterion (89.4%). On the two exams focusing on SQL, the overall class averages exceed the criterion (77.6% and 84.9%). Except for the average on the coding section of the 1st exam (64.4%), all the averages on both multiple-choice and coding sections of the two exams exceed the criterion (1st exam multiple-choice 77.9%, 2nd exam multiple-choice 86.9%, and 2nd coding 83%). Finally, we incorporated the Microsoft Technology Associate (MTA) exam into the course on a trial basis. Four people passed the MTA exam (14.8%).
The low average on the coding section of the first exam resulted in further review of the SQL and related topic material and teaching methodology. See actions below for discussion. (MGIS3330)
|
Actions for Objective:
| Action |
|
|
Two Courses In Place Of One Course
|
|
|
|
|
The MGIS faculty discussed the subject matter – Database Management Systems and SQL in particular – and the fact that this subject expands beyond the MIS major with applications such as data mining, Big Data, Data Analytics and Business Intelligence. We realized that more database work was needed to cover the material properly, resulting in the addition of a second required database class. The first course will cover database design and technical documentation such as Entity Relationship diagramming using the Microsoft relational database Access. The second database class will cover a more advanced approach to database design using SQL and procedural languages associated with SQL. The new approach with two required database classes will place the evaluation in the second course (4330). Therefore, the evaluation of SQL will be completed in the next cycle of assessment for the MGIS4330 class.
|
|
GOAL: Management Information Systems- A Broad Base Of Knowledge
|
|
|
Objective
|
|
|
|
|
|
Students who complete the BBA in Management Information Systems will demonstrate the ability to implement business oriented systems for electronic commerce and skills in using Internet technologies. (MGIS4320)
|
|
Indicator
|
|
|
Electronic Commerce Pre-Test And Post-Test
|
|
|
|
|
|
Assessment will be made using pre-test and post-test performance on business oriented systems. (MGIS4320)
|
| Criterion |
|
|
Electronic Commerce: Improvement On Post-Test Scores
|
|
|
|
|
|
Students will average at least a 50% improvement over the pre-test. The class average on individual post-test questions will be 75% correct. Post-test questions will be included on each unit examination. (MGIS4320)
|
|
Previous Cycle's "Plan for Continuous Improvement"
|
|
The MIS faculty assessment review meeting for 2012-2013 was held with Dr Gerald Kohers, the Department Chair, in attendance. Course Assessments for the core MIS course (MGIS3310) and Systems Analysis & Design (MGIS3360) were covered and the results of the assessments, as detailed above, were discussed.
Both courses were found to have made satisfactory progress based on the post-test averages meeting or exceeding the 75% score goal. However, further assessment in the form of qualitative reviews by the instructors identified areas for improvement. The results of the qualitative assessments are as follows.
In the core MIS course (MGIS3310) it was determined that skills for decision making, specifically with the Excel tool, may be lacking. The instructor's assessment included input from students, department faculty, other COBA department faculty, COBA administration and alumni. The plan for further assessment in this area will begin with an analysis of the current Excel skill learning path, pedagogy and development of goals.
In the System Analysis and Design course (MGIS3360) two items were planned. First, it was determined that the course level that is currently assigned to the course does not properly reflect the level of material or level of execution expected on the real world client project that is covered in the course. Therefore, a change request to revise the course number to a 4000 level has been submitted. By identifying a higher course level students should be better informed and consequently better prepared as to the rigor and course work load required of a course with a real world client project when planning their own course load.
Second, with the satisfactory results obtained for the conceptual material (results of 75% score or greater on the post-test) a plan to assess the project material covered in the course is needed. An analysis will be completed in the next assessment cycle to develop the approach for this assessment.
|
|
Update on Previous Cycle's "Plan for Continuous Improvement"
|
|
The plan for the core MIS course (MGIS3310) is to analyze the current Excel skill learning path, pedagogy and development of goals. That analysis is still in progress.
The plan for the Systems Analysis and Design course (MGIS3360) was to first revise the course number to a higher 4000 level to reflect the rigor in the course. That change has been made. Secondly, an analysis of the course project material is planned for the next assessment cycle which should be in the Spring 2015 semester.
|
|
Plan for Continuous Improvement
|
|
The MGIS faculty assessment review meeting for 2013-2014 was held with Dr. Gerald Kohers, Department Chair, in attendance. Course assessments were completed for the Programming course (MGIS2320) and the Database course (MGIS3330).
Results for the Programming course (MGIS2320) indicated a need to gather more detailed information in order to try to pinpoint specific skills/functions that students need more targeted help with. In order to gather the detailed information needed a more detailed rubric will be developed and used.
The Database course (MGIS3330) assessment resulted in a recognition that material in that area has grown considerably, resulting in the need for two database courses to adequately cover the material. Therefore, there will be two courses, one for foundational material and a second course focusing on more advanced SQL and procedural language material. Since the second class will build on the first class, the assessment for database material will take place in the second course (MGIS4330) in the future.
|