SACSCOC Fifth Year Interim Report
GOAL: Functional Competencies For Entry Into The Accounting Profession |
Objective |
|
||||
Individuals preparing to enter the accounting profession must be able to use strategic and critical approaches to decision-making. They must objectively consider issues, identify alternatives, and choose and implement solution approaches in order to deliver services and provide value. Elements (Sub-Objectives) include: - Identifies problems and potential solution approaches - Uses quantitative techniques to determine relative importance and likelihood of alternative scenarios - Employs model-building to quantify problems or test solutions - Evaluates the cost/benefit of alternative solutions - Organizes and evaluates information, alternatives, cost/benefits, risks and rewards - Links data, knowledge, and insights together for decision-making purposes - Objectively identifies strengths, weaknesses, opportunities, and threats associated with a specific scenario, case, or business activity |
Indicator |
|
|||
A mix of exam questions, projects, cases, and / or problem assignments, in multiple courses spread across the accounting curriculum, will be used to assess students' achievement on selected sub-objectives of the Decision Modeling competency. The mix depends on the course in which the assessment is being made and the instructor’s choice of instrument and selected sub-objectives. The results from the various classes will be forwarded to the Departmental Assessment Committee. This committee will compile the results and present the findings to the departmental faculty. |
Criterion |
|
|||
In each course, the instructor will determine a minimal acceptable score for each indicator used for assessment in that class. This minimal acceptable score may vary both across classes as well as inside a particular class. This variability is necessary due to the different type of indicators (exam questions, projects, cases, and / or problem assignments) used to assess students' achievement on selected sub-objectives of the Decision Modeling competency. Once the assessment of Decision Modeling is completed in the appropriate courses, the percentage of successful student attempts (number of students successfully completing the specific outcome predetermined success level divided by the total number of students attempting the specific outcome) will be reported for each class. The Departmental Assessment Committee will then compile the reports into an aggregated report that will show the success percentage by classification (junior, senior, and graduate). The Department of Accounting has set different target standards based on classification. The standards are 60% for junior-level classes, 70% for senior-level classes, and 75% for graduate-level classes. |
Finding |
|
|||
Junior Successes 1,779 Attempts 2,419 Success Ratio 73.5% Minimum Acceptable Rate 60% |
Action |
|
|||
The success ratio exceeds the minimum acceptable level of 60% by about 14 percentage points, and about 13 points better than last year. The faculty teaching courses where Decision Modeling is an objective should continue to place emphasis on this competency, and perhaps evaluate if a change in pedagogy might improve student comprehension. |
GOAL: Functional Competencies For Entry Into The Accounting Profession |
Objective |
|
||||
Risk analysis and control is fundamental to professional service delivery. The identification and management of audit risk (that is, the risk that the auditor will fail to detect a misstatement, caused by inadvertent error or fraud, that is material to financial statements) is the basis for the conduct of a GAAS audit. The understanding of business risk (that is, the risk that an entity - either a client or the prospective accounting professionals employer - will fail to achieve its objectives) affects how business strategy is created and implemented. Elements (Sub-Objectives) include: - Identifies risks of negative outcomes (including fraud) - Evaluates controls that mitigate risk of negative outcomes through prevention or detection and correction - Assesses and controls unmitigated risks through, for example, designing and applying tests - Communicates the impact of identified risks and recommends corrective action |
Indicator |
|
|||
A mix of exam questions, projects, cases, and / or problem assignments, in multiple courses spread across the accounting curriculum, will be used to assess students' achievement on selected sub-objectives of the Risk Analysis competency. The mix depends on the course in which the assessment is being made and the instructor’s choice of instrument and selected sub-objectives. The results from the various classes will be forwarded to the Departmental Assessment Committee. This committee will compile the results and present the findings to the departmental faculty. |
Criterion |
|
|||
In each course, the instructor will determine a minimal acceptable score for each indicator used for assessment in that class. This minimal acceptable score may vary both across classes as well as inside a particular class. This variability is necessary due to the different type of indicators (exam questions, projects, cases, and / or problem assignments) used to assess students' achievement on selected sub-objectives of the Risk Analysis competency. Once the assessment of Risk Analysis is completed in the appropriate courses, the percentage of successful student attempts (number of students successfully completing the specific outcome predetermined success level divided by the total number of students attempting the specific outcome) will be reported for each class. The Departmental Assessment Committee will then compile the reports into an aggregated report that will show the success percentage by classification (junior, senior, and graduate). The Department of Accounting has set different target standards based on classification. The standards are 60% for junior-level classes, 70% for senior-level classes, and 75% for graduate-level classes. |
Finding |
|
|||
Junior Senior Combined Successes 128 106 234 Attempts 165 125 290 Success Ratio 77.6% 84.8% 80.7% Minimum Acceptable Rate 60% 70% |
Action |
|
|||
At the junior level, the success ratio exceeds the minimum acceptable level of 60% by over 17 percentage points, but about 7 percentage points less than last year. At the senior level, the success ratio exceeds the minimum acceptable level of 70% by about 15 percentage points. The faculty teaching courses where Risk Analysis is an objective should continue to place emphasis on this item, and perhaps evaluate if a change in pedagogy might improve student comprehension. |
GOAL: Functional Competencies For Entry Into The Accounting Profession |
Objective |
|
||||
Technology is pervasive in the accounting profession. Individuals entering the accounting profession must acquire the necessary skills to use technology tools effectively and efficiently. These technology tools can be used both to develop and apply other functional competencies. Elements (Sub-Objectives) include: - Accesses appropriate electronic databases to obtain decision-supporting information - Assesses the risk of technology and automated business processes - Uses technology assisted tools to assess and control risk and document work performed - Builds appropriate models and simulations using electronic spreadsheets and other software |
Indicator |
|
|||
A mix of exam questions, projects, cases, and / or problem assignments, in multiple courses spread across the accounting curriculum, will be used to assess students' achievement on selected sub-objectives of the Leveraging Technology competency. The mix depends on the course in which the assessment is being made and the instructor’s choice of instrument and selected sub-objectives. The results from the various classes will be forwarded to the Departmental Assessment Committee. This committee will compile the results and present the findings to the departmental faculty. |
Criterion |
|
|||
In each course, the instructor will determine a minimal acceptable score for each indicator used for assessment in that class. This minimal acceptable score may vary both across classes as well as inside a particular class. This variability is necessary due to the different type of indicators (exam questions, projects, cases, and / or problem assignments) used to assess students' achievement on selected sub-objectives of the Leveraging Technology competency. Once the assessment of Leveraging Technology is completed in the appropriate courses, the percentage of successful student attempts (number of students successfully completing the specific outcome predetermined success level divided by the total number of students attempting the specific outcome) will be reported for each class. The Departmental Assessment Committee will then compile the reports into an aggregated report that will show the success percentage by classification (junior, senior, and graduate). The Department of Accounting has set different target standards based on classification. The standards are 60% for junior-level classes, 70% for senior-level classes, and 75% for graduate-level classes. |
Finding |
|
|||
Junior Senior Combined Successes 705 29 734 Attempts 800 47 847 Success Ratio 88.1% 61.7% 86.7% Minimum Acceptable Rate 60% 70% |
Action |
|
|||
The success ratio at the junior level exceeds the minimum of 60% by about 28 percentage points, about 4 points less than last year. The senior level ratio is about 8 percentage points below the acceptable threshold of 70%, however, investigation revealed a mis-measurement by the faculty teaching this competency [who were new to teaching this competency]. This error is expected to be measured correctly this year [2012]. The faculty teaching courses where Leveraging Technology is an objective should continue to place emphasis on this item, especially faculty teaching senior courses, who should exert care in performing assessment measurements. |
GOAL: Functional Competencies For Entry Into The Accounting Profession |
Objective |
|
||||
Measures used should be both relevant (that is, bear on the decision to be made) and reliable (consistently measure what they purport to measure). Various measurement and disclosure criteria used by accounting professionals - such as GAAP, OCBOA (Other Comprehensive Basis of Accounting) and tax reporting - have been codified to some degree. Other performance measures (such as Economic Value Added) or stated criteria (for example, investment performance) are used for special purposes. Some measurement criteria (such as effectiveness of internal control) are measured qualitatively, rather than quantitatively. Elements (Sub-Objectives) include: - Identifies what needs to be measured - Determines an appropriate, relevant and reliable measure for the intended use - Measures items using appropriate methods of measurement - Presents the measurement results objectively using applicable standards of disclosure or reporting - Resolves ambiguities when estimates are required |
Indicator |
|
|||
A mix of exam questions, projects, cases, and / or problem assignments, in multiple courses spread across the accounting curriculum, will be used to assess students' achievement on selected sub-objectives of the Measurement competency. The mix depends on the course in which the assessment is being made and the instructor’s choice of instrument and selected sub-objectives. The results from the various classes will be forwarded to the Departmental Assessment Committee. This committee will compile the results and present the findings to the departmental faculty. |
Criterion |
|
|||
In each course, the instructor will determine a minimal acceptable score for each indicator used for assessment in that class. This minimal acceptable score may vary both across classes as well as inside a particular class. This variability is necessary due to the different type of indicators (exam questions, projects, cases, and / or problem assignments) used to assess students' achievement on selected sub-objectives of the Measurement competency. Once the assessment of Measurement is completed in the appropriate courses, the percentage of successful student attempts (number of students successfully completing the specific outcome predetermined success level divided by the total number of students attempting the specific outcome) will be reported for each class. The Departmental Assessment Committee will then compile the reports into an aggregated report that will show the success percentage by classification (junior, senior, and graduate). The Department of Accounting has set different target standards based on classification. The standards are 60% for junior-level classes, 70% for senior-level classes, and 75% for graduate-level classes. |
Finding |
|
|||
Juniors Seniors Combined Successes 5,386 195 5,581 Attempts 8,106 262 8,368 Success Ratio 66.4% 74.4% 66.7% Minimum Acceptable Rate 60% 70% |
Action |
|
|||
For juniors, the success ratio exceeds the minimum acceptable level of 60% by about 6 percentage points, an decrease of about 3 percentage points from last year. For seniors, the assessment results exceed the minimum acceptable level of 70% by approximately 4 percentage points, about 1 point less than last year's 75.6%. While both ratios exceed the minimums, there is indication of room for improvement. The faculty teaching courses where Measurement is an objective should place additional emphasis on this item. |
GOAL: Functional Competencies For Entry Into The Accounting Profession |
Objective |
|
||||
Communicating the scope of work and findings or recommendations is an integral part of a professional service. An accounting professional in public practice might issue an audit or attestation report, recommendations for improved services, or tax or financial planning advice. An accounting professional in business, industry, or government might analyze operations or provide communications to the board of directors. Communicating clearly and objectively the work done and the resulting findings is critical to the value of the professional service. Some forms of communication are governed by professional standards (such as the form and content of the standard auditor's report or the required communications to audit committees) or law. Others are based on the service applied and the needs of those to whom the accounting professional reports. Elements (Sub-Objectives) include: - Prepares reports with objectivity, conciseness and clarity - Describes work performed and conclusions reached in a manner that enhances the reports' usefulness - Employs appropriate media in report preparation and presentation |
Indicator |
|
|||
A mix of exam questions, projects, cases, and / or problem assignments, in multiple courses spread across the accounting curriculum, will be used to assess students' achievement on selected sub-objectives of the Reporting competency. The mix depends on the course in which the assessment is being made and the instructor’s choice of instrument and selected sub-objectives. The results from the various classes will be forwarded to the Departmental Assessment Committee. This committee will compile the results and present the findings to the departmental faculty. |
Criterion |
|
|||
In each course, the instructor will determine a minimal acceptable score for each indicator used for assessment in that class. This minimal acceptable score may vary both across classes as well as inside a particular class. This variability is necessary due to the different type of indicators (exam questions, projects, cases, and / or problem assignments) used to assess students' achievement on selected sub-objectives of the Reporting competency. Once the assessment of Reporting is completed in the appropriate courses, the percentage of successful student attempts (number of students successfully completing the specific outcome predetermined success level divided by the total number of students attempting the specific outcome) will be reported for each class. The Departmental Assessment Committee will then compile the reports into an aggregated report that will show the success percentage by classification (junior, senior, and graduate). The Department of Accounting has set different target standards based on classification. The standards are 60% for junior-level classes, 70% for senior-level classes, and 75% for graduate-level classes. |
Finding |
|
|||
Junior Senior Combined Successes 4,286 291 4,577 Attempts 6,136 415 6,551 Success Ratio 69.9% 70.1% 69.9% Minimum Acceptable Rate 60% 70% |
Action |
|
|||
At the junior level, the success ratio exceeds the minimum acceptable level of 60% by nearly 10 percentage points, about the same as last year. The senior level success ratio barely exceed the minimum acceptable level of 70%, an decrease 11 points from last year. The faculty teaching junior level courses where Reporting is an objective should continue to place emphasis on this item, and perhaps evaluate if a change in pedagogy might improve student comprehension. The faculty teaching senior level courses where Reporting is an objective should place additional emphasis on this competency in future semesters. |
Closing the Loop |
At the request of the Department of Accounting Chair, the department faculty met on April 11, 2012, to discuss assessment findings for 2011.
The Department Assessment Committee provided the faculty with copies of the 2011 assessment results [findings] and reviewed those results with the faculty. For the combined [spring and fall] results, all competencies met or exceeded their target minimums [criterion], with 1 exception: the Leveraging Technology competency at the senior course level (determined to be a measurement error). The faculty agreed that future efforts address and emphasize those areas that had the lower scores, even though those scores were passing, in an effort to improve in those areas. Higher scores will also be evaluated for potential improvement and to prevent backsliding. Though the AICPA Core Competencies are assessed at specific points in the curriculum [i.e., in specific courses], the Competencies are in fact "taught" in many courses throughout the curriculum. Consequently, Closing the Loop involves effort in more than just the courses where assessment occurs. Therefore, when assessment results indicate improvement is desired, faculty of courses where that Core Competency is taught [thought not necessarily assessed] will emphasize that competency more in future semesters. That future emphasis could consist of modifying the depth and/or scope of the objective, changing the pedagogy used, or other items as determined by faculty judgment. Of course, even objectives with high assessment scores will be subjected to faculty scrutiny to both 1) determine how student learning could be improved, and 2) to prevent future learning deterioration. Subsequent to the meeting, the action items for each objective, as discussed in the meeting and indicated in this report, were shared with the accounting faculty. |