National University Graduation Rates, Retention Rates, and Assessment of Student Learning

advertisement
National University
Graduation Rates, Retention Rates, and Assessment of Student Learning
2014 Academic Year
Graduation Rate - Bachelors
80%
75%
76%
72%
72%
2006
2007
71%
70%
65%
60%
55%
50%
2008
2009
Academic Year
150% Time to Completion (72 months)
Graduation Rate - Masters
80%
75%
70%
65%
65%
60%
61%
58%
57%
55%
50%
2008
2009
2010
Academic Year
150% Time to Completion (36 months)
2011
Retention Rate - Bachelors
90%
85%
80%
75%
70%
70%
2006
2007
68%
70%
70%
65%
60%
55%
50%
2008
2009
Academic Year
Retention Rate - Masters
90%
85%
81%
82%
2008
2009
79%
79%
2010
2011
80%
75%
70%
65%
60%
55%
50%
Academic Year
National University Assessment System
Embedded in National University’s program development process is the alignment of
institutional learning outcomes, program learning outcomes and course learning outcomes.
Program Learning Outcomes Assessment is based on a multi-year planning cycle that culminates
in a Five Year Program Review. Select Program Learning Outcomes are assessed with direct and
indirect measures on an annual basis, and the Program Annual Report (PAR) provides
recommendations for ongoing program improvement and resource allocation.
All PARs are reviewed at the school level by the School Assessment Committee to ensure that
all measures are valid and reliable. The members of the School Assessment committee act as
mentors for the faculty program leads. PARs are reviewed by the department chair, dean, and
graduate council or undergraduate council. Final recommendations to improve student learning
and improve program quality are also considered during the normal budgeting cycle.
As part of the PAR, data on achievement of student learning outcomes is provided and
disaggregated by online classes and on campus classes at the program and institutional levels.
Faculty review and reflect on any gaps and provide plans for improvement in their action
plans. Disaggregated data for online and onsite achievement of student learning outcomes is also
reviewed as part of the Five Year Program Review.
Five Year Program Reviews are based on an inquiry process in which program faculty create an
overarching question that will result in a study of a current issue to inform program change. In
addition, faculty review trend data that is provided by the Office of Educational Effectiveness
&Accreditation. External reviewers are required for the Five Year Review process to review
resources, curriculum and assessment plans.
A final set of recommendations is developed by the program faculty, taking into account
comments from the external review and the appropriate councils. These recommendations are
presented to the Provost, and together with the faculty, dean and council representative, a
Memorandum of Agreement that includes approved recommendations and budget allocations is
developed. Final MOAs are reflected on in the annual program assessment reports.
The use of a multiple-assessment approach is a best practice, and it is encouraged and widely
exercised at National University. Both qualitative and quantitative data are critical components
of PAR. Commonly used data, evidence, and information include, but are not limited to, analysis
of exam results, student portfolios, signature assignments, program exit reviews, and surveys
conducted of students, alumni, and employers.
As the program grows and students complete their degrees, it is important to ascertain the impact
their education has had on their career. This is achieved in two ways. First, alumni survey are
sent out, allowing former graduates a chance to reflect and provide feedback as to how the
curriculum and overall program design impacted their performance in the industry. In addition,
employers are surveyed to assess whether graduates have gained the necessary and relevant skills
to be successful in the specific field. Data from both surveys is summarized and used for
program improvement.
National University’s Assessment Cycle
 Exists in relationship with the Mission, Core Values, Strategic Planning, Five Year
Program Review, and the Assessment Summit.
 Evolves as a systematic yearly planning and review process consistently used by all
schools and departments.
 Contributes to a comprehensive, university-wide approach to assessment. Multiple
methods of data collection and analysis of student learning are used to assess progress
towards achievement of learning outcomes and to make informed decisions regarding
change.
 Provides for regular and ongoing opportunities for faculty engagement and reflection
based on learning results.
Assessment Methods
The assessment plan includes direct and indirect measures for evaluating the achievement of
program learning outcomes of historical, theoretical and research-based knowledge.
Benchmarking is included in the plan.



Direct measure – pre- and post-assessments: Individual items imbedded in course
assignments assess specific program learning outcomes throughout the program. The
Program Lead and the individual faculty member teaching the course will develop the
items. The pre- and post-assessment items measure how learning in a course addresses
the program learning outcomes by comparing program learning outcome-related
knowledge at the beginning of the course to knowledge after completion of the course.
Program Learning Outcomes are assessed at key points in the curriculum to determine
level of learning (Initial, Developed, Mastered).
Direct measure – assignment rubrics: Student scores on signature items in assignment
rubrics in individual courses measure specific program learning outcomes and will
provide direct evidence of learning. Scores will be returned to students with any
necessary suggestions for improvement.
Indirect measure – student program exit survey questions: Upon completion of the
program the students will participate in an exit survey which affords an opportunity to
evaluate the extent to which students have acquired the skills and knowledge outlined in
the program learning objectives.
Results Presentation
The Program Annual Reviews consist of results and comments viewable by all program faculty,
chairs, deans, as well as Undergraduate Council. These groups review and comment on
assessment and improvement. The University implemented Taskstream’s AMS system as a
collaborative work environment and a repository for recommendations from preceding years are
reviewed annually. Presentations on assessment improvements are made at the Annual
Assessment Summit.
Implementation of Results to Improve Program
Based on assessment findings and faculty feedback from the assessment retreat, the Program
Lead Faculty will develop and implement changes. Benchmarking will be included in the
assessment plan.
Program Participation in the Program Annual Review
National University programs are required to assess a minimum of 20 percent of Program
Learning Outcomes annually. Programs participating in a Five Year Review are not required to
complete a Program Annual Review for the same academic year. In addition, programs with
enrollment less than ten students are not required to participate in the Program Annual Review
due to low data.
Student Learning Outcome Data
General
Total
Education
14
47
57
1
119
Programs Participating in FY14 PAR
Eight programs were scheduled to complete a Five Year Review during the 2014 academic year
(5 bachelor, 3 master)
Associate Bachelor Master
2014 Program Annual Review: Outcomes, Measures and Findings
Overall Statistics for the 2014 Program Annual Review Cycle
 There are 119 participating academic degrees
 43% (359/834) outcomes were included (only 20% of outcomes are required per year)
 94% (338/359) of outcomes included have at least one measure specified
 83% (299/359) of outcomes included have measures with findings specified
929 Total Measures
Measure Type/Method
Student Artifact
Exam
Portfolio
Other
Total Direct
363 (39%)
96 (10%)
27 (3%)
139 (15%)
625 (67%)
Survey
Focus Group
Interview
Other
Total Indirect
529 (28%)
5 (0.54%)
5 (0.54%)
29 (3%)
298 (32%)
Unspecified Measure
6 (0.65%)
Measure Level
Course
Program
Institution
Other
Unspecified
389 (42%)
517 (56%)
0 (0%)
5 (0.54%)
18 (2%)
820 Total Measures with Findings
Acceptable Target Achievement
Exceeded
Acceptable
Needs Improvement
Undetermined
405 (49%)
162 (20%)
140 (17%)
113 (14%)
Ideal Target Achievement
Approaching or Met
Needs Improvement
Undetermined
582 (71%)
72 (9%)
166 (20%)
Download