2005 Calendar Year Assessment Report
Program:
MPA Program
Completed By:
Department:
Urban Studies
Date:
Vera Vogelsang-Coombs & Rachel Singer
May 31, 2006
Goal 1:
Students will assume the challenges of public service by having a substantive foundation in general public administration (cited as the generalist outcome).
Outcomes
Students will understand
theories of public
administration.
Research Methods
Student performance in PAD
600, 604, PSC 605/PAD 617
as per rubric.
For 2005 calendar year.
Findings
PAD 600-N=72
65.28% Exemplary
31.94% Satisfactory
1.39% Marginal
1.39% Unsatisfactory
Review
MPA faculty reviewed CY 05
data April 2006.
Actions
See Table 3.
MPA faculty reviewed CY 05
data April 2006.
None at this time.
PAD 604 N=76
69.74% Exemplary
28.95% Satisfactory
1.32% Unsatisfactory
PSC 605/PAD 617 N=67
67.16% Exemplary
26.87% Satisfactory
5.97% Marginal
Students will apply
constitutional and ethical
values of public administration.
Student performance in PAD
634 and 631 as per rubric.
PAD 634 N=31
77.42% Exemplary
22.58% Satisfactory
PAD 631 N=11
45.45% Exemplary
27.27% Satisfactory
27.27% Marginal
Program: MPA Program
Department: Urban Studies
1
2005 Calendar Year Assessment Report
Goal 1:
continued
Outcomes
Students will know how to
apply principles of public
personnel administration.
Research Methods
Student performance in PAD
630 as per rubric.
Findings
PAD 630 N=72
76.39% Exemplary
15.28% Satisfactory
2.78% Marginal
Review
MPA faculty reviewed CY 05
data April 2006.
Actions
None at this time.
Goal 2:
Students will assume the challenges of public service by having methodological skills in general public administration (cited as the methodological outcome).
Outcomes
Students will understand the
fundamentals of quantitative
methods.
Research Methods
Student performance in PAD
501 and PAD 601 as per
rubric.
Findings
86% of 501 students pass 601
in 2005
Review
MPA faculty reviewed CY 05
data April 2006.
Actions
None at this time.
Students will use statistical
analysis effectively.
Student performance in PAD
601 via rubric.
MPA faculty reviewed CY 05
data April 2006.
None at this time.
Students will assess the
economic and revenue
dimensions of public
administration.
Student performance in PAD
603 via rubric.
PAD 601 N=86
39.53% Exemplary
40.70% Satisfactory
16.28% Marginal
3.49% Unsatisfactory
PAD 603 N=66
24.24% Exemplary
69.70% Satisfactory
6.06% Marginal
MPA faculty reviewed CY 05
data April 2006.
See Table 3.
Students will know how to lead
a strategic planning process.
Student performance in
PSC/PAD 635 via rubric.
PSC 635 N=18
100% Exemplary
MPA faculty reviewed CY 05
data April 2006.
See Table 3.
Program: MPA Program
Department: Urban Studies
2
2005 Calendar Year Assessment Report
Goal 3:
Students will develop specialized skills in on of the Program’s substantive area: (1) public management, (2) economic development, and (3) health care administration
(cited as the specialization outcome).
Outcomes
Students will defend their
problem analysis, using
presentation technology,
before a panel of MPA faculty
members and practitioners.
Research Methods
This panel will use a special
rubric that assesses
students on the program’s
six learning goals.
Findings
Thirteen randomly selected capstones
drawn from CY 2005 were evaluated.
The panel of faculty and practitioners
used a special rubric designed to assess
student performance along nine
dimensions. The scale ranged from 1 to
5 (high).
Review
MPA faculty reviewed
CY 05 data April 2006.
Actions
None at this time.
1: written communication: mean of
4.64/s.d. of .5802/variance of .3366
2: Project identification: mean of 4.56/s.d.
of .7938/variance of .63
3: MPA core ideas: mean of
4.48/s.d..7133/variance of .5088
4: Information Gathering: mean of
4.52/s.d. of .7484/variance of .5601
5: Analysis: mean of 4.39/s.d. of
.8098/variance of .6558
6: Project identification: mean of
4.21/s.d. of .8886/variance of .7896
7. Learning: mean of 4.47/s.d. of
.7510/variance of .5640
8. Quality of Oral Presentation: mean of
4.56/s.d. of .7015/variance of .4921
9. Response to Questions: mean of
4.62/s.d. of .6741/variance of .4545
Program: MPA Program
Department: Urban Studies
3
2005 Calendar Year Assessment Report
Goal 3:
continued
Outcomes
Students will prepare a written
problem analysis.
Research Methods
MPA faculty used a special
rubric designed to assess
student performance, based
on the 6 MPA learning goals.
The rubric used a seven-point
scale, from 0 to 6. See MPA
Program Assessment plan.
Thirteen randomly selected
capstones drawn from CY
2005 were evaluated.
Findings
Mean for goal 1=4.57
Mean for goal 2=3.86
Mean for goal 3=3.93
Mean for goal 4=4.11
Mean for goal 5=4.14
Mean for goal 6=3.93
Review
MPA faculty reviewed CY 0305 data (see Table 2) April
2006.
Actions
Noted in Tables 1 and 3.
Review
MPA faculty reviewed data
April 2006. Least improvement
noted in budgeting.
Actions
See table 3.
MPA faculty reviewed the
qualitative data April 2006.
See table 3.
MPA faculty reviewed data
April 2006.
No action at this time.
100% of capstone students
completed the course
successfully in CY 2005.
Goal 4:
The MPA Program uses student feedback to improve the program.
Outcomes
Research Methods
Findings
Students will achieve the
Self-assessment surveys.
Comparative Data from CY
educational goals of the MPA
2004 & CY 2005 selfProgram.
assessments.
Mean comparison of new &
graduating students showed
improvements on 28
dimensions.
Students will evaluate their
MPA Program experience.
End of Program SWOT
Analysis.
Students will evaluate their
MPA Program experience.
Student exit surveys.
Program: MPA Program
Department: Urban Studies
See attachment 1.
CY 05 Strengths,
Weaknesses, Most and Least
Benefit Received, and
Program Improvements
compiled
Comparative data 2000 to
2005
4
Attachment 1: MPA Student Self-Assessment (Calendar Years 2003-2006)
Mean Comparison between New students and Graduating students
Mean, New Students (N = 35)
Mean, Graduating Students (N=70)
4.5
4
3
2.5
2
1.5
1
0.5
MPA Self-Assessment Survey Questions
Que 28
Que 27
Que 26
Que 25
Que 24
Que 23
Que 22
Que 21
Que 20
Que 19
Que 18
Que 17
Que 16
Que 15
Que 14
Que 13
Que 12
Que 11
Que 10
Que 9
Que 8
Que 7
Que 6
Que 5
Que 4
Que 3
Que 2
0
Que 1
Mean of Student responses
3.5
0
3.93
Q28: Identify and understand the impact of
globalization on public Administration.
3.07
Q27: Design/Administer/Analyse surveys
2.79
Q26: Write a grant or proposal effectively
3.46
Q25: Motivate and supervise employess effectively
2.62
Q24: Conduct a cost-benefit analysis
Q23: Lead a stratagic planning process
Q22: Use statistical analysis effectively
3.71
Q21: Work effectively within the political environment
of public administration
3.36
3.71
Q20: Apply constitutional principles / ethical values of
public administration
3.79
Q19: Apply critical thinking skills
3.50
Q18: Use organizational theory
3.69
Q17: Use computers for information gathering and
analysis
Q16: Identify and understand legel issues in
administration
Q15: Provide leadearship in an organization
3.21
Q14: Manage interpersonal conflict
Q13: Analyse competing policy claims
3.86
Q12: Work effectively in a team
3.00
Q11: Assess economic dimensions of an issue.
3.29
Q10: Manage organizational change
3.36
Q9: Analyse revenue issues
3.77
Q8: Evaluate a public program
2
Q7: Work independently without supervision
Q6: Use a spreadsheet in a presentation.
Q5: Make an effective oral presentation
Q4: Effectively express your ideas in a written report.
Q3: Develop a budget proposal
3.43
Q2: Effectively analyse policy issues.
Q1: Effectively analyse management problems
Mean
MPA Graduating Student's Skill Assessment CY 2005
4
3
3.64
3.43
3.86
3.21
2.93
2.71
3.07
2.21
2.50
1
1.77
0
2.50
1
Q28: Identify and understand the impact of
globalization on public Administration.
2.60
Q27: Design/Administer/Analyse surveys
2.20
Q26: Write a grant or proposal effectively
3.10
Q25: Motivate and supervise employess
effectively
2.30
Q24: Conduct a cost-benefit analysis
2.20
Q23: Lead a stratagic planning process
2.80
Q22: Use statistical analysis effectively
3.10
Q21: Work effectively within the political
environment of public administration
2.40
Q20: Apply constitutional principles / ethical
values of public administration
3.60
Q19: Apply critical thinking skills
2.90
Q18: Use organizational theory
3.30
Q17: Use computers for information gathering
and analysis
2.60
Q16: Identify and understand legel issues in
administration
Q15: Provide leadearship in an organization
2.90
Q14: Manage interpersonal conflict
Q13: Analyse competing policy claims
3.60
Q12: Work effectively in a team
2.40
Q11: Assess economic dimensions of an issue.
2.30
Q10: Manage organizational change
2.20
Q9: Analyse revenue issues
Q8: Evaluate a public program
2
Q7: Work independently without supervision
Q6: Use a spreadsheet in a presentation.
3.60
Q5: Make an effective oral presentation
Q4: Effectively express your ideas in a written
report.
2.30
Q3: Develop a budget proposal
Q2: Effectively analyse policy issues.
Q1: Effectively analyse management problems
Mean
MPA Graduating Student's Skills Assessment CY 03-04
4
3
3.90
3.30
3.50
2.90
3.10
2.60
2.10
1.80
MPA Self Assessment Survey Questions
Que 28
Que 27
Que 26
Que 25
Que 24
Que 23
Que 22
Que 21
Que 20
Que 19
Que 18
Que 17
Que 16
Que 15
Que 14
Que 13
Que 12
Que 11
Que 10
Que 9
Que 8
Que 7
Que 6
Que 5
Que 4
Que 3
Que 2
Que 1
Response to MPA Self Assessment Survey Questions
MPA Graduating Student's Skills Assessment, CY 03-04 - CY 05
4.5
4
3.5
3
2.5
Mean, CY 03-04
2
Mean, CY 05
1.5
1
0.5
0