University College
GATEWAY TO GRADUATION
Using Analytics & Benchmarking to ‘Connect the Dots’ Improving Gateway Course Completions, Retention and Graduations Kenneth EA Wendeln – Faculty Kate Thedwall – Faculty Director of Gateway to Graduation
©2014 KEAW v3a
Overall Fall-to-Fall Retention Rates
6 yr IPEDS Graduation Rate 2001-02
DFWs For MY X100 Course
The Challenging ‘BHAG’ Goal ‘Big Hairy Audacious Goal’
~50% of Growth Goal ∆ Achieved or 5% CAGR
http://www.iupui.edu/administration/chancellorsnews/08_soc_slideshow.pdf
GATEWAY COURSE EXPERIENCE CONFERENCE -‐ 2014
3181 Actual
4
Some student characteristics we report, but can’t change!!
Mode of Entry Residency FT vs PT Age & Sex Ethnicity GPA SAT/ACT HS Rank st 1 Generation
Achieved a 16pp Improvement in Overall Fall-Fall Retention at IUPUI Retention F-F 80% 75%
"
16pp (+29%) over 12 yrs
! 71.4%
70%
70.5%
65% 60% 55% 50%
55.4%
45% 40%
F96 F97 F98 F99 F00 F01 F02 F03 F04 F05 F06 F07 F08 F09 F10 F11 F12 F13 Source: KEAW Analysis of IU Retention Reports
GATEWAY COURSE EXPERIENCE CONFERENCE -‐ 2014
7
Retention Efforts Have Improved the Retention Trends For All Fall Modes of Admission
Retention F-F 80% 75% 70%
∧= 1.7pp R2 = .86
FTFT (F-T Beginners) Transfers
71.7%
P-T Beginners 71.3%
65% 60% 55% 53.7%
50% 45% 40%
F96 F97 F98 F99 F00 F01 F02 F03 F04 F05 F06 F07 F08 F09 F10 F11 F12 F13 Source: KEAW Analysis of IU Retention Reports
GATEWAY COURSE EXPERIENCE CONFERENCE -‐ 2014
8
Fall Gateway Course DFW Grades
are Good Predictors of Retention 100%
Fall-to-Fall Retention for All Students Entering in Fall
DFW Grades for Fall Gateway Courses
∧= 8.0
90%
R2 = .86
80%
0%
All Fall Gateway DFW Grades
70%
20.2%
60% 50% 40% 30% 20% 10% 0%
-10%
Retention for All Fall Entering Students
29.2%
-20% -30% -40% -50% -60% -70% -80%
Source: KEAW Analysis of IUPUI DFW Reports
F96 F97 F98 F99 F00 F01 F02 F03 F04 F05 F06 F07 F08 F09 F10 F11 F12 F13
GATEWAY COURSE EXPERIENCE CONFERENCE -‐ 2014
-90%
9
… and so are Fall+Spring DFWs 100%
DFW Grades for Fall+Spring Gateway Courses
Fall-to-Fall Retention for All Students Entering in Fall
90%
R2 = .80
80%
∧= 6.0pp
Fall+Spr DFW Grades
70%
22.0%
60% 50% 40% 30% 20% 10% 0%
0% -5%
29.6%
Retention for All Fall Entering Students
-15% -25% -35% -45%
Expanded the DFW Reporting and Emphasis from not only the Fall …. but also to the Spring & Summer Semesters
Source: KEAW Analysis of IUPUI DFW Reports
F96 F97 F98 F99 F00 F01 F02 F03 F04 F05 F06 F07 F08 F09 F10 F11 F12 F13
GATEWAY COURSE EXPERIENCE CONFERENCE -‐ 2014
-55% -65% -75% -85% -95%
10
Gateway DFWs by Department
7 Year DFW % Change - AY07 to AY13 ✪
Change in DFW% For F06/S07
Geog 138
and F12/S13
Geol 133
MATH -Pre* 1786
50%
✪
MATH -Coll 1686
40%
ANTH 298
★
#
F12/S13 - 22.0%
CIT 252 CHEM 674
20%
FirstYr 641
F06/S07 - 29.6%
PSY 1367
30%
Rel 162
AY Semesters & DFW%
10%
BIOL 611
0%
PHIL 247
Span 190
DEPARTMENT/Class #DFWs in F06/07
Cost of DFWs In Student Tuition $ F06/S07 ~ $10.0 m F07/S08 ~ $ 8.9 m F08/S09 ~ $ 8.7 m
COMM 635
Spea 106 Soc 365
Source: KEAW Analysis of IUPUI DFW Reports v.2 9.9.13
Phys 66 POLS 186
HIST 931
ENG 1133
BUS 932
Econ 108
GATEWAY COURSE EXPERIENCE CONFERENCE -‐ 2014
F09/S10 ~ $ 7.6 m F10/S11 ~ $ 8.2 m F11/S12 ~ $ 8.4 m F12/S13 ~ $ 7.6 m 7 Years ~ $59.4 m Tuition @ $775/DFW 11
Top 20 Gateway Course #DFWs
Change in DFW% from AY12 to AY13 #
Change in DFW% AY12 to AY13 Fall, Spring & Summer
SOC R100 324
FirstYear 397
CHEM C101 462
40%
BIOL K101 260
30%
COMM R110 537
AY F/S/Su & DFW% MATH 11100 564
AY13 - 21.2%
ENG W132 269
0%
HIST H105 977
★ Source: KEAW Analysis of IUPUI DFW Reports
✪
BIOL N261 393
10%
HIST H114 185
AY12 - 22.7%
MATH M118 632
20%
BUS K201 202
✪
DEPARTMENT Course #DFWs in AY13
Top 20 67%
Mid 20 Last 24
BUS A100 283
PSY B110 507
MATH 15300 338 ENG W131 521
MATH M119 265
✪
CHEM C105 251
MATH 11000 277
✪
MATH 00100 454
✪
✪
GATEWAY COURSE EXPERIENCE CONFERENCE -‐ 2014
12
Gateway Page 1 Of 10
# First-Year
Seminars
DFW Trends by Semester
50% 45%
AY13 #Sem Grades # DFWs
3312 397
40% 35% 30%
Fall
25%
Spring Summer
20%
Academic Yr 15% 11%
10% 5% 0% AY10
AY11
AY12
AY13
AY14
GATEWAY COURSE EXPERIENCE CONFERENCE -‐ 2014
15
Quality of TLC Experiences Over Time (Themed Learning Communities) Applied what learned in one course to another course in TLC
5.00 4.75 4.50 4.19
4.19
3.94
3.98
3.75
3.69
3.73
3.50
3.59
4.25 4.00
3.64
4.20
4.17
4.17
3.89
3.92
4.00
3.79 3.51 3.67
3.38
3.25
4.30
3.44
3.66
3.84
4.00 4.00 3.93
3.69 3.83
3.48 3.57 3.34
3.00 Fall 2007
Fall 2008
Fall 2009
Fall 2010
Fall 2011
Understood connections between different disciplines and courses. Applied knowledge gained in TLC in service to the broader community and social issues. Formed friendships that will maintain
Fall 2012
Source: M. J. Hansen & D. J. Trujillo, Research Update, 3/22/13 Reports available at http://research.uc.iupui.edu/
GATEWAY COURSE EXPERIENCE CONFERENCE -‐ 2014
16
Conclusions from TLC Research Update • TLC faculty have developed pedagogical strategies that foster engagement, integrative thinking, and positive learning experiences. • The collective impact of TLC courses may be greater than any one course or intervention. • The positive learning and collaborative environments created by the TLC instructional teams seem to have positive effects on the academic success outcomes for students with diverse backgrounds and with identified “risk factors.” • TLC interventions can have positive impacts on academic success outcomes (academic performance and persistence). Source: M. J. Hansen & D. J. Trujillo, Research Update, 3/22/13 Reports available at http://research.uc.iupui.edu/
GATEWAY COURSE EXPERIENCE CONFERENCE -‐ 2014
17
★ PSY B110 50%
B104
DFW Trends by Semester
45%
2533 507
40%
37% 35%
AY13 #Sem Grades # DFWs
30%
Fall
25%
Spring 20%
20%
Summer Academic Yr
15% 10% 5% 0%
0% AY10
AY11
AY12
AY13
AY14
GATEWAY COURSE EXPERIENCE CONFERENCE -‐ 2014
18
Describing All DFW Students
Nonattenders Noncompliers Low Performers Drop Outs
% of DFWs
Attend Class
Did HWK
Pass Tests
25%
No
No
No
40%
Yes
No
No
25%
Yes
Yes
No
10%
Yes
Yes
Yes
GATEWAY COURSE EXPERIENCE CONFERENCE -‐ 2014
19
Steps to Success Measures 1. Attend Class yes
Obstacles
Intervention Administrative Withdrawal Attend Points
no
Swipe cards at Many life end of class events
no
Check in class Computer records
Not important Points How to do it Bonus before class (Cheating)
3. Prepare for Tests
no
Ask how? Ask % know
Ignorance Bad habits
Practice Mentors Aids
4. Complete the Course
no
Sudden break
High Stress
Flexible Start of class
2. Complete Homework yes
yes
GATEWAY COURSE EXPERIENCE CONFERENCE -‐ 2014
20
✪
Math’s ‘Best Practices’ for Lowering DFW Rates 1. Attendance (8) $ Every class period $ Use the Early Warning System
2. Homework/Quizzes (5)
$ Something due (graded) for every class period $ Quizzes & homework, graded with feedback
3. Prepare for Tests (7) $ Spend time on study skills $ Give practice/sample exams
GATEWAY COURSE EXPERIENCE CONFERENCE -‐ 2014
21
✪
Math’s ‘Best Practices’ … continued 4. Other (6)
$ Provide clear and reasonable expectations $ Give quizzes to make sure students are correctly placed… opportunity to switch courses $ Increase student self-efficacy $ Dress up on the first day $ Get to know everybody’s name $ Invite students to attend campus events outside of class
GATEWAY COURSE EXPERIENCE CONFERENCE -‐ 2014
22
GATEWAY COURSE EXPERIENCE CONFERENCE -‐ 2014
23
It Takes a Village • Focus on student success • Same goal for all constituents • Consistent and frequent messaging • Training & support programs • Data analysis considered important and relevant to decision making • Process is clear to all GATEWAY COURSE EXPERIENCE CONFERENCE -‐ 2014
24
Teaching Faculty • • • • • • •
Communities of Practice Teaching Academy Workshops Symposiums Research Fellowships Travel Grants Annual Retreats
Gateway
Coordinate & Motivate Focus on Student Success
• • • • • • •
Academic & Student Support Student Affairs AES Writing Center Math Assistance Center Speaker’s Lab Bepko Learning Center Counseling and Psychological Services
IUPUI Schools • Cross Discipline Research • Course Coordinators • Retention and DFW Analysis • Professional Development • Campus Culture
Administration • Vice-Chancellor support • Registrar • FLAGS • Administrative Withdrawal • PUL Standards
GATEWAY COURSE EXPERIENCE CONFERENCE -‐ 2014
25
Gateway’s Mutual Benefits Teaching Faculty
Schools & Departments
• Recognition of teaching achievements • Teaching Academy leverage for annual report or class choice • Opportunity for professional development with new disciplines • Funded CoP & Fellowships
• Recognition for Undergrad programs • University attention to Gateway courses • Lower DFW rates/ increased retention • Professional development for faculty without department cost
Students Increased retention leads to increased graduations GATEWAY COURSE EXPERIENCE CONFERENCE -‐ 2014
26
IPEDS Peers for Benchmarking Graduation vs Retention Rates 2000 to 2006 FTFT Fall Cohorts 6 yr Graduation Rate
70%
Temple U Utah
60%
U Illinois Chicago
U Colorado Denver
U New Mexico
U Alabama Birmingham
IUPUI
30% 20% 60%
U South Florida
U Louisville
50% 40%
U Buffalo
N = 75 y = 1.57x – 0.72 R2 = 0.76
Wayne State
65%
70% 75% 80% 1st Year, Fall-Fall Retention
85%
90%
Source: KEAW from CSRDE Retention Reports
IUPUI Cohort Retention & Graduations vs Peer Institutions
GATEWAY COURSE EXPERIENCE CONFERENCE -‐ 2014
27
Using IPEDs Peers for Predicting Graduation Rates from Retention 2000 to 2015 for FTFT Fall Cohorts
6 yr Graduation Rate
70% 60% Cohorts F’08 –F’12
50%
CRG F’15 Goal
F’07 IUPUI
40%
F’06
F’05
30%
F’00
20% 60%
65%
70% 75% 80% 1st Year, Fall-Fall Retention
85%
90%
Source: KEAW from CSRDE Retention Reports
IUPUI Cohort Retention & Graduations vs Peer Institutions
GATEWAY COURSE EXPERIENCE CONFERENCE -‐ 2014
28
The Doubling ‘BHAG’ Goal Achieving 4400 Baccalaureate Degrees in 2009-10
# Baccalaureate Degrees
5,000
Should be met by 2018-19 AY 2018-19
4,500
F’13 Cohort
2017-18 F’12
4,000 2012-13
3,500
R2 = .89
F’07 2009-10
3,000
IUPUI
F’04
2,500 2001-02 F’96 2,000 2,000
2,500
3,000
3,500
4,000
# Retained – Fall Full-Time Beginners & Transfers Source: KEAW from IU Graduation & Retention Reports
GATEWAY COURSE EXPERIENCE CONFERENCE -‐ 2014
29
Next Challenge …. Shortening The Jr/Sr ‘Pipeline’ to Graduation #200
100%
# Baccalaureate Degrees Conferred by IUPUI School in
MED
BUS
83
331
EDUC 204
HERR INFO 87
SWK 53
SCI 319
88
JOUR EGTC 393
36
NUR
PED 179
SPEA
329
138
LIBA 322
IUPUI
SCS +UCOL
average
490
Data Sources:
https://www.iu.edu/~rgistra/eReport/index.php http://reports.iupui.edu/render.aspx/PERSISTENCE RATES/ ONEYRRETN/IUPUI http://reports.iupui.edu/render.aspx/INSTITUTIONAL DATA/ DEGBYSCHL/IUPUI
Fall-to-Fall Retention Jrs & Srs
AY ‘09-10
95%
90%
85%
80%
75%
Average # of Juniors & Seniors in Fall’09 & Spring’10 Semesters per Degree Conferred in FY’09-10
70% 4.5
4
3.5
3
2.5
2
# Juniors + Seniors in the Pipeline to Graduation GATEWAY COURSE EXPERIENCE CONFERENCE -‐ 2014
30
Improving Retention … and Graduation from the ‘Inside Out’ IUPUI Meta-Course Mentoring/Support Courses & & Policies Curriculum My Gateway Class Classes ~475 Faculty
http://gateway.uc.iupui.edu
[email protected] [email protected] GATEWAY COURSE EXPERIENCE CONFERENCE -‐ 2014
31
Midwest Decision Sciences Institute – 2011 Conference
32