Using Analytics & Benchmarking to 'Connect the Dots'

Report 2 Downloads 52 Views
University College

GATEWAY TO GRADUATION

Using Analytics & Benchmarking to ‘Connect the Dots’ Improving Gateway Course Completions, Retention and Graduations Kenneth EA Wendeln – Faculty Kate Thedwall – Faculty Director of Gateway to Graduation

©2014  KEAW  v3a  

Overall Fall-to-Fall Retention Rates

6 yr IPEDS Graduation Rate 2001-02

DFWs For MY X100 Course

The Challenging ‘BHAG’ Goal ‘Big Hairy Audacious Goal’

~50% of Growth Goal ∆ Achieved or 5% CAGR

http://www.iupui.edu/administration/chancellorsnews/08_soc_slideshow.pdf

GATEWAY  COURSE  EXPERIENCE  CONFERENCE  -­‐  2014  

3181 Actual

4

Some student characteristics we report, but can’t change!!

Mode of Entry Residency FT vs PT Age & Sex Ethnicity GPA SAT/ACT HS Rank st 1 Generation

Achieved a 16pp Improvement in Overall Fall-Fall Retention at IUPUI Retention F-F 80% 75%

"

16pp (+29%) over 12 yrs

! 71.4%

70%

70.5%

65% 60% 55% 50%

55.4%

45% 40%

F96 F97 F98 F99 F00 F01 F02 F03 F04 F05 F06 F07 F08 F09 F10 F11 F12 F13 Source: KEAW Analysis of IU Retention Reports

GATEWAY  COURSE  EXPERIENCE  CONFERENCE  -­‐  2014  

7

Retention Efforts Have Improved the Retention Trends For All Fall Modes of Admission

Retention F-F 80% 75% 70%

∧= 1.7pp R2 = .86

FTFT (F-T Beginners) Transfers

71.7%

P-T Beginners 71.3%

65% 60% 55% 53.7%

50% 45% 40%

F96 F97 F98 F99 F00 F01 F02 F03 F04 F05 F06 F07 F08 F09 F10 F11 F12 F13 Source: KEAW Analysis of IU Retention Reports

GATEWAY  COURSE  EXPERIENCE  CONFERENCE  -­‐  2014  

8

Fall Gateway Course DFW Grades

are Good Predictors of Retention 100%

Fall-to-Fall Retention for All Students Entering in Fall

DFW Grades for Fall Gateway Courses

∧= 8.0

90%

R2 = .86

80%

0%

All Fall Gateway DFW Grades

70%

20.2%

60% 50% 40% 30% 20% 10% 0%

-10%

Retention for All Fall Entering Students

29.2%

-20% -30% -40% -50% -60% -70% -80%

Source: KEAW Analysis of IUPUI DFW Reports

F96 F97 F98 F99 F00 F01 F02 F03 F04 F05 F06 F07 F08 F09 F10 F11 F12 F13

GATEWAY  COURSE  EXPERIENCE  CONFERENCE  -­‐  2014  

-90%

9

… and so are Fall+Spring DFWs 100%

DFW Grades for Fall+Spring Gateway Courses

Fall-to-Fall Retention for All Students Entering in Fall

90%

R2 = .80

80%

∧= 6.0pp

Fall+Spr DFW Grades

70%

22.0%

60% 50% 40% 30% 20% 10% 0%

0% -5%

29.6%

Retention for All Fall Entering Students

-15% -25% -35% -45%

Expanded the DFW Reporting and Emphasis from not only the Fall …. but also to the Spring & Summer Semesters

Source: KEAW Analysis of IUPUI DFW Reports

F96 F97 F98 F99 F00 F01 F02 F03 F04 F05 F06 F07 F08 F09 F10 F11 F12 F13

GATEWAY  COURSE  EXPERIENCE  CONFERENCE  -­‐  2014  

-55% -65% -75% -85% -95%

10

Gateway DFWs by Department

7 Year DFW % Change - AY07 to AY13 ✪

Change in DFW% For F06/S07

Geog 138

and F12/S13

Geol 133

MATH -Pre* 1786

50%



MATH -Coll 1686

40%

ANTH 298



#

F12/S13 - 22.0%

CIT 252 CHEM 674

20%

FirstYr 641

F06/S07 - 29.6%

PSY 1367

30%

Rel 162

AY Semesters & DFW%

10%

BIOL 611

0%

PHIL 247

Span 190

DEPARTMENT/Class #DFWs in F06/07

Cost of DFWs In Student Tuition $ F06/S07 ~ $10.0 m F07/S08 ~ $ 8.9 m F08/S09 ~ $ 8.7 m

COMM 635

Spea 106 Soc 365

Source: KEAW Analysis of IUPUI DFW Reports v.2 9.9.13

Phys 66 POLS 186

HIST 931

ENG 1133

BUS 932

Econ 108

GATEWAY  COURSE  EXPERIENCE  CONFERENCE  -­‐  2014  

F09/S10 ~ $ 7.6 m F10/S11 ~ $ 8.2 m F11/S12 ~ $ 8.4 m F12/S13 ~ $ 7.6 m 7 Years ~ $59.4 m Tuition @ $775/DFW 11

Top 20 Gateway Course #DFWs

Change in DFW% from AY12 to AY13 #

Change in DFW% AY12 to AY13 Fall, Spring & Summer

SOC R100 324

FirstYear 397

CHEM C101 462

40%

BIOL K101 260

30%

COMM R110 537

AY F/S/Su & DFW% MATH 11100 564

AY13 - 21.2%

ENG W132 269

0%

HIST H105 977

★ Source: KEAW Analysis of IUPUI DFW Reports



BIOL N261 393

10%

HIST H114 185

AY12 - 22.7%

MATH M118 632

20%

BUS K201 202



DEPARTMENT Course #DFWs in AY13

Top 20 67%

Mid 20 Last 24

BUS A100 283

PSY B110 507

MATH 15300 338 ENG W131 521

MATH M119 265



CHEM C105 251

MATH 11000 277



MATH 00100 454





GATEWAY  COURSE  EXPERIENCE  CONFERENCE  -­‐  2014  

12

Gateway Page 1 Of 10

# First-Year

Seminars

DFW Trends by Semester

50% 45%

AY13 #Sem Grades # DFWs

3312 397

40% 35% 30%

Fall

25%

Spring Summer

20%

Academic Yr 15% 11%

10% 5% 0% AY10

AY11

AY12

AY13

AY14

GATEWAY  COURSE  EXPERIENCE  CONFERENCE  -­‐  2014  

15

Quality of TLC Experiences Over Time (Themed Learning Communities) Applied what learned in one course to another course in TLC

5.00 4.75 4.50 4.19

4.19

3.94

3.98

3.75

3.69

3.73

3.50

3.59

4.25 4.00

3.64

4.20

4.17

4.17

3.89

3.92

4.00

3.79 3.51 3.67

3.38

3.25

4.30

3.44

3.66

3.84

4.00 4.00 3.93

3.69 3.83

3.48 3.57 3.34

3.00 Fall 2007

Fall 2008

Fall 2009

Fall 2010

Fall 2011

Understood connections between different disciplines and courses. Applied knowledge gained in TLC in service to the broader community and social issues. Formed friendships that will maintain

Fall 2012

Source: M. J. Hansen & D. J. Trujillo, Research Update, 3/22/13 Reports available at http://research.uc.iupui.edu/

GATEWAY  COURSE  EXPERIENCE  CONFERENCE  -­‐  2014  

16

Conclusions from TLC Research Update •  TLC faculty have developed pedagogical strategies that foster engagement, integrative thinking, and positive learning experiences. •  The collective impact of TLC courses may be greater than any one course or intervention. •  The positive learning and collaborative environments created by the TLC instructional teams seem to have positive effects on the academic success outcomes for students with diverse backgrounds and with identified “risk factors.” •  TLC interventions can have positive impacts on academic success outcomes (academic performance and persistence). Source: M. J. Hansen & D. J. Trujillo, Research Update, 3/22/13 Reports available at http://research.uc.iupui.edu/

GATEWAY  COURSE  EXPERIENCE  CONFERENCE  -­‐  2014  

17

★ PSY B110 50%

B104

DFW Trends by Semester

45%

2533 507

40%

37% 35%

AY13 #Sem Grades # DFWs

30%

Fall

25%

Spring 20%

20%

Summer Academic Yr

15% 10% 5% 0%

0% AY10

AY11

AY12

AY13

AY14

GATEWAY  COURSE  EXPERIENCE  CONFERENCE  -­‐  2014  

18

Describing All DFW Students

Nonattenders Noncompliers Low Performers Drop Outs

% of DFWs

Attend Class

Did HWK

Pass Tests

25%

No

No

No

40%

Yes

No

No

25%

Yes

Yes

No

10%

Yes

Yes

Yes

GATEWAY  COURSE  EXPERIENCE  CONFERENCE  -­‐  2014  

19

Steps to Success Measures 1.  Attend Class yes

Obstacles

Intervention Administrative Withdrawal Attend Points

no

Swipe cards at Many life end of class events

no

Check in class Computer records

Not important Points How to do it Bonus before class (Cheating)

3.  Prepare for Tests

no

Ask how? Ask % know

Ignorance Bad habits

Practice Mentors Aids

4.  Complete the Course

no

Sudden break

High Stress

Flexible Start of class

2.  Complete Homework yes

yes

GATEWAY  COURSE  EXPERIENCE  CONFERENCE  -­‐  2014  

20



Math’s ‘Best Practices’ for Lowering DFW Rates 1.  Attendance (8) $  Every class period $  Use the Early Warning System

2.  Homework/Quizzes (5)

$  Something due (graded) for every class period $  Quizzes & homework, graded with feedback

3.  Prepare for Tests (7) $  Spend time on study skills $  Give practice/sample exams

GATEWAY  COURSE  EXPERIENCE  CONFERENCE  -­‐  2014  

21



Math’s ‘Best Practices’ … continued 4.  Other (6)

$  Provide clear and reasonable expectations $  Give quizzes to make sure students are correctly placed… opportunity to switch courses $  Increase student self-efficacy $  Dress up on the first day $  Get to know everybody’s name $  Invite students to attend campus events outside of class

GATEWAY  COURSE  EXPERIENCE  CONFERENCE  -­‐  2014  

22

GATEWAY  COURSE  EXPERIENCE  CONFERENCE  -­‐  2014  

23

It Takes a Village •  Focus on student success •  Same goal for all constituents •  Consistent and frequent messaging •  Training & support programs •  Data analysis considered important and relevant to decision making •  Process is clear to all GATEWAY  COURSE  EXPERIENCE  CONFERENCE  -­‐  2014  

24

Teaching Faculty •  •  •  •  •  •  • 

Communities of Practice Teaching Academy Workshops Symposiums Research Fellowships Travel Grants Annual Retreats

Gateway

Coordinate & Motivate Focus on Student Success

•  •  •  •  •  •  • 

Academic & Student Support Student Affairs AES Writing Center Math Assistance Center Speaker’s Lab Bepko Learning Center Counseling and Psychological Services

IUPUI Schools •  Cross Discipline Research •  Course Coordinators •  Retention and DFW Analysis •  Professional Development •  Campus Culture

Administration •  Vice-Chancellor support •  Registrar •  FLAGS •  Administrative Withdrawal •  PUL Standards

GATEWAY  COURSE  EXPERIENCE  CONFERENCE  -­‐  2014  

25

Gateway’s Mutual Benefits Teaching Faculty

Schools & Departments

•  Recognition of teaching achievements •  Teaching Academy leverage for annual report or class choice •  Opportunity for professional development with new disciplines •  Funded CoP & Fellowships

•  Recognition for Undergrad programs •  University attention to Gateway courses •  Lower DFW rates/ increased retention •  Professional development for faculty without department cost

Students Increased retention leads to increased graduations GATEWAY  COURSE  EXPERIENCE  CONFERENCE  -­‐  2014  

26

IPEDS Peers for Benchmarking Graduation vs Retention Rates 2000 to 2006 FTFT Fall Cohorts 6 yr Graduation Rate

70%

Temple U Utah

60%

U Illinois Chicago

U Colorado Denver

U New Mexico

U Alabama Birmingham

IUPUI

30% 20% 60%

U South Florida

U Louisville

50% 40%

U Buffalo

N = 75 y = 1.57x – 0.72 R2 = 0.76

Wayne State

65%

70% 75% 80% 1st Year, Fall-Fall Retention

85%

90%

Source: KEAW from CSRDE Retention Reports

IUPUI Cohort Retention & Graduations vs Peer Institutions

GATEWAY  COURSE  EXPERIENCE  CONFERENCE  -­‐  2014  

27

Using IPEDs Peers for Predicting Graduation Rates from Retention 2000 to 2015 for FTFT Fall Cohorts

6 yr Graduation Rate

70% 60% Cohorts F’08 –F’12

50%

CRG F’15 Goal

F’07 IUPUI

40%

F’06

F’05

30%

F’00

20% 60%

65%

70% 75% 80% 1st Year, Fall-Fall Retention

85%

90%

Source: KEAW from CSRDE Retention Reports

IUPUI Cohort Retention & Graduations vs Peer Institutions

GATEWAY  COURSE  EXPERIENCE  CONFERENCE  -­‐  2014  

28

The Doubling ‘BHAG’ Goal Achieving 4400 Baccalaureate Degrees in 2009-10

# Baccalaureate Degrees

5,000

Should be met by 2018-19 AY 2018-19

4,500

F’13 Cohort

2017-18 F’12

4,000 2012-13

3,500

R2 = .89

F’07 2009-10

3,000

IUPUI

F’04

2,500 2001-02 F’96 2,000 2,000

2,500

3,000

3,500

4,000

# Retained – Fall Full-Time Beginners & Transfers Source: KEAW from IU Graduation & Retention Reports

GATEWAY  COURSE  EXPERIENCE  CONFERENCE  -­‐  2014  

29

Next Challenge …. Shortening The Jr/Sr ‘Pipeline’ to Graduation #200

100%

# Baccalaureate Degrees Conferred by IUPUI School in

MED

BUS

83

331

EDUC 204

HERR INFO 87

SWK 53

SCI 319

88

JOUR EGTC 393

36

NUR

PED 179

SPEA

329

138

LIBA 322

IUPUI

SCS +UCOL

average

490

Data Sources:

https://www.iu.edu/~rgistra/eReport/index.php http://reports.iupui.edu/render.aspx/PERSISTENCE RATES/ ONEYRRETN/IUPUI http://reports.iupui.edu/render.aspx/INSTITUTIONAL DATA/ DEGBYSCHL/IUPUI

Fall-to-Fall Retention Jrs & Srs

AY ‘09-10

95%

90%

85%

80%

75%

Average # of Juniors & Seniors in Fall’09 & Spring’10 Semesters per Degree Conferred in FY’09-10

70% 4.5

4

3.5

3

2.5

2

# Juniors + Seniors in the Pipeline to Graduation GATEWAY  COURSE  EXPERIENCE  CONFERENCE  -­‐  2014  

30

Improving Retention … and Graduation from the ‘Inside Out’ IUPUI Meta-Course Mentoring/Support Courses & & Policies Curriculum My Gateway Class Classes ~475 Faculty

http://gateway.uc.iupui.edu [email protected] [email protected]

GATEWAY  COURSE  EXPERIENCE  CONFERENCE  -­‐  2014  

31

Midwest Decision Sciences Institute – 2011 Conference

32