Austin Peay State University
Austin Peay State University Predicting academic performance with a personalized course recommendation system
Overview Austin Peay (APSU), one of the fastest-growing universities in Tennessee, is a four-year public masters-level school offering over fifty-six majors and sixty-three different concentrations to a student body of almost 10,000 undergraduates. Located in the Kentucky-Tennessee border town of Clarksville, APSU was originally founded in 1927 as a two-year junior college and teacher training institution. With a commitment to helping students achieve their higher education goals, APSU has successfully grown to become one of the leading colleges and universities operating under the Tennessee Board of Regents, the sixth largest system of public higher education institutions in the US.
2
Challenge INFLUENCING STUDENT SUCCESS
PRE VIEW YOUR SUCCESS. PL AN YOUR SUCCESS
One of the major challenges in higher education today
Having such a diverse population mix requires a
is how to influence student success and persistence
thoughtful and planned approach to student success
to graduation. For APSU, that challenge is complicated
and retention strategies. With traditional methods
due to half of the student demographic being “first
already in place, APSU sought inspiration for a new
generation” - the first member of their family to attend
approach from one of the key variables related to
a higher education institution.
student success: course selection.
Further, almost half of APSU students are also classified
Many students are confronted with such a wide array
as non-traditional or adult learners, typically with families
of course options that navigating their way through a
and part-time jobs. Comparatively, over half of the
degree program can be an overwhelming experience.
students at APSU are also Pell Grant recipients, which
Even with a clear idea of the degree path in hand,
adds yet another dimension to their undergraduate
students weren’t guaranteed to do well in the courses
population profile.
they selected.
For APSU academic leaders, the primary goal was to
APSU asked the question: what if students could know,
motivate and encourage an undergraduate population
up front, the degree program courses in which they
largely in need of first-line help, guidance and
would perform the best? By improving the course
support to successfully persist from freshman year to
selection experience, APSU would be able to help
sophomore year.
students plan for their academic success in a way never thought possible.
3
Solution A PERSONALIZED COURSE RECOMMENDATION SYSTEM
Enter D2L Degree Compass: a real-time, personalized
KEY BENEFITS: • System correctly predicts student letter grades with
course recommendation system that uses predictive
92% accuracy and passing grades with 90% accuracy.
modeling to help pair students with the courses that
• Predictions accurate to within 0.4 of a letter grade.
best fit their academic talents and their selected
• Over 1500 unique courses have been matriculated.
program of study.
• Prediction results have been replicated at three other TN sites with diverse student bodies and institution
The system combines historical course grades with the
types (2 colleges, 1 university)
student’s current academic profile to make individualized course recommendations for their specific degree path.
“The algorithm has been very stable and reliable in its course recommendations and grade predictions and we
Designed and delivered with a $1 million grant from the
are very excited to state that the data is mature enough
Bill and Melinda Gates Foundation, Complete College
to establish the effect of utilizing Degree Compass
America, and the Tennessee Completion Innovation
advice.”
Challenge, Degree Compass guides students to make
Dr. Tristan Denley, Austin Peay State University
the most informed choices about their degree pathway starting on the very first day of school.
4
“Our primary motivation for deploying Degree Compass was to respond to the unique success and retention needs of our complex student population.” Dr. Tristan Denley, Austin Peay State University
5
Result RIGHT STUDENT. RIGHT COURSE. FIRST TIME
Given the fact that, on average, students take up to
Degree Compass has passed more than 1,500 courses
20% more courses than necessary to graduate, Degree
through its recommendation engine and delivered
Compass keeps students on track to graduation with
almost 150,000 grade predictions since APSU’s Spring
the opportunity to preview and plan their success before
2011 deployment. When the model’s predictions were
class even begins.
retrospectively compared with earned grades, Degree
By using predictive modeling to get the right student in
Compass successfully predicted the courses in which
the right course the first time, the APSU implementation
students would achieve an A,B, or C with 90% accuracy —
of Degree Compass has laid a new foundation for student
and predict those marks within 0.4 of a letter grade.
success never thought possible before.
When examining the effectiveness of Degree Compass
With APSU data mature enough to establish the
recommendations, it was found that more than 90% of
benefits of using Degree Compass, more deployments
students who took a 4-star class received an A or a B,
are happening across higher education institutions in
compared with 62% of A or B grades awarded in general.
the Tennessee Board of Regents. Degree Compass is
Between Fall 2010 and Fall 2012, the A, B, and C grades
currently installed at two of the six universities and three
awarded across the diverse APSU student population
of the thirteen community colleges in the system.
revealed an overall increase of 1.4% (5.3 SD shift). By July 2013, 3 more higher education institutions in This statistically significant shift was also apparent for
the state of Tennessee will be implemented and fully
several subpopulations, including African American
operational as part of the final deliverables of the
students (increase of 2.1% or 2.89 SD) and Pell Grant
Gates Foundation grant and the Tennessee Completion
recipients (increase of 3.9% or 7.7 SD) resulting in many
Innovation Challenge. With grade prediction results
hundreds of improved and passing grades over the last
capable of being tabulated and reported for each
two years of deployment.
passing semester, D2L is extremely committed to continue monitoring student success across these
While course selection is just one element of the student
eight pioneering institutions.
success, retention and degree completion discussion, it becomes one of the more important elements when you
If you have any questions on how Degree Compass can
can predict which courses in the degree program that
help you and your institution with your student success
the student would be most academically successful.
strategy, please contact your regional account manager directly or email us at: [email protected].
6
About D2L A global leader in EdTech, D2L is the creator of Brightspace, the world’s first integrated learning platform. The company partners with thought-leading organizations to improve learning through data-driven technology that helps deliver a personalized experience to every learner, regardless of geography or ability. D2L’s open and extensible platform is used by more than 1,100 clients and almost 15 million individual learners in higher education, K–12, healthcare, government, and the enterprise sector—including Fortune 1000 companies. The company has operations in the United States, Canada, Europe, Australia, Brazil, and Singapore. www.brightspace.com | www.D2L.com CONTAC T US
Phone:
1-519-772-0325 (Worldwide)
Toll Free: 1-888-772-0325 (North America)
0-808-234-4235 (United Kingdom and Europe)
0-800-452-069 (New Zealand)
1-800-656-210 (Australia)
0-800-891-4507 (Brazil)
Fax: 1-519-772-0324 Email:
[email protected]
Twitter: @Brightspace Web:
www.brightspace.com | www.D2L.com
© 2014 D2L Corporation. The D2L family of companies includes D2L Corporation, D2L Ltd, D2L Australia Pty Ltd, D2L Europe Ltd, D2L Asia Pte Ltd, and D2L Brasil Soluções de Tecnologia para Educação Ltda. Brightspace, D2L, and other marks (“D2L marks”) are trademarks of D2L Corporation, registered in the U.S. and other countries. Please visit d2l.com/trademarks for a list of other D2L marks.
9
Overview Austin Peay (APSU), one of the fastest-growing universities in Tennessee, is a four-year public masters-level school offering over fifty-six majors and sixty-three different concentrations to a student body of almost 10,000 undergraduates. Located in the Kentucky-Tennessee border town of Clarksville, APSU was originally founded in 1927 as a two-year junior college and teacher training institution. With a commitment to helping students achieve their higher education goals, APSU has successfully grown to become one of the leading colleges and universities operating under the Tennessee Board of Regents, the sixth largest system of public higher education institutions in the US.
2
Challenge INFLUENCING STUDENT SUCCESS
PRE VIEW YOUR SUCCESS. PL AN YOUR SUCCESS
One of the major challenges in higher education today
Having such a diverse population mix requires a
is how to influence student success and persistence
thoughtful and planned approach to student success
to graduation. For APSU, that challenge is complicated
and retention strategies. With traditional methods
due to half of the student demographic being “first
already in place, APSU sought inspiration for a new
generation” - the first member of their family to attend
approach from one of the key variables related to
a higher education institution.
student success: course selection.
Further, almost half of APSU students are also classified
Many students are confronted with such a wide array
as non-traditional or adult learners, typically with families
of course options that navigating their way through a
and part-time jobs. Comparatively, over half of the
degree program can be an overwhelming experience.
students at APSU are also Pell Grant recipients, which
Even with a clear idea of the degree path in hand,
adds yet another dimension to their undergraduate
students weren’t guaranteed to do well in the courses
population profile.
they selected.
For APSU academic leaders, the primary goal was to
APSU asked the question: what if students could know,
motivate and encourage an undergraduate population
up front, the degree program courses in which they
largely in need of first-line help, guidance and
would perform the best? By improving the course
support to successfully persist from freshman year to
selection experience, APSU would be able to help
sophomore year.
students plan for their academic success in a way never thought possible.
3
Solution A PERSONALIZED COURSE RECOMMENDATION SYSTEM
Enter D2L Degree Compass: a real-time, personalized
KEY BENEFITS: • System correctly predicts student letter grades with
course recommendation system that uses predictive
92% accuracy and passing grades with 90% accuracy.
modeling to help pair students with the courses that
• Predictions accurate to within 0.4 of a letter grade.
best fit their academic talents and their selected
• Over 1500 unique courses have been matriculated.
program of study.
• Prediction results have been replicated at three other TN sites with diverse student bodies and institution
The system combines historical course grades with the
types (2 colleges, 1 university)
student’s current academic profile to make individualized course recommendations for their specific degree path.
“The algorithm has been very stable and reliable in its course recommendations and grade predictions and we
Designed and delivered with a $1 million grant from the
are very excited to state that the data is mature enough
Bill and Melinda Gates Foundation, Complete College
to establish the effect of utilizing Degree Compass
America, and the Tennessee Completion Innovation
advice.”
Challenge, Degree Compass guides students to make
Dr. Tristan Denley, Austin Peay State University
the most informed choices about their degree pathway starting on the very first day of school.
4
“Our primary motivation for deploying Degree Compass was to respond to the unique success and retention needs of our complex student population.” Dr. Tristan Denley, Austin Peay State University
5
Result RIGHT STUDENT. RIGHT COURSE. FIRST TIME
Given the fact that, on average, students take up to
Degree Compass has passed more than 1,500 courses
20% more courses than necessary to graduate, Degree
through its recommendation engine and delivered
Compass keeps students on track to graduation with
almost 150,000 grade predictions since APSU’s Spring
the opportunity to preview and plan their success before
2011 deployment. When the model’s predictions were
class even begins.
retrospectively compared with earned grades, Degree
By using predictive modeling to get the right student in
Compass successfully predicted the courses in which
the right course the first time, the APSU implementation
students would achieve an A,B, or C with 90% accuracy —
of Degree Compass has laid a new foundation for student
and predict those marks within 0.4 of a letter grade.
success never thought possible before.
When examining the effectiveness of Degree Compass
With APSU data mature enough to establish the
recommendations, it was found that more than 90% of
benefits of using Degree Compass, more deployments
students who took a 4-star class received an A or a B,
are happening across higher education institutions in
compared with 62% of A or B grades awarded in general.
the Tennessee Board of Regents. Degree Compass is
Between Fall 2010 and Fall 2012, the A, B, and C grades
currently installed at two of the six universities and three
awarded across the diverse APSU student population
of the thirteen community colleges in the system.
revealed an overall increase of 1.4% (5.3 SD shift). By July 2013, 3 more higher education institutions in This statistically significant shift was also apparent for
the state of Tennessee will be implemented and fully
several subpopulations, including African American
operational as part of the final deliverables of the
students (increase of 2.1% or 2.89 SD) and Pell Grant
Gates Foundation grant and the Tennessee Completion
recipients (increase of 3.9% or 7.7 SD) resulting in many
Innovation Challenge. With grade prediction results
hundreds of improved and passing grades over the last
capable of being tabulated and reported for each
two years of deployment.
passing semester, D2L is extremely committed to continue monitoring student success across these
While course selection is just one element of the student
eight pioneering institutions.
success, retention and degree completion discussion, it becomes one of the more important elements when you
If you have any questions on how Degree Compass can
can predict which courses in the degree program that
help you and your institution with your student success
the student would be most academically successful.
strategy, please contact your regional account manager directly or email us at: [email protected].
6
About D2L A global leader in EdTech, D2L is the creator of Brightspace, the world’s first integrated learning platform. The company partners with thought-leading organizations to improve learning through data-driven technology that helps deliver a personalized experience to every learner, regardless of geography or ability. D2L’s open and extensible platform is used by more than 1,100 clients and almost 15 million individual learners in higher education, K–12, healthcare, government, and the enterprise sector—including Fortune 1000 companies. The company has operations in the United States, Canada, Europe, Australia, Brazil, and Singapore. www.brightspace.com | www.D2L.com CONTAC T US
Phone:
1-519-772-0325 (Worldwide)
Toll Free: 1-888-772-0325 (North America)
0-808-234-4235 (United Kingdom and Europe)
0-800-452-069 (New Zealand)
1-800-656-210 (Australia)
0-800-891-4507 (Brazil)
Fax: 1-519-772-0324 Email:
[email protected]
Twitter: @Brightspace Web:
www.brightspace.com | www.D2L.com
© 2014 D2L Corporation. The D2L family of companies includes D2L Corporation, D2L Ltd, D2L Australia Pty Ltd, D2L Europe Ltd, D2L Asia Pte Ltd, and D2L Brasil Soluções de Tecnologia para Educação Ltda. Brightspace, D2L, and other marks (“D2L marks”) are trademarks of D2L Corporation, registered in the U.S. and other countries. Please visit d2l.com/trademarks for a list of other D2L marks.
9
