Showing posts with label Readings. Show all posts
Showing posts with label Readings. Show all posts

Thursday, March 5, 2015

Alternative paths to college completion: Effect of attending a 2-year school on the probability of completing a 4-year degree: Jonathan Sandy, Arturo Gonzalezb, Michael Hilmer

This paper tries to find the effect of attending a 2-year college before attending a 4-year university has on Bachelor degree rates. It uses the National Longitudinal Survey, class of 1972 (NLS72); the 1994 round of the Beginning Postsecondary Study (BPS); and the 1992 round of the sophomore cohort of the High School and Beyond (HSB) as separate data sources to see if their results are consistent. It also uses Oaxaca's method to attempt to separate any potential differences between those who start at 2- year institutions and those who start at 4-year institutions by whether it is due to variations in student quality or variations in institution quality.

The most interesting part for my purposes was the analysis of the HSB data, as this was the data used by Adelman in his first toolbox study. He found transferring from a 2-year to a 4-year institution while earning more than 10 credits at both increased graduation rates. Would these researchers find the same results? They did not, in fact, they found that chances of graduating were 19.3% lower for those who attended 2-year institutions first, and that about 48% of this was due to lower student quality while about 52% was due to lower institution quality. Why the opposite results?

For Sandy, et al., mother some college, father some college, gpa above a B average, female, verbal and quantitative SAT scores, and hours worked were all significant controls. For Adelman, high school performance, having children, continuous enrollment, 1st year grades, dropping many courses first year and overall, and grade trend were all significant controls. He also found sex, whether a student worked or not, and starting at a 4-year university were insignificant, while Socioeconomic status (SES), which Sandy, et al. try to represent with parental education, was only significant at the .1 level.

Given the differences in the findings despite seeming to use the same data, it appears that one of the controls must explain the differences between these findings. In my eyes, the two major factors that Adelman accounted for that Sandy, et al. did not are the subject having a child and continuous enrollment. Between these, it seems like continuous enrollment, one of the biggest factors of Adelman's model, is the likely culprit. Perhaps 2-year students who go directly into 4-year programs have more momentum, or have lower opportunity costs, or were more motivated in the first place, or some other factor that means they are more likely to graduate than those who wait between finishing at a 2-year and attending a 4-year institution. Another potential factor is in the way transfer is described; Adelman requires at least 10 credits from each institution. Perhaps students struggle from the transition from 2-year to 4-year, and thus never complete even 10 credits from the later, still including them in Sandy, et al.'s analysis, but not Adelman's.

Either way, this shows how tangled all this data is and how seemingly similar assessments of  the same data can show wildly different results.

Friday, January 30, 2015

Exploring the Effects of Financial Aid on the Gap in Student Dropout Risks by Income Level: Rong Chen, Stephen DesJardins

Read here

This 2007 study by Rong Chen and Stephen DesJardins attempts to find correlations between income, type of financial aid, and college dropout rates. They use data from Beginning Postsecondary Students survey (BPS:96/01) which followed students nationwide who started as post-secondary students during the 1995-1996 academic year and tracked them for six years, recording their background, financial aid received, and enrollment status, among other factors. The survey had data on those who started at 2-year and 4-year universities, but this study only looked at those who started at a 4-year institution. 

Financial aid was broken down into three categories: Pell grants, loans, and work-study aid. The data set had some holes in it, while for grants and loans it gave an exact amount in dollars for all years, it only gave exact amounts for work-study aid was only reported in year 1, the remaining years only indicated whether this type of aid was received or not. Therefore, the researchers could not test for amount of aid overall, just the type of aid. Income was measured in four categories, lowest, middle, highest, and unreported. Their analysis found that students in the lowest third drop out the most, but all types of aid help in lowering dropout rates. Work-study aid and loans lowered dropout rates about equally for all income levels, but Pell grants were most effective on low income students. 


Update: For their data set, low income meant less than $25,000, middle meant between $25,000 and $75,000, and high was anything above $75,000.



Thursday, January 29, 2015

Adding a timing light to the “tool box”: Stephen DesJardins, Brian McCall, Dennis Ahlburg, and Melinda Moye

Read here

This 2002 paper by Stephen DesJardins et al. is a response to Clifford Adelman's "Answers in the Toolbox Study" (see a summary of that paper in a previous post) with a focus on adding the element of time to their analysis. The researchers believe that different factors will have greater or lesser effect as time goes on. Their model asks, if a subject has not graduated from a 4-year college by time t-1, how does a given factor correlate with graduation. While they mainly use the same factors outlined by Adelman, and agree with many of his conclusions, they show that the effect of different factors change when time is taken into account.

DesJardins et al. use the same data set as Adelman, and start by replicating his results. Afterwards, they start testing various factors, and how they change correlation to gradation over time. In their final model, for example, being male is initially negatively correlated with gradation. But over time, the effect becomes less negative, and by around year 7, being male becomes positively correlated with graduation. Their biggest critique of Adelman was his academic resources factor, which was and index of high school intensity/quality, high school gpa/class rank, and high school test scores. They found the index became less predictive overall when college gpa was included, a fact Adelman acknowledged in his paper "The Toolbox Revisited." Much more interestingly, when they separated academic resources into its three factors, they all had relatively similar, positive prediction power at year one, gpa/rank and test scores declined in influence as time went on, eventually becoming negative, while intensity/quality grew and became much more significant as time passed.

Overall, this study had many of the same findings and limitations as Adelman's "Answers in the Toolbox" study, such as the fact that it has a hard time measuring the effect of student aid due to problems with reporting. Despite its similarities, it adds more credibility to many of Adelman's arguments while highlighting areas where Adelman may be wrong.

Tuesday, January 27, 2015

A Conceptual Model of Nontraditional Undergraduate Student Attrition: John Bean and Barbara Metzner

Read Here

This 1985 paper by John Bean and Barbara Metzner creates a model for attrition rates of nontraditional undergraduates through a literature review of over 70 papers covering traditional 4-year universities, commuter 4-year universities, and 2-year colleges. Their model has six major variables, most of which are made up of an index of factors. These variables are background and defining variables, academic variables, academic outcomes, environmental variables, psychological results, and intent to leave. Bean and Metzner do not test their model, nor propose the significance of each factor. This is problematic, especially considering some of their factors, such as academic advising, a factor in academic variables, are showed as positively correlated to persistence in some studies, negatively correlated in others, and of no effect in others. Despite these problems with the model, I found this paper to be a very useful literature review.

The paper defines nontraditional students somewhat ambiguously: being older than 24, or living off campus and commuting, or studying part time; and not relying on the social structure of the institution and concerning themselves primarily with academic issues at the institution. In other words, nontraditional students tend to be cemented in their lives already and have strong existing social circles outside of school, and they are usually pursuing education for better career prospects. They tend to have more outside obligations, such as family and work, which means they have lower attrition rates despite often having higher gpas. Other notable findings are that, compared to traditional students, they have lower high school gpas, less social connections on campus, transfer to other schools less, and were more stressed.

The main problem with this paper is that all of the studies reviewed looked at attrition rates rather than graduation, and many only examined students for a year or less, so it may be missing important insights, especially after freshman year when many of these studies end. It is also unclear whether many of these studies could determine between students who stopped attending an institution because they were only interested in a class or two for personal enjoyment or occupational incentives, transferred to different schools, or dropped out of higher education all together, an important distinction. Still, this paper clearly shows where we know traditional and nontraditional students differ, and where more research needs to be done.

Friday, January 23, 2015

Nontraditional Undergraduates: Susan Choy

Read Here

This is a 2002 study by Susan Choy that examines the growing number of nontraditional students in US higher education using the National Postsecondary Student Aid Study- 2000 (NPSAS:2000) to examine this population and its characteristics and the Beginning Postsecondary Students Longitudinal Studies- 1996/1998 (BPS:1996/1998) to compare persistence of traditional and nontraditional students. Choy describes a nontraditional student as one who delays enrollment by a year or more, or attends part time at least part of the year, or works full time while enrolled, or is considered financially independent when calculating financial aid, or has a non-spouse dependent, or is a single parent, or does not have a high school diploma. She further breaks down the categories of non-traditional students, those who meet only one of these descriptions are minimally non-traditional, those who meet two or three are moderately nontraditional, and those who meet four or more are highly nontraditional. One problem with this description is that many of them, especially being a single parent and having dependents other than a spouse, are not mutually exclusive and in some cases are contained within each other. Choy gives no justification for why this is justifiable.

The NPSAS:2000 found that 73% of undergraduates in 1999-2000 had at least one nontraditional characteristic; about 27% were traditional, 17% minimally nontraditional, 28% moderately nontraditional and 28% highly nontraditional. Traditional students tended to enroll in public and private not-for-profit 4-year schools, minimally nontraditional students tended to enroll in public 2-year and 4-year schools, and a majority of moderately and highly nontraditional students tended to enroll in public 2-year schools, and together made up a large portion of students at private for-profit institutions.

There was also a traditional-nontraditional split in hours worked and self-identification as student or employee. For traditional students, 30% did not work, 67% worked but considered themselves primarily students, and 3% considered themselves employees. For minimally nontraditional students, those figures were 19%, 71%, and 10%; for moderately nontraditional they were 20%, 43%, and 37%; and for highly nontraditional they were 11%, 22%, and 67%. And while students of all types who worked reported about the same number of benefits of working while studying, the more nontraditional students found the challenges of working while studying to be much greater. For nontraditional students who considered themselves employees first, the main motivations for going to school were gaining skills, earning a degree/certificate, and personal enrichment/investment, each cited in about 80% of the population. Only about 33% said required for job was a motivation.

For students int the (BPS:1996/1998), who enrolled from 1995-1996 with the goal of a certificate or degree, traditional students without a degree were more likely to be enrolled three years later than nontraditional students without a degree. For associates and bachelors degree, the
more nontraditional a student was, the more likely it was that they had dropped out. For traditional and nontraditional students alike, those whose goal was and associates degree were more likely to drop out with no degree after 3 years than those aiming for a bachelors. If they left school at any time for more than four months, both traditional and nontraditional students were equally likely to return to the same institution, but traditional students were more likely to transfer downwards while nontraditional students were more likely to drop out.

Tuesday, January 20, 2015

The Toolbox Revisited: Paths to Degree Completion From High School Through College; Clifford Adelman

Read here

This is a 2006 study by Clifford Adelman where he updates his model from "Answers in the Tool Box. Academic Intensity, Attendance Patterns, and Bachelor's Degree Attainment" using the data from the NELS:88/2000 study, which again follows nationwide students, this time from 8th grade in 1988 through to 2000. While this gives slightly less time to graduate from college than the first study, it is still a useful comparison. Adelman is attempting to test whether his results hold up, how graduation rates have changed, and to address any criticisms of his first piece. (If you have not read the previous post on this paper, you should do so now.)

Academic resources is still a predictor of success, but less so. High school rank/gpa became more important than test scores, and completing Algebra 2 no longer doubled the chance of degree obtainment, now it is required to go beyond Algebra 2.  The reason this factor is weaker is because the model takes more into account of college academics. The NELS:88/2000 included more information on courses taken, which led to some interesting results, such as the fact that 5 or more credits earned over summer drastically improves graduation rates, especially for African-Americans.

Once again, transferring is a mixed bag. For those transferring from a 2 or 4-year institution to a 4-year institution and earn at least 10 credits from each, transferring increases graduation rate. But multiple schools lowers graduation rates. Adelman describes the later case as brought down by students "swirling" back and forth between 2 and 4-year systems, wandering aimlessly. These are the transfers that the system desperately needs to avoid.

Compared to the original model, this one added multiple schools, whether a student was ever part time, and percent of classes dropped after deadline as negatives and summer term credits and cumulative college math credits as positives. Parenthood was no longer a factor, nor was earning less than 20 credits in the first full year. Overall, the model was about as predictive as before, this time continuous enrollment, first year grades, and percent of classes dropped after the deadline were the biggest predictors of graduation. The model still finds race and gender insignificant.

Over these two papers, Adelman's main points are that college success comes from a strong high school foundation and continuous enrollment in school. If we want to study graduation rates, we need to examine students, not institutions, and we need to use hard evidence, not survey data. The system needs to focus on students, setting high expectations, encouraging summer credits, making sure they have a plan and the resources needed to carry it out.

Answers in the Tool Box. Academic Intensity, Attendance Patterns, and Bachelor's Degree Attainment: Clifford Adelman

Read here

This 1999 study is one of the most cited studies on the subject of college graduation, and for good reason. Clifford Adelman uses data from High School & Beyond/Sophomore cohort files, a study that followed a national selection of students from 10th grade in 1980 through to 1993. Researchers tested these students in 10th and 12th grade, asked  them about family background and future ambitions in both these grades, asked about degree obtainment and college experiences throughout the period, and, most importantly, tracked the high school and college transcripts of these participants over the length of the study. Adelman is interested in examining what are the main factors in college graduation, especially for bachelor's degrees, and what society can do to improve these rates.

This study is important for a number of reasons. First, it reconciles what participants report against what the records say. Only asking students leads to faulty results, either because students do not know answers, as is often the case with parental education or salary, because they misunderstand the question, such as those who study abroad for a semester claiming they've only ever attended one school, or they lie by over-reporting the good, such as grade point average (gpa) or under-reporting the bad, such as remedial classes taken. Second, it track students as they move throughout the higher education system, not just how they fair at any particular institution, and it tracks them for an extended period of time. Many surveys, especially before this one, focused only on first or second year performance at the same institution where the participant started, but the goal is not persistence, but graduation. Universities may want to focus on retention rates, but for students, what matters is whether the receive their degree or not.

The first factor Adelman considers is academic resources, a term he borrows from previous research, which attempts to measure academic performance in high school and how it affects college graduation rates. This factor, which is an index obtained by combining intensity of high school classes, test scores, and class rank, becomes one of the major determinants of graduation. Students in the lowest two socio-economic status (SES) quintiles but highest academic resources quintile averaged higher graduation rates than those in the highest SES quintile overall. A great high school education is a strong predictor of college success. Especially important is math; completing Algebra 2 in high school more than doubles the odds of receiving a bachelors degree. SES still has some significance in the model, but academic resources is a much more powerful indicator.

At the time of the study, the phenomena of attending multiple institutions was growing, as it does to this day, and researchers were still behind on how they measured its effects. Transfers can have very different effects on graduation rates depending on the schools being transferred from and to, how many credits earned at each, and whether the original school is transferred back to. For example, students who attend a community college where they earn 10 or more credits, then transfer to a 4-year institution where they earn more than 10 credits have higher graduation rates than those who start of attending a 4-year institution, even though those who attend a 4-year institution first have higher graduation rates overall. Transferring to a school in a different state also increases graduation rates over transfers within a state. But no matter where the student is, the biggest factor is that they are continuously in school, never missing more than 2 semesters or 3 quarters, and this is the second big factor in graduation rates.

Other factors that they study found were significant were whether they had children before 1986 (age 22 to 23), completed less than 20 credits in first complete year, or transferred and did not return to the same institution all of which had negative effects, while improved gpa from freshman year to senior year and freshman gpa, as well as previously mentioned continuous enrollment, academic resources, SES quintile, and transferred from a 2-year college to 4-year college and earned 10 credits at each all had positive effects. Overall, the model had about a 43% explanatory power, mainly coming from continuous enrollment and academic resources. What is interesting is that race and gender have no significant affect on the model, despite numerous attempts to include it, and while SES quintile matters, it is much weaker than expected.