Monday, November 19, 2012

How to Increase Your Law School's Academic Reputation

USNewsLaw schools care deeply about their academic reputation.  If this were not true, my Indiana Law mailbox would not be stuffed full with glossy brochures sharing the news of faculty publications, impressive new hires, areas of concentration, and sundry distinguished speaker series, etc. 

Because of the timing of these mailings – I got nearly 100 in Sept and October—I am guessing that the senders hoped to influence the annual U.S. News & World Report Academic Reputation survey.  Cf. Michael Sauder & Wendy Espeland, Fear of Falling: The Effects of U.S. News & World Report Rankings on U.S. Law Schools 1 (Oct 2007) (reporting "increases in marketing expenditures aimed toward raising reputation scores in the USN survey"). But does it work?  A recent study by Larry Cunningham (St. Johns Law) suggests that the effect is, at best, decimal dust.  

Glossy brochures may not reliably affect Academic Reputation, but I have uncovered four factors that are associated with statistically significant increases and decreases of USN Academic Reputation.  To illustrate, consider the scatterplot below, which plots the 1993 ordinal rank of USN Academic Reputation against the 2012 ordinal rank [click on to enlarge].

Acadrep
BarFour sets of dot (Red, Blue, Orange, and Green), each representing distinctive shared features of law schools, tend to be above or below the regression line.  These patterns suggest that changes in USN Academic Reputation over time are probably not the result of random chance. But we will get to the significance of the Red, Blue, Orange, and Green dots soon enough.  

The primary takeaway from the above scatterplot is that 2012 USN Academic Reputation is overwhelmingly a function of 1993 USN Academic Reputation.   Over 88% of the variation is explained by a school's starting point 20 years earlier.  Part of this lock-in effect may be lateral mobility.  That is, there are perks at higher ranked schools: they tend to pay more; the teaching loads are lighter; and the prestige is greater, etc. So school-level reputations rarely change, just the work addresses of the most productive scholars.  This is, perhaps, the most charitable way to explain the enormous stickiness of USN Academic Reputation.

That said, the scatterplot does not show a perfect correlation; slightly less than 12% of the variation is still in play to be explained by influences other than starting position.  A small handful of schools have made progress over these 20 years (these are the schools above the regression line), and a handful have fallen backwards (those below the line).

BarThe Red circles, Blue rectangles, Orange diamonds, and Green circles represent four law school-level attributes.  The Reds have been big gainers in reputation, and so have the Blues. In contrast, the Oranges have all experienced big declines; and as as a group, so have the Greens.  When the attributes of the Red, Blue, Orange, and Green Schools are factored into the regression, all four are statistically signficant (Red, p =.000; Blue, p = .001; Orange, p = .012; Green, p = .000) and the explained variation increases 4% to 92.3%.  As far as linear models goes, this is quite an impressive result. 

Before you look below the fold for answers, any guesses on what is driving the Red and Blue successes and Orange and Green setbacks?

RedChanged the Law School Name (average gain: +39.0)

Red circles are the five law schools that, over the last 20 years, have changed university affiliations and thereby changed their names.  These include:

  • Michigan State University.  In 2004, the Detroit College of Law became Michigan State University College of Law.  DCL was ranked 155 in Academic Reputation in 1993;  in 2012, MSU Law was ranked 96, reflecting a 59 point jump, which is the largest in the dataset.
  • Quinnipiac Law.  In the mid-1990s, the University of Bridgeport Law School became Quinnipiac University School of Law.  This switch in university affiliations came about as the result of law faculty and students wanting to distance themselves from the financial support given to Bridgeport from the Reverend Sun Myung Moon.  Since 1993, Quinnipiac's academic reputation has climbed from 166 to 123 (+43 spots).
  • Seattle University.  In 1994, the University of Puget Sound transferred the sponsorship of its law school to Seattle University, leading to the renaming and relocation of the law school.  The reincarnated law school has fared well in USN Academic Reputation, increasing from 113 to 71 (+42).
  • University of New Hampshire.  In the spring of 2010, Franklin Pierce Law Center signed an affiliation agreement with the University of New Hampshire, the state's flagship public university, and in turn changed its name.  UNH Law has fared well in the USN Academic Reputation survey, climbing from 151 to 123 (+28).
  • Penn State Law.  In 2000, the independent Dickinson School of Law, one of the oldest law schools in the nation, merged with Big 10 powerhouse Penn State University.  The merger has been good for USN Academic Reputation, which has increased from 107 in 1993 to 84 in 2012 (+23).

So, USN Academic Reputation is likely influenced by the halo of a stronger university brand.  But this strategy is only open to a handful of independent law schools and those affiliated with a weak, financially struggling central universities.  So it is not generalizable as a strategy for increasing Academic Reputation.  Sorry to get your hopes up.

Well, what about the Blue retangles?

BlueConservatives Welcome (average gain: +28.3)

This one is a little counterintuitive.  I identifed three research-oriented law schools where, compared to the rest of the legal academy, conservatives have fared well during faculty hiring: George Mason, San Diego, and Pepperdine. Why these three? (If there are other law schools that have tried to build a strong conservative faculty brand, they have escaped my attention.)

  1. George Mason's Law & Economics emphasis.
  2. San Diego Law is a conservative Catholic law school that hosts The Right Coast blog.
  3. Pepperdine Law is a Christian-centered law school that hired Kenneth Starr to serve as dean as dean after he rapped up this tenure as Independent Counsel of the Clinton Whitewater investigation.

As show in the scatterplot above, all three law schools have fared very well in Academic Reputation:  GMU (#76 to #51, +25), San Diego (#69 to #51, +18), and Pepperdine (#107 to #65, +42). 

But wait, fellow academics vote in the USN Academic Reputation survey, and supposedly we are an overwhelmingly liberal.  So why did these three conservative school fare so well?  This could be combination of three factors:

  • Discounts on productive scholars.  Because GMU and San Diego are not put off by conservative credentials, they have gotten highly productive scholars at a discount.  Among law schools on SSRN, GMU Law ranks #18 in all-time downloads and San Diego ranks #21 -- both are significantly higher than these schools' USN Academic Reputation and overall USN rank. But this does not explain Pepperdine, which ranks #117.
  • USN "echo chamber" effect.  My colleague, Jeff Stake, has documented that a school's USN Academic Reputation is influenced by changes in its overall USN ranking.  So, if a school manages to increase its overall rank, USN Academic Reputation then rises.  See Stake, The Interplay between Law School Rankings, Reputations, and Resource Allocation, 81 Ind. L. J. 229 (2006).  A strong conservative brand probably helps a law school attract more than its share of highly credentialed conservative students.  Until 2001, GMU Law was perennially a T2 law school; but in 2012, it was ranked #39.  Likewise, until 2004, Pepperdine was perennially a T3/T4 (note their used to be five USN tiers); but in 2012, it was ranked #49.  In contrast, USD Law (ranked #69 in the USN Overall in 2012) has increased its Academic Reputation significantly but moved sideways in the rankings (query: did USD understand the optimal tradeoffs between LSAT and UGPA?)
  • USN Voters.  The Survey voters are supposedly deans, associates deans, and newly tenured faculty.  It is at least conceivable that administrators are, as a group, less liberal than their faculty.  After all, they have to balance the law school budget each year.  Similarly, law school administrators, who are accountable to central universities, and younger faculty, who just cleared the tenure gauntlet, are probably quite in tune with law schools comprised of highly productive scholars.  And San Diego and GMU Law excel on that metric.  This might be a non-factor.  It is hard to tell.

If moving on USN Academic Reputation is really important to a faculty, the lesson here is, "make a hard, high-profile right turn, and wait a decade."  That said, there are probably not enough spoils to go around for more than a handful of conservative law schools to use this strategy.

Name changes and conversativism are the factors associated with an increases in USN Academic Reputation.  What are negative factors?

OrangeScandals and negative NY Times coverage (average drop: -24.3)

The three orange triangles are three schools that gained unprecedented notoriety based on either a rankings scandal or extensive negative treatment in the New York Times.

  • Scandals.  Illinois and Villanova both voluntarily disclosed that they submitted false admissions credentials to both the ABA and U.S. News.  And both have taken a huge hit:  within the incredibly stickly Tier 1, Illinois's Academic Reputation rank was #22 in 1993, #22 in 2011, and then #39 in 2012 (-17); similarly, Villanova's went from #69 in 1993, to #62 in 2011, to #106 in 2012 (-37).  Quite a severe pummeling by USN voters!
  • New York Times coverage.  In his year long focus on law schools, David Segal of the New York Times signaled out New York Law School as a particularly egregious example of the excesses of law school.  See Segal, Law School Economics: Ka-Ching!, N.Y. Times, July 16, 2011.  If you were teaching in legal education in 2011, you read that article.  New York Law School's Academic Reputation went from #95 in 1993, to #94 in 2011, to #114 in 2012 (-19).  Ironically, New York Law School was embarking on real innovation in the years prior to the story, but negative press in the NY Times, regardless of accuracy or fairness, is a bell that can't be unrung.

The last factor is perhaps the most troubling. 

GreenSchools in the Rust Belt (average drop: -13.0)

There are 31 schools in the so-called Rust Belt, which I define as western PA and NY, Ohio, Michigan, Indiana, Illinois and Wisconsin. These 31 law schools experienced an average USN Academic Reputation decline of 13 spots.  And note, this includes the MSU Law +59 miracle jump and several elite law schools such as Northwestern (-2), Chicago (-3), and Michigan (-3) that are in the highly sticky T14 range.  So, to get a -13 average, we need some really big negative numbers from many law schools.  

Here, I will not name names.  Instead, let me share the ten biggest drops by Rust Belt schools: -17, -20, -27, -30, -34, -34, -42, -43, -46, -49.  Eight of the ten biggest 20-year drops were Rust Belt schools (and one of the remaining two was Villanova, which earned its spot through scandal).

Why is this happening?  Well, the economic center of gravity of the US economy has been moving to the south and west for several decades now.  Although this affects the Northeast just like it does the Midwest, the Northeast has become an agglomeration of "advanced producer services", which includes bankers, consultants, accountants, and lawyers.  See Henderson & Alderson, The Changing Economic Geography of Law U.S. Law Firms (2008) (documenting a large increase in corporate law lawyers in the Northeastern Mid-Atlantic region and the relative hollowing out of corporate lawyers in the Rust Belt, with the exception of Chicago). 

The implication is that regional law schools in the Rust Belt are more likely to be serving a stagnant regional economy.  This is not particularly attractive to prospective law students.  See Henderson & Morriss, Student Quality as Measures by LSAT Scores: Migration Patterns in the U.S. News Rankings Era, 81 Ind. L. J. 163 (2006) (documenting that students will trade down in USN ranking to attend a school in large and growing corporate legal market).  So this is likely the "echo chamber" effect playing itself out in conformity with larger systemic trends affecting the legal market.  See Stake, supra.

Some might argue that the declines are the result of academic snobbery against the flyover states.  If so, this prejudice must have arisen with avengence during the last 20 years.  Or, less plausibly, some might argue that these schools have had a harder time recruiting or retaining sufficiently talented, productive faculty.  Remember, this is the same survey that boosted Detroit College of Law a record +59 jump when it made the 90-mile move to East Lansing ... which is very much in the Rust Belt.  That +59 point jump probably had a lot more to do with a Big Ten brand than the production of high quality faculty scholarship.  

After we consider starting position, the Jeff Stake "echo chamber" effect, scandals, name changes, conservative branding, and basic measure error inherent in any survey work, how much unexplained variation can we really assign to the true changes in the academic quality of law schools?  To my mind, virtually nothing.   

Below is a scatterplot that places Predicted 2012 Academic Reputation (based on starting position, name changes, conservativism, scandals, and Rust Belt status) against Actual 2012 Academic Reputation. [click on to enlarge.]  

Predict academic reputation

The top three outperformers in the new model are Alabama, Georgia State and Stetson.  Was their secret sauce a better faculty, or the echo chamber aided by sunny weather, a growing southern economy, and/or cheap in-state tuition in an era of rising costs?  Regardless, congrats!

Conclusion

Here is a very big puzzle.  Law faculty are comprised of very smart people, yet we organize virtually all of our hiring, strategic plans, and marketing efforts in an effort to make gains in a reputational game that cannot be won.  Why?  That is a very big topic and, alas, the basis for a future post.

[posted by Bill Henderson]

http://lawprofessors.typepad.com/legalwhiteboard/2012/11/how-to-increase-your-law-schools-academic-reputation.html

Data on legal education, Important research, Innovations in legal education, Scholarship on legal education, Structural change | Permalink

Comments

Fascinating stuff. One caveat/question: is it possible (a) that chasing reputation with mailers, etc., does help, (b) but that with most schools all doing it similarly, it cancels out? I'm not sure there's any way to test that: I suppose we could try to identify maybe the few dozen schools that have NOT done reputational marketing (which may not be possible), to see if they have declined -- but even if we found such an effect, it's possible that "not doing marketing" would be just a proxy for another, more substantial variable, like "low on discretionary funds."

But I don't want to make too much of a deal out of this caveat -- you convinced me.

Posted by: Scott Moss | Nov 19, 2012 10:05:20 AM

"Why?"

Come on, it is a simple answer. Money (must justify those ruthlessly over-inflating tuitions and salaries...*somehow*) and blind ego.

It appears that the vast majority of USN&WR voters are more or less ignorant about the vast majority of the schools (thus the preternatural persistence of reputation and the power of renaming - "Hey, I've heard of Seattle...).

Not that it has stopped these self-proclaimed intellectuals from voting - or inspired them to work on a better (or *any*) system of "value add" evaluation - *that* might bruise a few hothouse egos.

(I'm talking about tuition-justifying value-add for the students here - not ego preening a la Richard II or Brian Leiter...).

Posted by: cas127 | Nov 19, 2012 3:31:01 PM

To follow on your question, and Scott's answer: the reputational race is one that cannot be won, but can be lost. Schools are now frantically running to stay in place, and we have examples of what happens to schools that stumble (see: Illinois, Villanova).

Posted by: anonprof06 | Nov 20, 2012 8:55:10 AM

Scott, regarding the question whether lack of marketing imposes a reputational cost, I think Larry Cunningham's study would have captured that. If you don't get a boost for marketing materials, you don't get dinged for doing nothing. Unless Larry's dataset had 90-100% of schools with the same position in a positional arms race (complete unity, which can't be modeled).

I guess I need to study the article to be 100% this did not affect the dataset.

http://papers.ssrn.com/sol3/papers.cfm?abstract_id=2133395

Thanks for the observation, which is worth checking out to be certain that marketing has zero effect. bh.

Posted by: Bill Henderson | Nov 20, 2012 6:47:38 PM

Post a comment