July 07, 2009
How to Fend Off the Summer Doldrums, Count Mouse Clicks
Mouse click rankings for SSRN downloads covering US News law schools ranked from 23 to 100 by Bridget Crawford can be found on Feminist Law Professors (why starting with 23?) and "since it's the boring dog days of summer, and inspired by Professor Crawford," Brian Leiter tabulated the US News top 15 law schools according to gross SSRN downloads. Who's bored enough to fill in the gap between the 15th and 23rd ranked schools?
On the absurdity of all this, an anonymous commenter to one of Morriss's Volokh Conspiracy posts on rankings years ago wrote:
Downloads just aren't the same as actual citations: Setting aside whether even citations mean anything important about scholarship, a citation, at the very least, means that another scholar respected an article enough to reference it in his or her own work. Downloads don't mean the same thing. An abstract could sell a paper as having an entirely new schema for analyzing an area of law, then the paper could turn out to be garbage. But, SSRN would already reflect the paper as influential. Heck, the attached paper could be a blank .PDF with a catchy title, and it would do well.
[JH]
July 7, 2009 in Info - Antics or Metrics? | Permalink | Comments (1) | TrackBack
April 08, 2009
Jonesing for Law School Rankings?
Experiencing law school rankings withdrawal because US News' traditional March publication date has been pushed back to April 23 this year? Well Avvo has added its own law school rankings to the genre. The site ranks law schools that produce the top "Avvo" rated attorneys. Here's the top 5:
- Yale Law School
- Stanford Law School
- Harvard Law School
- Columbia Law School
- New York University
Click here to browse the law school directory. [JH]
April 8, 2009 in Info - Antics or Metrics? | Permalink | Comments (1) | TrackBack
March 24, 2009
Profiling Social Networks by Analyzing User Tagging Behavior
Can an analysis of the tagging data of users serve as a useful metric to profile social networks? According to Ying Ding, Elin K. Jacob, James Caverlee, Michael Fried and Zhixiong Zhang the answer is a qualified "yes." In Profiling Social Networks: A Social Tagging Perspective, D-Lib Magazine (March/April 2009) the authors report on their investigation of social tagging using data gathered from Delicious, Flickr and YouTube for the years 2005, 2006 and 2007. Preliminary findings indicate that it is possible to profile a social network through the analysis of tagging data. Interestingly, the authors find that Delicious is a more representative venue for analyzing the social tagging behavior of users than either Flickr or YouTube. Are Delicious users more tech savvy? [JH]
March 24, 2009 in Info - Antics or Metrics? | Permalink | Comments (0) | TrackBack
February 11, 2009
Top 50 Cited Authors in HeinOnline's Law Journal Library
HeinOnline has compiled a list of the 50 most frequently cited authors in its Law Journal Library using Hein's new citation analysis tool, ScholarCheck. Here's the top 10:
- Posner, Richard A. cited 12,586 times in 251 articles.
- Sunstein, Cass R. cited 11,521 times in 267 articles.
- Epstein, Richard A. cited 6,194 times in 272 articles.
- Easterbrook, Frank H. cited 6,018 times in 84 articles.
- Prosser, William L. cited 5,585 times in 55 articles.
- Coffee, John C. Jr. cited 5,196 times in 68 articles.
- Delgado, Richard cited 5,165 times in 145 articles.
- Eskridge, William N. Jr. cited 5,029 times in 69 articles.
- Pound, Roscoe cited 4,869 times in 284 articles.
- Fischel, Daniel R. cited 4,703 times in 43 articles
February 11, 2009 in Info - Antics or Metrics? | Permalink | Comments (0) | TrackBack
January 27, 2009
Avvo Blog's Real-Time Law Blog Ranking by Traffic
The Avvo Blog has created an auto-updating list of the top 300 legal blogs, ordered by their traffic rankings using Alexa data. The creators write "because of the way Alexa works, we could not include every blog we would have liked to (no subdomains or folders on non-blog sites), but we are working to change that." That's why our Law Professor Blogs Network comes in fifth place. It's not a blog. It's the domain for some 50 blogs organized under individual subdomains, including LLB. Maybe the matter should have been worked out before going live with the ranking.
Here's the top 5:
- Above the law
- The Volokh Conspiracy
- Talk Left
- Alt House
- Law Professor Blogs Network
[JH]
January 27, 2009 in Info - Antics or Metrics? | Permalink | Comments (0) | TrackBack
January 05, 2009
John Doyle's Law Journal Rankings
John Doyle (Washington and Lee Law School Library) has updated his law journal rankings database through 2008. Here three of the rankings for US law journals. Methodology and complete listing here. [JH]
Combined Factors
1 Harvard Law Review 100
2 The Yale Law Journal 89.6
3 Columbia Law Review 82.4
4 Stanford Law Review 74.7
5 New York University Law Review 68.2
6 California Law Review 66.6
6 University of Pennsylvania Law Review 66.6
8 The Georgetown Law Journal 64.4
9 Virginia Law Review 63.5
10 Cornell Law Review 61.6
Impact Factor
1 The Yale Law Journal 2.9
2 Columbia Law Review 2.75
3 New York University Law Review 2.7
4 Supreme Court Review 2.68
5 Harvard Journal of Law & Technology 2.59
6 Stanford Law Review 2.55
7 Cornell Law Review 2.54
8 Virginia Law Review 2.52
9 University of Pennsylvania Law Review 2.5
10 California Law Review 2.49
10 The Georgetown Law Journal 2.49
Currency Factor
1 The Georgetown Law Journal 5
2 The Yale Law Journal 4.32
3 Harvard Law Review 4.29
4 Cornell Law Review 4.09
5 New York University Law Review 3.89
6 Columbia Law Review 3.81
7 California Law Review 3.8
8 Virginia Law Review 3.63
9 University of Pennsylvania Law Review 3.58
10 Harvard Civil Rights-Civil Liberties Law Review 3.46
January 5, 2009 in Info - Antics or Metrics? | Permalink | Comments (0) | TrackBack
December 01, 2008
Can Your Blog Give Your Boss Clues to What Projects Should Be Assigned to You?
The Myers-Briggs Type Indicator assessment is a personality test employers use as a means to sort out the workforce into productive assignments best suited to individual strengths and weaknesses. It has also been used in modified form to select juries. And now it is the "basis" for analyzing bloggers.
Typealyzer is having its 15 nanoseconds of blogosphere fame. Go to the site, plug in your blog's URL and out pops one of Myers-Briggs' 16 personality types. This blog and every law-related blog I checked except one are the INTJ (introverted, intuitive, thinking and judging) type. Interesting, Slaw.ca is not. Slaw.ca is the ISTJ (introverted, sensing, thinking and judging) type.
The INTJ type represents 2% of the US population. Folks of this type "have original minds and great drive for implementing their ideas and achieving their goals. Quickly see patterns in external events and develop long-range explanatory perspectives. When committed, organize a job and carry it through. Skeptical and independent, have high standards of competence and performance – for themselves and others."
The ISTJ type represents 11% of the US population. Folks of this type are "quiet, serious, earn success by thoroughness and dependability. Practical, matter-of-fact, realistic, and responsible.Decide logically what should be done and work toward it steadily, regardless of distractions. Take pleasure in making everything orderly and organized – their work, their home, their life. Value traditions and loyalty."
Typealzyer is all the rage for the moment but since the protocol for the Myers-Briggs assessment involves answering a series of forced choice questions, I seriously doubt the results; what is your blog's URL is not one of the Myers-Briggs questions. [JH]
December 1, 2008 in Info - Antics or Metrics? | Permalink | Comments (0) | TrackBack
October 10, 2008
Will SSRN Ever Crowdsource Its Digital Depository Like Amazon?
Have you noticed that SSRN has some really exciting new features like simple submissions, a "more intuitive, user-friendly" sign-in "modeled after commonly used websites and forms," and redesigned author and abstract pages? You can also export SSRN paper cites into common bib apps like EndNote and share papers through Digg, Del.icio.us, etc. In other words, no-brainer improvements add-ons, certainly nothing to write home about.
CiteReader, an Infometric Tool. I have been playing around with the Company's CiteReader, a work in progress, but useful should you get curious about the download count noise law schools and their profs like to generate. Take a look at the numbers to put some meat on bony claims based on clicking a mouse button: track (1) number of abstract views, (2) number of downloads of SSRN paper(s); and (3) number of citations of the paper(s) in the SSRN database by law school, by prof, by article. Oops!
Amazon-esque Features. The Company has added one useful feature. On a paper's Abstract Page you will find a "People who downloaded this paper also downloaded" display listing other SSRN papers. Full of hubris, the Company writes:
We love this feature, and many users have actually told us they “found” papers relevant to their research through this list. ... As you can see, it is similar to other features on popular sites like Amazon.
So when will SSRN implement a commenting function to Abstract Pages like Amazon does? It might help abstract viewers make more informed mouse click decisions.
Distributing Works-in-Progress, Why? On a more serious note, Online crowdsourcing might even contribute to improving the quality of legal scholarship. Any SSRN user can see that authors upload to SSRN revised versions of their papers. Perhaps the papers were revised because some downloaders have actually read the papers and emailed the authors comments. But wouldn't crowdsourcing these works-in-progress by online commenting be a plus too? Wouldn't it be a more timely and contemporary way to do this? Contemporary as in using social media, as in SSRN not even having to invent the necessary applications to do this ... [sigh of relief] ... (SSRN isn't exactly known for being a design and implementation coding powerhouse, evidenced once again by the new features listed above).
Remember the bad old days when scholars tried to obtain input from other scholars by circulating drafts in the US mail, hoping recipients would take the time to write back a letter with comments and criticism. In library school we learned about this "informal college" of review and its drawbacks -- unknown writers not getting responses from known experts in the field, useful suggestions and corrections received too late to be added before the article had to be published.
So one has to ask the question, what is the point of e-distributing works-in-progress in SSRN without crowdsourcing via something called the "World Wide Web"? To date it appears to be the narcissistic self-stroking of law prof egos based on absurd download counts. If their articles aren't being cited, at least they are being read downloaded, right? Or from an infometric perspective, at least SSRN's CiteReader provides a psychiatric fix for the academic delusions produced by drinking that info-antic Kool-aid. [JH]
October 10, 2008 in Digital Collections, Info - Antics or Metrics?, Products & Services | Permalink | Comments (0) | TrackBack
September 15, 2008
Most Productive Not-Top 50 Law School Faculties
Roger Williams University School of Law has produced a scholarly productivity study for law schools ranking outside the US News Top 50 using articles published in "top journals" over a 15-year period, 1993-2008.
On a per capita basis, the top five law schools are
- University of San Diego: US News Rank, 82; Peer Review Score, 2.8
- Yeshiva University (Cardozo): 55; 2.7
- Florida State University: 55; 2.8
- University of Richmond: 68; 2.4
- University of Pittsburgh: 73; 2.8
NB: We're talking about articles published, not articles cited. A citation analysis correlated to US News peer review scores for the "not-Top 50" law school faculties would be much more interesting in my humble opinion. Hat tip to Brian Leiter (Chicago), Law School Reports. [JH]
September 15, 2008 in Info - Antics or Metrics? | Permalink | Comments (0) | TrackBack
February 20, 2008
Top 30 Law Prof Blogs: Harmless if not Very Meaningful Competition
Paul Caron (Cincinnati) charts traffic statistics of the "leading blogs" edited by law professors who use SiteMeter to record blog traffic. The selection of blogs is drawn from Dan Solove's "comprehensive" Law Professor Blogger Census, which of course isn't comprehensive (nor claimed by Solove to be) and wouldn't stand up to the population identification rigors needed for a real infometric analysis. But Caron's ranking, harmless if not very meaningful, is good enough for a blog post and a round of back slapping in law school faculty lounges across the country.
Or to put it another way:
Who cares [about law prof blog traffic rankings], you say? Blog Emperor Caron, of course! Curious that four of the top five have almost nothing to do with law; four of the top five are right-wing blogs; and three of the top five have almost no intellectual content. Welcome to the blogosphere! -- Posted by Brian Leiter (Texas)
Indeed, welcome to the academic legal blogosphere law prof style, complete with pathological myopia. Caron's ranking is, shall we say, a tad elitist. It intentionally excludes academic law library/law librarian blogs. He notes, for example, that Law Librarian Blog is not edited by law profs. Apparently my co-editor's credentials as an AAUP-represented tenured faculty member aren't good enough; neither are yours if similarly situated. The academic legal blogosphere must be a very exclusive club; membership, alas, does not require publishing intellectual content.
Of course the information for an inclusive traffic-based "ranking" is readily available thanks to Bonnie Shucha's excellent directory which was updated earlier this month and now lists 140 law library/law librarian blogs, many of which do reside in the academic legal blogosphere.
The giggle factor for info antics about the legal blogosphere is pretty high among law librarians and some, hopefully most, law profs. I wonder if LIS profs use these all too common posts as examples of what infometrics is not. Bottom line: take them for what they are worth -- law blog trivial pursuit.
Kudos to Dennis Kennedy for recognizing the contributions law library/law librarian bloggers make to the legal blogosphere by repeatedly awarding them his annual Blawggie Award for "Best Legal Blog Category".
"I have to be one of the biggest fans of law librarian blogs there is. I learn so much from these blogs and they get named for this award [Best Legal Blog Category] every year. As I said before, 'across the board, these blogs have developed into strong information resources, often with links to primary source information that I'm not sure how I would find otherwise.'" -- Dennis Kennedy
[quoted in our coverage of Kennedy's 2007 Blawggies]
Footnote: Law Librarian Blog would have come in 19th place by visitors and page views for the period covered in Caron's blog ranking. Other academic law library/law librarian blogs may have placed higher if they had been included but I'm sure Caron has other ways to show his appreciation for the contributions academic law librarians make. [JH]
February 20, 2008 in Info - Antics or Metrics? | Permalink | Comments (0) | TrackBack
February 13, 2008
Professional Reading: Review of Metric Services for Digital Libraries and Repositories
Chris Armbruster's (Research Associate, Max Planck Digital Library and Executive Director, Research Network 1989) Access, Usage and Citation Metrics: What Function for Digital Libraries and Repositories in Research Evaluation? is available from SSRN. Here's the abstract for this very interesting and helpful review article:
The growth and increasing complexity of global science poses a grand challenge to scientists: How to organise the worldwide evaluation of research programmes and peers? For the 21st century we need not just information on science, but also meta-level scientific information that is delivered to the digital workbench of every researcher. Access, usage and citation metrics will be one major information service that researchers will need on an everyday basis to handle the complexity of science.
Scientometrics has been built on centralised commercial databases of high functionality but restricted scope, mainly providing information that may be used for research assessment. Enter digital libraries and repositories: Can they collect reliable metadata at source, ensure universal metric coverage and defray costs?
This systematic appraisal of the future role of digital libraries and repositories for metric research evaluation proceeds by investigating the practical inadequacies of current metric evaluation before defining the scope for libraries and repositories as new players. Subsequently the notion of metrics as research information services is developed. Finally, the future relationship between a) libraries and repositories and b) metrics databases, commercial or non-commercial, is addressed.
Service reviewed include: Leiden Ranking, Webometrics Ranking of World Universities, COUNTER, MESUR, Harzing POP, CiteSeer, Citebase, RePEc LogEc and CitEc, Scopus, Web of Science and Google Scholar.
February 13, 2008 in Info - Antics or Metrics?, Professional Readings | Permalink | Comments (0) | TrackBack
February 05, 2008
Some Evidence for the Assimilation of Blogs into the Structure of Legal Literature
| Why Cite to Blogs? |
| There are a number of reasons to cite to blogs. Ones usually identified are factual assertions, crediting/criticizing ideas, and using a blog post as supporting authority but one largely overlooked reason is the role blogs play as informal repositories of downloadable documents. |
Recently Balkinization's Jack Balkin and The Volokh Conspiracy's Orin Kerr observed that the law review citation rate for their blogs has increased somewhat significantly on an annual basis since 2004. This shouldn't come as much of a surprise. Blogs, as Jack Balkin writes "are being assimilated into the larger universe of legal writing and becoming part of the web of [legal] citations."
I took a quick look at annual blog citation rates for 2004-2007 recently and found similar increases. Using LexisNexis, instead of Westlaw (hat tip to PrawfsBlawg's Dan Markel who was wondering why no one seems to use Lexis-Nexis for citation counts anymore), I searched US Law Reviews & Journals Combined and US Federal & State Cases Combined by the domain name of three common blog service providers (blogspot.com, typepad.com, and wordpress.com) to estimate citation rates.
At the outset, I should emphasize that this search method underestimates the number of blog citations, possibly by a wide margin. For example, The Volokh Conspiracy was not captured because its URL, http://volokh.com/, does not identify a blog hosting service while Balkinization was captured because its URL, http://balkin.blogspot.com/, does include one of the blog hosting services I searched. Additional understating is likely due to the fact that this is a document count, not a pure citation count. (Any single counted document may cite two or more blogs, or more than one post from the same blog.)
This built-in undercount does not diminish from the fact that the below statistics do give a sense of the magnitude of the growth rate of blog citations. According to this estimate, blog citations in law reviews and court opinions have grown from about 70 in 2004 to over 500 in 2007 (and still counting since many law reviews have not completed their 2007 publishing cycle). I believe it is fair to say that for 2005 and 2006 blog citations probably grew exponentially on a document count basis, doubling each year.
It is unlikely, however, that any final count for 2007 will show a similar rate of growth. If the case, would this mean that blogs are "on the decline." Doubtful. It would simply mean that the blogging phenomenon is maturing. As with other forms of publication, with age comes acceptance and recognition of place within the structure of legal literature.
|
Click to enlarge. [JH]
February 5, 2008 in Info - Antics or Metrics? | Permalink | Comments (1) | TrackBack
January 17, 2008
Be True to Your School
Check out the ten law schools who graduated the most law teachers on Brian Leiter's Law School Reports. The data was obtained from 7,820 tenured and tenure-track law professors listed in the AALS Directory of Law Teachers.
The data was provided to Leiter by a Michigan Assistant Dean in response to Leiter's recent Ludicrous Hyperbole Watch: University of Michigan Law School post. Leiter (JD '87 and Ph.D in philosophy '95 from Michigan) writes, "The data [as supplied] was presented in aggregate form, which works to the advantage of larger schools like Michigan." Ah yes, crunch the numbers to make your school look good. Leiter reworked the data for a more appropriate per capita ranking.
Beware the thin-skinned law school administrator. [JH]
January 17, 2008 in Info - Antics or Metrics?, Law School News & Views | Permalink | Comments (0) | TrackBack
November 30, 2007
The Monopoly Board of Citation Rankings
Check out Roger Alford's The Monopoly Board of Citation Rankings. Using Brian Leiter's Most Cited Law Professors by Specialty, 2000-2007, Alford assigns each of the 18 specialties covered in Leiter’s 7-year citation study a real estate value based on the 10th most-cited person in each specialty. It's a much more clever illustration than my more mundane citation density graph. [JH]
November 30, 2007 in Info - Antics or Metrics? | Permalink | Comments (0) | TrackBack
November 15, 2007
Just Released: Leiter's Most Cited Law Professors by Specialty, 2000-2007
Editor's Note: The below does not reflected revisions made to Brian Leiter's Most Cited Law Professors by Specialty, 2000-2007 study. [JH]
Brian Leiter has published his study entitled Most Cited Law Professors by Specialty, 2000-2007 at Brian Leiter's Law School Rankings. Here's the announcement on his blog. The study identifies the 10 most cited faculty (in many instances the 20 most cited faculty) in 18 legal specialties. The image (left, click to enlarge) displays the citation density for the top 10 most cited faculty in each specialty. Note how compact Will, Trusts and Estates, Tax, Criminal Law and Procedure, and several other specialties are.
Leiter's study also ranks the top 15 law schools by percentage of faculty in the Top 10 or Top 20 of their specialties. Not surprisingly, Yale ranks first.
If one wishes to estimate a law school's scholarly reputation in a specialty by the number of faculty members listed in Leiter's citation analysis of that specialty then Yale stands out with 4 faculty members in the top 10 for Constitutional and Public Law and 3 in the top 8 for Legal History; Columbia with 3 in the top 4 for Business Law; Harvard with 2 in the top 3 and Georgetown with 3 in the top 10 for Critical Theories; UC-Berkeley with 2 in the top 3 for IP/Cyberlaw; and the University of Chicago with 3 in the top 4 for Law & Economics.
Top Guns. Some top ranked law professors stand out by how many more citations their work has garnered over the next most cited scholar in their specialty. For example:
- Constitutional and Public Law: Cass Sustein's 6,180 citations (first in the field) compared to Laurence Tribe's 3,520 (second);
- Law & Economics: Richard Epstein, first with 3,390 citations, Eric Posner, second with 2,020 (but Epstein has had a 22 year head start);
- Law & Philosophy: Ronald Dworkin, 3,070 followed by Martha Nussbaum, 1,130; and
- Legal Ethics/Legal Profession: Deborah Rhodes with 3,180, Geoffrey Hazard, Jr., 1,140.
A Quick Look at Demographics for the Top 10 Most Cited Law Professors by Specialty
|
| Click on the image for a larger display |
Young Guns. As observed by Leiter, the lists are dominated by faculty in their 50s and 60s but I was surprised to find that the "young guns" are fairly well represented with 16% of the listed Top 10 most cited faculty being under the age of 50, including the following scholars listed in the Top 5 of their specialty:
- Criminal Law and Procedure: Dan Kahan (Yale) age 44 (ranked 1st), William Stuntz (Harvard) 49 (4th)
- Environmental Law: Richard Revesz (New York) 49 (3rd)
- International Law: Jack Goldsmith (Harvard) 45 (1st), Curtis Bradley (Duke) 43 (4th) and Sean Murphy (George Washington) 47 (5th)
- IP/Cyber Law: Mark Lemley (Stanford) 41 (1st), Robert Merges (UC-Berkeley) 48 ((2nd), Dan Burk (Minnesota) 45 (tied for 5th)
- Law & Economics: Eric Posner (Chicago) 42 (2nd), Ian Ayres (Yale) 48 (3rd)
- Law & Social Science: Lee Epstein (Northwestern) 49 (2nd), Jeffrey Rachlinski (Cornell) 41 (5th)
- Tax: Edward McCaffery (USC) 49 (3rd)
Two thirty-somethings made the most cited lists: Robert Sitkoff (Harvard) who at the age of 33 is the seventh most cited scholar in Wills, Trusts & Estates, and Orin Kerr (George Washington) age 36, the 20th most cited scholar in Criminal Law & Procedure. Not bad for a citation study that goes back to 2000.
Gender. Sixteen percent of the Top 10 most cited faculty are women, including the following scholars listed in the Top 5 of their speciality:
- Civil Procedure: Judith Resnik (Yale) (ranked 2nd), Deborah Hensler (Stanford) (4th)
- Critical Theories: Martha Minow (Harvard) (1st), Catharine MacKinnon (Michigan) (5th)
- Environmental Law: Carol Rose (Arizona) (2nd)
- Evidence: Margaret Berger (Brooklyn) (2nd)
- IP/Cyber Law: Pamela Samuelson (Berkeley) (3rd), Jessica Litman (Michigan) (4th), Jane Ginsburg (Columbia) (tied for 5th)
- Labor & Employment: Katherine van Wezel Stone (UCLA) (4th), Cynthia Estlund (New York) (5th)
- Law & Philosophy: Martha Nussbaum (Chicago) (2nd)
- Law & Social Science: Deborah Merrit (OSU) (3rd)
- Legal Ethics/Legal Profession: Deborah Rhode (Stanford) (1st)
- Legal History: Reva Siegel (Yale) (3rd)
Much more detail at Brian Leiter's Most Cited Law Professors by Specialty, 2000-2007. [JH]
November 15, 2007 in Info - Antics or Metrics? | Permalink | Comments (0) | TrackBack
September 14, 2007
Size Still Matters in Latest Per Capita Faculty Productivity Study
Professor Michael Yelnosky, Associate Dean for Academic Affairs at Roger Williams has released this draft "productivity" study of Tier 3 and Tier 4 law schools (Criteria used in study). The Yelnosky study applies features of the method used by Texas law prof Brian Leiter in an earlier 2000-2002 study (Criteria used in study) with some modifications. For example, unlike the Leiter study, the Yelnosky study examines the Top 50 journals, defined as the general law reviews published by the 54 schools receiving the highest peer assessment scores in the U.S. News Rankings (2.8 or higher).
Readers of this blog will note that I respect Leiter's law school rankings studies for their careful employment of objective metrics and equally careful identification and examination of the shortcomings of ranking studies, including his own. See, for example, Top 35 Law Faculties Based on Scholarly Impact for 2007 (one of "those rare citation studies coming out of the legal academy that exemplifies the precision of infometrics, not the carelessness of 'info antics.'").
One metric in Leiter's 200-2002 study that is used in Yelnosky's study, however, is not one of Leiter's best efforts. He applied a points system to the length of articles (0 points for articles under 6 pages; 1 point for articles 6-20 pages; 2 points for articles 21-50 pages; 3 points for articles exceeding 50 pages) and addressed the self-publishing aspect of articles published in-house by halving their point values. Objective? Yes, but the "so what" factor looms large because of the arbitrary nature of the page cutoffs for earning points. For an earlier study using the same methodology for per capita faculty productivity, see Brian Leiter, Measuring the Academic Distinction of Law Faculties, 29 Journal of Legal Studies 451 (2000) [Westlaw].
I agree with Leiter on two issues. Short law review articles and in-house publications should be addressed in per capita faculty productivity studies. But I would not use a points system. Instead I would simply identity both facets in a table and use cumulative stats for data analysis: (1) all articles; (2) all articles longer than X pages; (3) all non-in-house articles, etc.
The Yelnosky study continues the early Leiter "tradition." I'm happy to note that Leiter has not. [JH]
September 14, 2007 in Info - Antics or Metrics? | Permalink | Comments (0) | TrackBack
September 10, 2007
Three Thumbs Down on LLJ Published Info Antics Article
When my co-editor Ron Jones called Nova law profs Robert M. Jarvis and Phyllis Coleman's Ranking Law Reviews by Author Prominence - Ten Years Later, 99 Law Library Journal 573 (2007) to my attention, my first thought was to categorize the work as "Professional Reading." After reviewing the methodology, it's more info antics than metrics. Much more. I have to concur with Brian Leiter's assessment of this work. "This, sad to say, has to be the most pointless ranking exercise since the Cooley silliness, one that truly succeeds in conveying no meaningful information." Ranking Law Reviews by "Author Prominence", Brian Leiter's Law School Reports. See also PropertyProf Blog editor Ben Barros' Law Review Rankings of the Worst Sort ("The contributor scale on page three is just absurd.").
It's one thing to point to Noble laureates as Garfield once did in a "proof of concept" moment but quite another to create a 40-category contributor scale like Jarvis and Coleman does. I'm not listing the "Top X" results from this study for obvious reasons. [JH]
September 10, 2007 in Info - Antics or Metrics? | Permalink | Comments (0) | TrackBack
September 06, 2007
Law Librarian Blog Garners 5th Place in OEDb's Top 25 Librarian Bloggers Ranking
Online Education Database reports that Law Librarian Blog ranks fifth in their Top 25 Librarian Bloggers ranking study. Our blog is also the most popular law librarian blog according to the report. Thanks readers!
In answering the question, "which librarian bloggers have the biggest reach?", OEDb writes "our goal was to show — using objective data from reliable sources — which blogs are the most popular, according to visitor traffic and site backlinks. To this end, we used data for these four metrics to calculate the rankings: (1)Google PageRank, (2) Alexa Rank, (3) Technorati Authority, and (4) Bloglines Subscribers."
The OEDb study apparently excluded blogs by libraries. It would be huge undertaking but hopefully library blogs will be the subject of a future study using the same metrics. BTW, check out OEDb's recently launched Library 2.0-themed blog, called iLibrarian. [JH]
September 6, 2007 in About This Blog, Info - Antics or Metrics? | Permalink | Comments (0) | TrackBack
September 05, 2007
Top 35 Law Faculties Based on Scholarly Impact for 2007
Texas law prof Brian Leiter has published Top 35 Law Faculties Based on Scholarly Impact for 2007 in Brian Leiter's Law School Rankings. Leiter's study, which compiled citation data for all tenure-stream members of the academic faculty (for 2007-08) from 2000 to the present, is a ranking of the top 35 law faculties based on a standard "objective" measure of scholarly impact, namely, per capita citations to faculty scholarship. Leiter cautions that "scholarly impact as measured by citations has important limitations as a proxy for scholarly reputation." In this report he identifies six kinds of phenomena which may skew the correlation between citation and quality.
Top 35 Law Faculties Based on Scholarly Impact for 2007 is one those rare citation studies coming out of the legal academy that exemplifies the precision of infometrics, not the carelessness of "info antics." [JH]
September 5, 2007 in Info - Antics or Metrics?, Scholarship | Permalink | Comments (0) | TrackBack
August 27, 2007
Amazon's Book Sales Ranking Game
The New York Times takes a look at the book sales rankings game on Amazon. From the article, The Highs and the Lows of Rankings on Amazon:
When Amazon created the system 10 years ago, it could hardly have known how greatly its list would change the dynamics of the publishing business (much the way the company itself did) or how hard writers and industry executives would work to game the system. Today the Amazon rankings list — and, to a lesser extent, a similar list on the Barnes & Noble Web site — is the subject of great microanalysis and some mystery.
[JH]
August 27, 2007 in Info - Antics or Metrics? | Permalink | Comments (0) | TrackBack

