Plinius

Sunday, August 1, 2010

PL 53/10: Practical advocacy

Filed under: statistics — plinius @ 8:32 am

The moment we start to compare libraries, we get into trouble.

Picture: Polaria in Tromsø.

Library rankings must, by definition, put some libraries at the bottom.

Thomas Hennen – Director of Waukesha County Federated Library System in Wisconsin – constructed a widely used index of library quality in the US about ten years ago. In 2008 Keith Curry Lance and Ray Lyons designed a competing index.

Norway has 430 public library systems – one for each municipality. If I create a single library quality index for Norway – and group the libraries by quartiles –

  • about one hundred libraries will be very satisfied – “among the top 25 percent”
  • about one hundred will be rather satisfied – “above the middle”
  • about one hundred will be rather dissatisfied satisfied – “below the middle”
  • about one hundred will be quite unhappy  – “close to the bottom”

Interenational universities – who compete aginst each other in the global market – must accept such quality ratings. But internationally only the top hundred or the top thousand universities count. Libraries are ranked locally, in national or regional settings. Here, even low ranks are painfully visible.

The answer is: differentiate.

Libraries need to focus more on empirical data. Great values, good intentions and stories of individual benefit will not be enough. The political demand for accountability – documenting what you do – is growing. Give us numbers!

But we can differentiate much more. Let libraries compete in many sports: visits, loans, children’s services. Big libraries work under different conditions from small ones. For each particular sport we may divide the libraries into leagues based on size.

Below I illustrate – using Norwegian data.

Five leagues

The five leagues I have chosen include

  • municipalities with more than fifty thousand inhabitants:  14 library systems
  • twenty to fifty: 35 libraries
  • ten to twenty: 57 libraries
  • five to ten: 88 libraries
  • less than five: 234 libraries

The leagues represent the following shares of the population (2009):

  • 37 percent of the population live in municipalities with more than fifty thousand inhabitants:
  • 22 percent in municipalities with twenty to fifty
  • 17 percent in municipalities with ten to twenty
  • 13 percent in municipalities with five to ten
  • 12 percent in municipalities with less than five

In each league libraries may compete in selected “sports”. The choice of indicators requires a process that involves the library community. The extensive consultation process behind BIX may serve as an example.

I do not see this as a purely political process, however. Many technical aspects and arguments need to be brought into the discussion. But a straight technocratic approach, where statisticians decide and librarians follow, is unlikely to work. Decision-oriented statistical systems must combine technical quality and social legitimacy.

Below I have selected twelve indicators to illustrate possible choices:

  1. Visits per capita
  2. Loans per capita
  3. Activity level (= loans + visits per capita)
  4. Loans of children’s books per child
  5. Loans of fiction books per adult
  6. Loans of non-fiction books per adult
  7. Turnover of non-fiction books
  8. Loans of non-book media per capita
  9. Operational costs (=salaries + media expenses per capita)
  10. Productivity (=activity/operational costs)
  11. Reference questions per 100 visits
  12. Active users per 100 capita

At the moment I can only calculate the first ten indicators. The data for (11) and (12) are collected by ABM utvikling, but are not published in a reusable digital format.

In the Metropolitan League (more than fifty thousand), the 2009 results were:

Visits per capita

  1. Asker
  2. Kristiansand
  3. Trondheim

Loans per capita

  • Asker
  • Trondheim
  • Tønsberg

Activity level

  • Asker
  • Tromsø
  • Trondheim

Loans of children’s books per child

  • Tromsø
  • Kristiansand
  • Tønsberg

Loans of fiction books per adult

  • Asker
  • Kristiansand
  • Tønsberg

Loans of non-fiction books per adult

  • Tønsberg
  • Trondheim
  • Bærum

Turnover of non-fiction books

  • Trondheim
  • Drammen
  • Bærum

Loans of non-book media per capita

  • Asker
  • Trondheim
  • Bergen

Operational costs per capita

  • Asker
  • Drammen
  • Bærum

Productivity

  • Trondheim
  • Tromsø
  • Bergen

Comparisons

Asker is clearly the outstanding library in this league, ranking first on five different categories. But money explains part of their (well-deserved) success. The most efficient libraries in this category are Trondheim, Tromsø and Bergen. We also note that as many as eight libraries:

  • Asker
  • Bergen
  • Bærum
  • Drammen
  • Kristiansand
  • Trondheim,
  • Tromsø
  • Tønsberg

can boast of a top three position – on at least one of the ten indicators.

Resources

Plinius

  1. Asker 7,66
  2. Kristiansand 7,16
  3. Trondheim 7,05
Advertisements

Leave a Comment »

No comments yet.

RSS feed for comments on this post. TrackBack URI

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s

Create a free website or blog at WordPress.com.

%d bloggers like this: