previous sub-section
Chapter 11— Analysis of JSTOR The Impact on Scholarly Practice of Access to On-line Journal Archives
next sub-section

Results

The data were analyzed to address five core questions related to the impact of JSTOR: (1) how faculty searched for information; (2) which faculty used JSTOR; (3) how journals were used; (4) how the Internet was used; and (5) how journal use and Internet use correlated with JSTOR use.

Information Searching

Table 11.1 summarizes data on how faculty searched for information. The proportion of faculty using the search strategies did not differ significantly by institution or discipline, with the exception of three strategies. First, the proportion of Michigan economists who reported browsing library shelves (46%) was significantly less than the proportion of five-college historians who used this strategy (86%). Second, the proportion of Michigan economists who reported searching card catalogs (14%) was significantly less than the proportion of five-college historians who used this strategy (39%). And finally, the proportion of Michigan economists who reported browsing departmental collections (48%) was significantly greater than the proportion of five-college historians who used this strategy (4%).[1]

Who Used JSTOR

Overall, 67% of the faculty did not use JSTOR,[2] 14% used JSTOR once a year, 11% used JSTOR once a month, and 8% used JSTOR once a week. None of the faculty used JSTOR daily. Table 11.2 summarizes JSTOR frequency of use by type of institution and discipline. A comparison of use by type of institution shows a higher proportion of JSTOR users at the five colleges (42%) than at the University of Michigan (27%). A further breakdown by discipline shows that the five college economists had the highest proportion of users (46%), followed by the Michigan economists (40%), the five-college historians (39%), and the Michigan historians (16%). One way to put JSTOR use into perspective is to compare this activity with similar, more familiar on-line activities, such as literature searching. Overall, 21% of the faculty did not do on-line searches, 25% searched once a year, 25% searched once a month, 25% searched once a week, and 4% searched daily. Table 11.3 summarizes data on the frequency of on-line searching by type of institution and discipline for the same faculty described in Table 11.2. A comparison of on-line searching by type of institution shows a higher proportion of on-line searchers at the five colleges (85%) than at the University of Michigan (76%). A further breakdown by discipline shows that the five-college economists had the highest proportion of searchers (89%), followed by the five-college historians (82%), and the Michigan economists and historians (both 76%).


183
 

TABLE 11.1. Percentage of Faculty by Search Strategy, Type of Institution, and Discipline (n = 151a )

 

University of Michigan

Five Colleges

Search Strategies

Economics (n = 44)

History (n = 54)

Economics (n = 25)

History (n = 28)

Use citations from related publications

84%

96%

100%

100%

Consult a colleague

93%

85%

96%

  89%

Search electronic catalogs for a known item

80%

89%

88%

  89%

Browse library shelves

46%a

83%

72%

  86%b

Browse electronic catalogs

57%

56%

80%

  79%

Use electronic indexes

59%

59%

84%

  64%

Use printed indexes

34%

57%

64%

  82%

Search card catalogs for a known item

14%a

32%

17%

  39%b

Browse departmental collections

48%a

11%

20%

    4%b

Browse card catalogs

2%

20%

24%

  25%

Note: Means with different subscripts differ significantly at p < .01 in the Tukey honestly significant difference test.

a Nine cases were unusable due to incomplete data.

 

TABLE 11.2. Percentage of Faculty by Frequency of JSTOR Use, Type of Institution, and Discipline (n = 147a )

 

University of Michigan

Five Colleges

Frequency of Use

Overall (n = 93)

Economics (n = 43)

History (n = 50)

Overall (n = 54)

Economics (n = 26)

History (n = 28)

neverb

73%

60%

84%

58%

54%

61%

once a year

12%

17%

8%

17%

15%

18%

once a month

9%

14%

4%

14%

19%

10%

once a week

6%

9%

4%

11%

12%

11%

daily

0%

0%

0%

0%

0%

0%

a Thirteen cases were unusable due to incomplete data.

b The "never" category also includes faculty who were unaware of JSTOR.

Figure 11.1 shows a plot of the cumulative percentage of faculty per institution who used JSTOR and who did on-line searches versus the frequency of these activities. For example, looking at the values plotted on the y-axis against the "Monthly" category shows that over three times as many Michigan faculty searched once a month or more (51%) compared with those who used JSTOR at least once a month (15%). Similarly, over two times as many of the five-college faculty searched once a month or more (62%) compared with those who used JSTOR at least once a month (25%). A further breakdown by discipline shows that


184
 

TABLE 11.3. Percentage of Faculty by Frequency of On-Line Searching, Type of Institution, and Discipline (n = 147a )

 

University of Michigan

Five Colleges

Frequency of Searches

Overall (n = 93)

Economics (n = 43)

History (n = 50)

Overall (n = 54)

Economics (n = 26)

History (n = 28)

never

24%

24%

24%

15%

11%

18%

once a year

25%

28%

22%

24%

16%

32%

once a month

25%

22%

28%

26%

34%

18%

once a week

23%

19%

26%

30%

35%

25%

daily

3%

7%

0%

6%

4%

7%

a Thirteen cases were unusable due to incomplete data.

over twice as many of the five-college economists searched once a month or more (73%) than used JSTOR at least once a month (31%), that over six times as many of the Michigan historians searched once a month or more (54%) than used JSTOR at least once a month (8%), that over twice as many of the five-college historians searched once a month or more (50%) than used JSTOR at least once a month (21%), and that over twice as many of the Michigan economists searched once a month or more (48%) than used JSTOR at least once a month (23%).

Journal Use

Table 11.4 summarizes how faculty used features of journals. Across all journal features, patterns of use were similar except in two areas. First, the proportion of Michigan historians who used article abstracts (31%) was significantly smaller than the proportion of Michigan economists (81%), five-college economists (89%), and five-college historians (61%) who used abstracts. Second, the proportion of Michigan economists who used book reviews (49%) was significantly smaller than the proportion of five-college historians (100%), Michigan historians (98%), and five college economists (85%) who used book reviews.

Overall, faculty in the sample reported that they regularly used 8.7 journals, that they subscribed to 4.1 of these journals, and that 2.2 of these journals were also in JSTOR. Table 11.5 summarizes journal use by institution and discipline. There were no significant differences in the number of journals used across institution and discipline, although Michigan historians reported using the most journals (8.9). There were also no significant differences across institution and discipline in the number of paid journal subscriptions among the journals used, although again Michigan historians reported having the most paid subscriptions (4.6). There was a significant difference in the number of journals used regularly by the economists that were also titles in JSTOR (M = 2.9) compared with those used by the historians ([M = 1.7], t [158] = 5.71, p < .01).


185

Figure 11.1.
Cumulative percentage of on-line searchers versus JSTOR users, by frequency of use
and type of institution (n = 147)

Further examination of differences in use of journals shows a much greater consensus among the economists about the importance of the economics journals in JSTOR than among the historians about the history journals in JSTOR. For example, Table 11.6 shows the economists' ranking in order of use of the five economics journals chosen for JSTOR. The American Economic Review was cited among the top ten most frequently used journals by over 75% of both the Michigan and the five-college economists; the Journal of Political Economy was cited


186
 

TABLE 11.4. Percentage of Faculty by Use of Journal Features, Institution, and Discipline (n = 159a )

 

University of Michigan

Five Colleges

Journal Feature

Economics (n = 47)

History (n = 58)

Economics (n = 26)

History (n = 28)

Articles

96%

98%

100%

100%

Tables of contents

81%

86%

100%

96%

Bibliographies

60%

71%

89%

82%

Book reviews

49%b

98%a

85%a

100%a

Article abstracts

81%a

31%b

89%a

61%a

Editorials

13%

24%

35%

43%

Note: Means with different subscripts differ significantly at p < .01 in the Tukey honestly significant difference test.

a One case was unusable due to incomplete data.

 

TABLE 11.5. Number of Journals Used, Number of Paid Subscriptions, and Number of JSTOR Target Journals by Institution and Discipline (n = 160)

 

University of Michigan

Five Colleges

Journals Used

Economics (n = 48)

History (n = 58)

Economics (n = 26)

History (n = 28)

Total

8.6

8.9

8.4

8.7

Number that are paid subscriptions

3.7

4.6

4.0

3.6

Number that are JSTOR target journals

3.1a

1.6b

2.5

1.9b

Note: Means with different subscripts differ significantly at p < .01 in the Tukey honestly significant difference test.

 

TABLE 11.6. Percentage of Economics Faculty Ranking JSTOR Economics Journals as Top Five Most Frequently Used, Next Five Most Frequently Used, and Not Used (n = 74)

 

University of Michigan ( n = 48)

Five Colleges ( n = 26)

Journal

Top Five

Next Five

Not Used

Top Five

Next Five

Not Used

American Economic Review

79%

  6%

15%

66%

15%

19%

Journal of Political Economy

52%

10%

38%

32%

26%

42%

Quarterly Journal of Economics

41%

15%

44%

16%

26%

58%

Econometrica

26%

30%

44%

  8%

15%

77%

Review of Economics and Statistics

18%

28%

54%

12%

34%

54%


187

among the top ten by over 60% of both the Michigan and the five-college economists; and the Quarterly Journal of Economics and the Review of Economics and Statistics were cited among the top ten by over 50% of the Michigan economists and by over 40% of the five-college economists. By contrast, Table 11.7 shows the historians' ranking in order of use of the five history journals chosen for JSTOR. The American Historical Review was cited among the top ten most frequently used journals by over 60% of both the Michigan and the five-college historians. However, none of the other four journals were used by a majority of the historians at Michigan or at the five colleges.

Internet Use

Overall, faculty reported weekly use of e-mail (M = 4.3), monthly use of on-line catalogs (M = 3.2) and the Web (M = 3.0), and two or three uses per year of FTP (M = 2.3) and on-line database (M = 2.1). Table 11.8 summarizes the use of these Internet applications by institution and discipline. In terms of e-mail use, Michigan historians (M = 3.3) were significantly lower than the Michigan economists (M = 4.9), the five-college economists (M = 5.0), and the five-college historians (M = 4.7). In terms of World Wide Web use, Michigan historians (M = 1.8) were significantly lower than everyone, while the five-college historians (M = 2.9) were significantly lower than the five-college economists (M = 4.2) and the Michigan economists (M = 3.9). In terms of FTP use, the Michigan historians (M = 1.4) and the five-college historians (M = 1.7) differed significantly from the Michigan economists (M = 3.4) and the five-college economists (M = 2.7). In terms of on-line database use, the Michigan historians (M = 1.6) were significantly lower than the five-college economists (M = 2.9). Faculty did not differ significantly in terms of on-line catalog use.

The Relationship of Journal and Internet Use to JSTOR Use

Examination of the frequency of JSTOR use among faculty aware of JSTOR (n = 78) showed that 58% of the respondents had varying levels of use, while 42% reported no use. Using the frequency of JSTOR use as the dependent variable, the faculty who reported no use were censored on the dependent variable. The standard zero, lower-bound tobit model was designed for this circumstance (Tobin 1958). Most important, by adjusting for censoring, the tobit model allows inclusion of negative cases in the analysis of variation in frequency of use among positive cases, which greatly enhances degrees of freedom. Therefore, hierarchical tobit regression analyses were used to examine the influence of demographic characteristics, journal use, search preferences, Internet use, and attitude toward computing on the frequency of JSTOR use. Independent variables used in these analyses were selected on the basis of significance in univariate tobit regressions


188
 

TABLE 11.7. Percentage of History Faculty Ranking JSTOR History Journal as Top Five Most Frequently Used, Next Five Most Frequently Used, and Not Used (n = 86)

 

University of Michigan ( n = 58)

Five Colleges ( n = 28)

Journal

Top Five

Next Five

Not Used

Top Five

Next Five

Not Used

American Historical Review

44%

19%

37%

58%

24%

18%

Journal of American History

31%

  6%

63%

39%

  4%

57%

Journal of Modern History

15%

10%

75%

18%

11%

71%

William and Mary Quarterly

13%

  6%

81%

15%

  3%

82%

Speculam

  9%

  3%

88%

11%

10%

79%

 

TABLE 11.8. Mean Frequency of Computer Application Use over Direct Connection (High-Speed Network) by Institution and Discipline (n = 158a )

 

University of Michigan

Five Colleges

Computer Application

Economics (n = 47)

History (n = 57)

Economics (n = 26)

History (n = 28)

E-mail

4.9a

3.3b

5.0a

4.7a

On-line catalogs

3.3

2.8

3.6

3.7

On-line databases

2.3

1.6a

2.9b

2.1

World Wide Web

3.9a

1.8b

4.2a

2.9c

File Transfer Protocol (FTP)

3.4a

1.4b

2.7a

1.7b

Note: Frequency of use was reported on a 5-point scale (1 = never; 2 = 2-3 times per year; 3 = monthly; 4 = weekly; 5 = daily).

Note: Means with different subscripts differ significantly at p < .01 in the Tukey honestly significant difference test.

a Two cases were unusable due to incomplete data.

on the frequency of use variable. Table 11.9 summarizes the independent variables used in the multiple tobit regression analyses.

Table 11.10 summarizes the results of the hierarchical tobit regression of demographic, journal use, search preference, Internet use, and computing attitude variables on frequency of JSTOR use. The line second from the bottom in Table 11.10 summarizes the log likelihood score for each model. Analysis of the change in log likelihood score between adjacent models gives a measure of the significance of independent variables added to the model. For example, in Model 1, the addition of the demographic variables failed to produce a significant change in the log likelihood score compared to the null model. By contrast, in Model 2, the addition of journal use variables produced a significant change in the log likelihood score compared to Model 1-suggesting that the addition of the journal


189
 

TABLE 11.9. Descriptive Statistics for Faculty Aware of JSTOR (n = 78)

Variable

Mean

Std

At Michigan

49%

  -

In economics

54%

  -

Male

82%

  -

Years since degree

17.2

11.5

Copies articles

  3.09

  0.91

Puts articles on reserve

  2.73

  1.15

Reads abstracts

68%

  -

Total # subs., JSTOR

  2.5

  1.5

Total # subs., all

  8.8

  1.96

# paid subs.

  4.04

  2.43

Uses on-line indexes

60%

  -

Searches on-line catalog

85%

  -

Browses on-line catalog

65%

  -

Frequency of on-line catalog use

  3.47

  1.25

Frequency of on-line database use

  2.33

  1.31

Frequency of WWW use

  3.47

  1.62

Frequency of FTP use

  2.39

  1.42

Attitude toward computing

  3.52

  0.70

Frequency of JSTOR use

  2.05

  2.09

use variables improved the fit in Model 2 over Model 1. Similarly, the addition of search variables in Model 3 and of Internet use variables in Model 4 both produced significant improvements in fit, but the addition of the computer attitude variable in Model 5 did not. Therefore, Model 4 was selected as the best model. From Model 4, the coefficients for gender, article copying, abstract reading, and searching on-line catalogs are all positive and significant. These results suggest that, controlling for other factors, men were 0.77 points higher on frequency of JSTOR use than were women, that there was a 0.29-point increase in the frequency of JSTOR use for every point increase in the frequency of article copying, that faculty who read article abstracts were 0.82 points higher on frequency of JSTOR use than were faculty who didn't read abstracts, and that there was a 1.13point increase in the frequency of JSTOR use for every point increase in the frequency of on-line catalog searching. From Model 4, the coefficients for affiliation with an economics department and the number of paid journal subscriptions are both negative and significant. These results suggest that, controlling for other factors, economists were 0.88 points lower on frequency of JSTOR use than were historians and that there was a 0.18-point decrease in frequency of JSTOR use for every unit increase in the number of paid journal subscriptions.


190
 

TABLE 11.10. Tobit Regression on Frequency of JSTOR Use among Faculty Aware of JSTOR (n = 78)

Variable

Model 1

Model 2

Model 3

Model 4

Model 5

Constant

  0.56

-2.45*

-3.89***

-3.86***

-4.63***

At Michigan

-0.11

   .28

   .47

   .47

   .47

In economics

0.20

  -.73

  -.48

  -.88*

  -.94**

Male

   .77

   .82*

   .91**

   .77*

   .77*

Years since degree

-0.04**

-0.02

-0.00

0.00

0.00

Copies articles

 

   .29

   .28

   .29*

   .29*

Puts articles on reserve

 

   .28*

   .33**

   .24

   .22

Reads abstracts

 

1.38***

1.22***

   .82**

   .86**

Total # subs., JSTOR

 

   .27*

   .26*

   .21

   .23

Total # subs., all

 

0.03

-0.02

-0.02

-0.03

# paid subs.

 

  -.17**

  -.16**

  -.18**

  -.19**

Uses on-line indexes

   

   .37

   .22

   .25

Searches on-line catalog

   

1.34**

1.13*

1.17*

Browses on-line catalog

   

-0.02

  -.15

  -.25

Frequency of on-line catalog use

     

0.02

0.01

Frequency of on-line database use

     

0.02

-0.00

Frequency of WWW use

     

   .22

   .19

Frequency of FTP use

     

   .20

   .15

Attitude toward computing

       

   .31

-Log likelihood

111.94

98.08

93.56

89.31

88.70

Chi-square

    6.72

27.72***

  9.04**

  8.5*

  1.2

Note: -Log likelihood for the null model = 115.30.

* = p < .10; ** = p < .05; *** = p < 01.


previous sub-section
Chapter 11— Analysis of JSTOR The Impact on Scholarly Practice of Access to On-line Journal Archives
next sub-section