Vol. 57 (2007), No.8
Kazuaki KISHIDA
Faculty of Letters, Keio University
2-15-45 Mita, Minato-ku, Tokyo 108-8345 JAPAN
Abstract：This paper tries to discuss extensively matters on evaluations of information and information systems including libraries, information retrieval (IR) systems, digital libraries, and so on. First, we focus on some fundamental problems for executing the evaluation such as definition of target phenomenon, measurement, data collection, and methodology for analysis. Second, some typical areas of evaluation in mainly library and information science are briefly reviewed, e.g., assessment of information and documents, evaluation on IR experiment, scientometric studies, and evaluations of traditional and digital libraries.
Keywords： evaluation / library evaluation / information retrieval evaluation / scientometrics / digital library evaluation
Yuan SUN
National Institute of Informatics
2-1-2 Hitotsubashi, Chiyoda-ku, Tokyo 101-8430 JAPAN
Abstract：In recent years, since use of objective and quantitative measures to evaluate research performance has been of a great concern, bibliometric indicators have received considerable attention. However it should be noticed that there are some misunderstandings and misuses of bibliometrics and its indicators. This article presents the essential elements of bibliometrics and its application to the analysis of research systems. After showing the examples of typical bibliometric research, we introduce and discuss about the characteristics of bibliometric indicators, including citation impact, Impact Factor, and the current state-of-the-art performance indicators.
Keywords： bibliometrics / research evaluation / citation / indicator / Impact Factor / h-index
Kazuko KURIYAMA
Shirayuri College
1-25 Midorigaoka, Chofu-shi, Tokyo 182-8525 JAPAN
Abstract：There are various approaches to information retrieval in all its aspect. In studies of information retrieval systems, it is common that evaluation of system performances through experiments using test collections. It is still fundamental, even if targets of the systems come to include technical documents to general documents, users of them spread over from experts as researchers and librarians to the general public. This paper gives an overview of test collections and evaluation measures as bases for evaluation of information retrieval systems.
Keywords： information retrieval / search engine / evaluation measure / TREC / NTCIR
Norihiko UDA
University of Tsukuba
1-2 Kasuga, Tsukuba, Ibaraki 305-8550 JAPAN
Abstract：This paper argues that quality evaluation is important in developing indicators of measurement of digital libraries. We reveal factors of complexity in digital library services practically, and then lead to usability of digital libraries. In addition, we discuss that progress in intellectual production is a key in digital library outcomes.
Keywords： digital library / quality evaluation / outcomes / usability / portfolio
Chie SUGA
Keio University
2-15-45 Mita, Minato-ku, Tokyo 108-8345 JAPAN
Abstract：This paper argues that library evaluation from the users' point of view could be divided into the following three methods: (1) the reflection method, where the users' opinion is reflected in the evaluation; (2) the collaboration method, where the users collaborate with librarians in evaluating the library; (3) the independent evaluation method, where the evaluation is conducted by the independent organization established by the users.
It also describes the actual ways of evaluation by the reflection and collaboration methods, both of which have actually been attempted. The reflection method includes assessment satisfaction, outcome, and SERVQUAL. The collaboration method is conducted by the organization made up of the public and a team of specialists.
The paper finally suggests the value and problems of these methods.
Keywords： library evaluation / user satisfaction / outcome assessment / SERVQUAL / participative evaluation
Yoko HIROSE, Natsuko NAKAZAWA
Thomson Scientific
1-1-1 Hitotsubashi, Chiyoda-ku, Tokyo 100-0003 JAPAN
Abstract：The mission of the library is to select, collect, and control information, and offer access to those resources. Journal collection assessment is important for academic libraries in order to understand how well they provide necessary information to end users. Citation data of journal articles have been utilized as one of the methods of collection evaluation. This paper illustrates two assessment methods using Thomson Scientific's Citation Index products.
Keywords： collection evaluation / journal collection / Web of Science / Citation Index / citation / JCR / ICR / 2-Step-Map
Noriko TAIRA
Academic Information Center, Health Sciences University of Hokkaido
1757 Kanazawa, Ishikari-Tobetsu, Hokkaido 061-0293 JAPAN
Abstract：Lately, with the change in the field of medical treatment, the service that medical librarians offer is also expanding. However, most librarians are not educated as specialists of information service. Besides, as they are not usually received professional education about medical treatment, it seems that they don't have enough knowledge and skill to offer the service that medical staffs really need. Then, I conducted on investigation for 129 medical librarians (52 answered) and 2,093 medical staffs (839 answered) in Hokkaido to understand the level of knowledge, skill and consciousness of librarians, to know the users' needs and impressions of librarians and to clear the gap of them. As a result, all 10 items of "the expectation" had shown significant differences between the librarians'consciousness and the users'expectation. And there were significant differences between librarians' mind and the users' content level of "the satisfaction" were "holding course" and "reasonable charge for copy service". It was found that most of librarians were not consider themselves as professionals of information. They have low level of self-estimate about new knowledge and skill, and they think that they are not expected much as specialists of information by medical staffs.
Keywords： medical staff / medical librarian / information professions / information needs / library information services / medical libraries
Page Top