Home

USER'S GUIDE

Contents

1. Title for collection Women s History Excerpt The collection title is a short phrase used throughout the digital library to identify the content of the collection Example titles include Computer Science Technical Reports and Humanity Development Library Contact email address fannettebiics waikato ac nz This email address specifies the first point of contact for the collection Ifthe Greenstone software detects a problem a diagnostic report is sent to this address Enter an email address in its full form namedomain About this collection This collection is an excerpt for demonstration purposes based on the Women s History Primary Sources collection It consists of primary Sources and associated information on women s history gathered from W Web sites around the world The collection contains about numdocs documents This is statement describing the principles governing what is included in the collection It appears on the first page when the collection is presented Your position in the sequence is indicated by an arrow underneath in this case the collection information stage To proceed click the green source data button collection source configure build view information data collection collection collection N a Document Done Figure 16d is the point where the user specifies the source text that comprises the collection You may either base your collection on a default structure that is
2. Figure 6 Importing l a Greenstone Librarian Interface Mode Librarian Collection UNESCO Example 1 unescoex File Edit Metadata Sets BB Help existing metadata Em A Greenstone Collections A b17mie aa greenstone demo demo Gn bigase C 1b20cre b21lwae C b22bue _jeci58e _jeci59e _jeci60e 1fb33fe 1fb34fe A wb34te 3 Importing Metadata he metadata element Organization cannot be automatically imported into the collection Select a metadata set and either 1 press Add to add the metadata to that set only if there is not already Organization metadata in the set or 2 choose an element and press Merge to import Organization metadata to this element or 3 ignore this metadata element oF 6 Development Li E Garish version ae Simple image c CDS ISIS exan MARC example a Development Li M MSWord and PI dis Organization Development Library Subset Example M w No action requested Figure i Filtering the F Greenstone Librarian Interface Mode Librarian Collection UNESCO Example 1 unescoex file trees File Edit Metadata Sets E a Greenstone Collections 4 ac0ine ak greenstone demo demo _ acO1ne htm a ra Development Library Subset collection dis e El ac0ine _ acO2we htm gt acO1ne htm L ec121e htm lL ji10le htm Mon lae jecll9e eci2le ec121le htm ec158e ec159e H lec1i60e a 1 fhaafe No action requested 24 MAKING GREE
3. for there may be private ones that do not appear on the Greenstone home page With each is given its short name full name whether it is publicly displayed and whether or not it is running Clicking a particular collection s abbreviation the first column of links in Figure 17 brings up information about that collection gathered from its collection configuration file and from other internal structures created for that collection If the collection is both public and running clicking the collection s full name the second link takes you to the collection itself A collection named wohiex for Women s History Excerpt 1s visible near the bottom of Figure 17 Figure 18 shows the information that is displayed when this link is clicked The first section gives some information from the configuration file and the size of the collection about 1000 documents about a million words over 6 Mb The next sections contain internal information related to the communication protocol through which collections are accessed For example the filter options for QueryFilter show the options and possible values that can be used when querying the collection The administrative facility also presents configuration information about the installation and allows it to be modified It facilitates examination of the error logs that record internal errors and the user logs that record usage It enables a specified user or users to authorize other
4. 3 3 Tagging document files Source documents often need to be structured into sections and subsections and this information needs to be communicated to Greenstone so that it can preserve the hierarchical structure Also metadata typically the title might be associated with each section and subsection The source documents from an OCR process are typically a set of word processor files including images If these are represented as Microsoft Word files they can be input into Greenstone using the Word plugin Alternatively they can be converted to HTML and input using the HTML plugin In either case the hierarchical structure of a document may be indicated 52 MAKING GREENSTONE COLLECTIONS by inserting tags in the text as follows kes Section Description Metadata name Title sRealizing human rights for poor people Strategies for achieving the international development targets lt Metadata gt lt Description gt gt text of section goes here lt lt Section gt gt The lt gt markers are used because they indicate comments in HTML thus these section tags will not affect document formatting You must include these markers around your section tags even if the document you are working with is not HTML e g if it s a Microsoft Word file In the Description part between the lt Description gt and lt Description gt tags other kinds of metadata can be specified but this is n
5. 31 31 32 33 40 48 49 SI 54 55 56 57 58 62 63 64 64 66 68 71 71 72 73 74 78 greenstone org 1 1 Collections PLD LIED II tc CI cI CO 1 Overview of Greenstone Greenstone 1s a comprehensive system for constructing and presenting collections of thousands or millions of documents including text images audio and video A typical digital library built with Greenstone will contain many collections individually organized though they bear a strong family resemblance Easily maintained collections can be augmented and rebuilt automatically There are several ways to find information in most Greenstone collections For example you can search for particular words that appear in the text or within a section of a document You can browse documents by title just click on a book to read it You can browse documents by subject Subjects are represented by bookshelves just click on a bookshelf to look at the books Where appropriate documents come complete with a table of contents you can click on a chapter or subsection to open it expand the full table of contents or expand the full document into your browser window useful for printing The New Zealand Digital Library website nzdl org provides numerous example collections On the front page of each collection is a statement of its purpose and coverage and an explanation of how the collection is organized Most collections can be accessed by both s
6. United Nations University Once the software has been installed the library will be entered automatically every time you re insert the CD ROM if autorun 1s enabled 2 2 Finding information The easiest way to learn how to use a Greenstone collection is to try it out Don t worry you can t break anything Click liberally most images that appear on the screen are clickable If you hold the mouse stationary over an image most browsers will soon pop up a message that tells you what will happen if you click Experiment Choose common words like the and and to search for that should evoke some responses and nothing will break Greenstone digital library systems usually comprise several separate collections for example computer science technical reports literary works internet FAQs magazines There will be a home page for the digital library system which allows you to access any publicly accessible collection in addition each collection has its own about page that gives you information about how the collection is organized and the principles governing what is included in it To get back to the about page at any time just click on the collection icon that appears at the top left side of all searching and browsing pages Figure 1 shows a screenshot of the Demo collection supplied with the Greenstone software which is a very small subset of the Development Library collection we will use it a
7. preferences dialog establishes these workflow settings These settings are stored with the collection not in the Librarian Interface configuration file The Connection tab lets you alter the path to the locally running Greenstone library server which is used when Previewing collections It also lets you set proxy information for connecting to the Internet e g when downloading files see the Downloading Files From the Internet section for details Check the box to enable proxy connection and supply details of the proxy host address and port number The proxy connection is established when you close the Preferences dialog During the course of a session the Librarian Interface may give warning messages which inform you of possibly unforeseen consequences of an action You can disable the messages by checking the Do not show this warning again box You can re enable warning messages using the Warnings tab Check the box next to warning messages you want to see again The Librarian Interface uses particular application programs to open particular file types To alter file associations open the File menu and click File Associations To add an association select the target file extension from the pull down list or type in a new extension do not include the Next either type command that launches the desired application in the appropriate field or choose the application from the Browse dialog 1 can be used in the launc
8. them in this case Sources might be unavailable because e the file FTP site or URL does not exist e you need to dial up your ISP first e you are trying to access a URL from behind a firewall MAKING GREENSTONE COLLECTIONS 61 Figure 16 Continued e File Edit View Go Window Help A NA HOME collec Source data One or more of the input sources you specified is unavailable marked x below This might be because e The file FTP site or URL does not exist e Youneed to dial up your ISP first e You are trying to access a URL from behind a firewall this is the case if you normally have to present a username and password to access the internet If this is a URL that you can see in your browser it may be coming from a locally cached copy Unfortunately locally cached copies are invisible to our murroring process In this case we recommend that you download the pages using your browser first Input sources filet w le My Documents misc notes whist html x http x fam greatamericanwomen com x Ezayi l MORE 2 SOURCES If you use file or ftp to specify a file that file will be downloaded Ifyou use http it depends on whether the URL gives you a normal web page in your browser or a list of files If a page that page will be downloaded and so will all pages it links to and all pages they link to etc provided they reside on the same site below the URL If you use file or ftp to spe
9. 1 OVERVIEW OF GREENSTONE 1 1 1 Collections 1 1 2 Finding information 2 1 3 Document formats 2 1 4 Multimedia and multilingual documents 3 1 5 Distributing Greenstone 3 2 USING GREENSTONE COLLECTIONS 5 2 1 Using a Greenstone CD ROM 5 2 2 Finding information 6 How to find information z How to read the documents 8 What the icons mean 9 How to search for particular words 9 Scope of queries 11 Advanced search features 11 2 3 Changing the preferences 13 Collection preferences 13 Language preferences 13 Presentation preferences 14 Search preferences 15 3 MAKING GREENSTONE COLLECTIONS 17 3 1 The librarian s interface 18 Getting started 18 Assembling the source material Enriching the documents Designing the collection Building the collection Previewing Help 3 2 Librarian Interface user guide Starting Off Downloading Files From the Internet Collecting Files for Your Collection Enriching the Collection with Metadata Designing Your Collection s Appearance Producing Your Collection Miscellaneous 3 3 Tagging document files 3 4 The Collector Logging in Dialog structure Collection information Source data Configuring the collection Building the collection Viewing the collection Working with existing collections Document formats 4 ADMINISTRATION 4 1 Configuration files 42 Logs 4 3 User management 4 4 Technical information APPENDIX A SOFTWARE FEATURES APPENDIX B GLOSSARY OF TERMS 20 22 28 30 30 31
10. COLLECTIONS Search Types Sections click Document Plugins To add a plugin select it using the Select plugin to add pull down list near the bottom and then click Add Plugin A window appears entitled Configuring Arguments it is described later Once you have configured the new plugin it is added to the end of the Currently Assigned Plugins list Note that except for UnknownPlug each plugin may only occur once in the list To remove a plugin select it in the list and click Remove Plugin Plugins are configured by providing arguments To alter them select the plugin from the list and click Configure Plugin or double click the plugin A Configuring Arguments dialog appears with various controls for specifying arguments There are different kinds of controls Some are checkboxes and clicking one adds the appropriate option to the plugin Others are text strings with a checkbox and a text field Click the box to enable the argument then type appropriate text regular expression file path etc in the box Others are pull down menus from which you can select from a given set of values To learn what an argument does let the mouse hover over its name for a moment and a description will appear When you have changed the configuration click OK to commit the changes and close the dialog or Cancel to close the dialog without changing any plugin arguments The plugins in the list are executed in order and the o
11. DORR Building the collection Build The collection is now being built this might take some time The building status line below gives feedback on how the operation is progressing To stop the building process at any time click here SET Atte The collection you are working on will remain intact If you leave this page and have not cancelled the building process with the stop building button the collection will continue to build and will be installed upon successful completion Importing collection extracted Title metadata Lucretia Mott to Josephine 5 Griffing 1870 m E Connect Host nzdi2 cs waikato ac nz contacted Waiting for reply Ld the filename convention that is adopted by the mirroring package This metadata is used in the collection to allow readers to refer to the original source material rather than to a local copy Figure 16g shows the building stage Up until now the responses to the dialog have merely been recorded in a temporary file The building stage is where the action takes place During building indexes for both browsing and searching are constructed according to instructions in the collection configuration file The building process takes some time minutes to hours depending on the size of the collection and the speed of your computer Some very large collections take a day or more to build When you reach this stage in the interaction a status line at the bottom of the web p
12. and begun to fill out general information about the collection its title the E mail address of the person responsible for it and a brief description of the content in the popup window The collection title is a short phrase used throughout the digital library to identify the collection s content existing collections have names like Food and Nutrition Library World Environmental Library and so on When you type the title the system assigns a unique mnemonic identifier the collection name for internal use you can change it if you like The E mail address specifies the first point of contact for any problems encountered with the collection The brief description is a statement describing the principles that govern what is included in the collection It appears under the heading About this collection on the collection s initial page Figure 4 Starting a new collection Figure 5 Exploring the local file space MAKING GREENSTONE COLLECTIONS 19 E Greenstone Librarian Interface Mode Librarian Collection No Collection ENMIG Design H Greenstone Collections Local Filespace Home Folder kjdon Create a new Collection UNESCO Example 1 A Greenstone Digital Collection built using the GLI Files are sourced from previous collections including the Humanities Development Library DLS and have some pre existing metadata assigned to them Development Library Subset collection dis e w Cancel No
13. assigned to it The same panel also allows you to change the profile for mapping elements of one metadata set to another This profile is created when importing documents from collections that have pre assigned metadata 26 MAKING GREENSTONE COLLECTIONS ES Greenstone Librarian Interface Mode Librarian Collection UNESCO Example 1 unescoex File Edit Metadata Sets Figure 10 Editing the metadata set Help L Extracted Greenstone Met ex Encoding ex Language ex Source ex Title comment en Currently uses a hierarchy page Library Subs definition en The subject of this resource F sonn s I e dis Organization e dis Keyword ea dis Language ea dis AZLISt _j Importing Profiles i an A on ann na con nen Figure 1 ile Designing ES Greenstone Librarian Interface Mode Librarian Collection UNESCO Example 1 unescoex 1 Fil Edit Metadata 5 the collection Ele E Metadata Sets Document Plugins he design section of the Librarian Interface allows you to control Search Types many aspects of your collection s appearance The design is split up Search Indexes into several sections This section contains general options and Partition Indexes settings To choose a different section click on its name in the list to Cross Collection Search he left Browsing Classifiers Format Features Translate Text greenstone cs waikato ac nz Metadata Sets eeeee eee 6 greenstonel
14. changes occur and monitor what 1s happening on the system The facility is disabled by default but can be enabled by editing the main cfg configuration file see the Greenstone Digital Library Developer s Guide Section 4 Working with existing collections When you enter the Collector you have to specify whether you want to create an entirely new collection or work with an existing one adding data to it or deleting it By creating all searching and browsing structures automatically from the documents themselves Greenstone makes it easy to add new information to existing collections Because no links are inserted by hand when new documents in the same format become available they can be merged into the collection automatically To work with an existing collection you first select the collection from a list that 1s provided Some collections are write protected and cannot be altered these ones don t appear in the selection list With the collection you can e Add more data and rebuild the collection e Edit the collection configuration file e Delete the collection entirely e Export the collection to CD ROM Add new data Edit configuration file Delete the collection Export the collection MAKING GREENSTONE COLLECTIONS 65 The files that you specify will be added to the collection Make sure that you do not re specify files that are already in the collection otherwise two copies will be included Files are identifie
15. cs waikato ac nz UNESCO Example 1 Browse Browse A Greenstone Digital Collection built using the GLI Files are sourced fre collections including the Humanities Development Library DLS and h pre existing metadata assigned to them MAKING GREENSTONE COLLECTIONS 27 Greenstone Librarian Interface Mode Librarian Collection UNESCO Example 1 unescoex Figure 12 Specifying which plug ins to use General a Use this view to add configure or remove plugins from your Search Types collection To add one choose it from the combobox and click Add Search Indexes Plugin Partition Indexes To configure or remove one select it from the list of assigned Cross Collection Search plugins then Browsing Classifiers i Change its position in the plugin order by clicking on the arrow vi Format Features Translate Text plugin HTMLPlug input encoding iso_8859_1 description_tags cove Metadata Sets plugin WordPlug description_tags plugin PDFPlug description_tags plugin GAPlug BibTexPlug ba Add Plugin Confiqure Plugin Remove Plugin Figure 13 Configuring arguments to a plug in Hj Configuring Arguments v description tags nolinks keep head no metadata po Add Plugin Configure Plugin Remove Plugin 28 MAKING GREENSTONE COLLECTIONS Designing the collection The Design panel Figures 11 13 allows one to specify the structure organization and pres
16. document contains the closer it matches e rare terms are more important than common ones e short documents match better than long ones Use as many search terms as you like a whole sentence or even a whole paragraph If you specify only one term it doesn t much matter whether you use an all or a some query except that in the second case the results will be sorted by the search term s frequency of occurrence Scope of queries In most collections you can choose different indexes to search For example there might be author or title indexes Or there might be chapter or paragraph indexes Generally the full matching document is returned regardless of which index you search If documents are books they will be opened at the appropriate place Advanced search features While the above is enough to meet most searching needs some more advanced search features are provided These are activated from the Preferences page which is reached by clicking the preferences button at the top of the page see Section 2 3 below After changing your preferences do not click your browser s Back button that would undo the changes Instead click any of the buttons on the search browse bar 12 USING GREENSTONE COLLECTIONS Case sensitivity and stemming Phrase searching When you specify search terms you can choose whether upper and lower case must match between the query and the document this is called case sensitivity You ca
17. in a source document takes precedence over that assigned to the document as a whole This means that you should not explicitly specify Title metadata for the top level section within a source document unless you want it to override the title you gave it when specifying metadata In the above example unless you want to override the document s existing title you should omit the line that reads Metadata name Title sMy Document lt Metadata gt 54 MAKING GREENSTONE COLLECTIONS 3 4 The Collector The Collector is a facility that helps you create new collections modify or add to existing ones or delete collections To do this you will be guided through a sequence of web pages which request the information that is needed The sequence is self explanatory this section takes you through it As an alternative to using the Collector you can also build collections from the command line the first few pages of the Developer s Guide give a detailed walk through of how to do this The Collector predates the librarian interface described in Section 3 1 and for most practical purposes the librarian interface should be used instead of the Collector Building and distributing information collections carries responsibilities that you should reflect on before you begin There are legal issues of copyright being able to access documents doesn t mean you can necessarily give them to others There are social issues collections should respect the cu
18. number of __ 1073 documents number of 1073 sections number of words 1038463 number of bytes 6294492 preferred a receptionist Filter options for BrowseFilter optionname type repeatable default value valid values EndResults integer one per query 1 1 10000 ParentNode string one per query StartResults integer one per query 1 1 10000 Filter options for NullFilter option name type repeatable default value valid values Filter options for QueryFilter option name type repeatable default value valid values Casefold boolean one per term true false true CombineQuery enumerated one per query and and or not EndResults integer one per query 10 1 1000 Index enumerated one per term dtz dtz Language enumerated one per term MatchMode enumerated one per query some some all Maxdocs integer one per query 200 1 1000 all phrases PhraseMatch enumerated one per query some_phrases is pen AAA alloc QueryType enumerated one per query ranked boolean ranked StartResults integer one per query 1 15 1000 Stem boolean one per term false false tme Subcollection enumerated one per term Term string one per term ADMINISTRATION 71 4 1 Configuration files 4 2 Logs There are two configuration files that control Greenstone s operation the site configuration file gsdlsite cfg and the main configura
19. of features that can be formatted is changed slightly and more variables are available to be used in the format command providing greater control over the page layout This section describes the translation view where you can define language specific text fragments for parts of the collection s interface Under Design Sections click Translate Text First choose an entry from the Features list The language specific strings associated with this feature appear below Use the Language of translation pull down list to select the target language and type the translated text into the text area referring to the Initial Text Fragment if necessary Click Add Translation when finished To remove an existing translation select it in the Assigned Translations table and click Remove Translation To edit a translation select it edit it in the Translated Text text area and click Replace Translation 48 MAKING GREENSTONE COLLECTIONS Metadata Sets This section explains the metadata set review panel Under Design Sections click Metadata Sets This view is used to review the metadata sets that the collection uses and the elements that are available within each set Choose from the list of Available Metadata Sets in order to see details of their elements To use another metadata set with the loaded collection click Add Metadata Set and select the metadata set file mds for the new metadata set Editing metad
20. ones can be written for different OVERVIEW OF GREENSTONE 3 document types to do this you need to study the Greenstone Digital Library Developer s Guide To build browsing structures from metadata an analogous scheme of classifiers is used These create browsing indexes of various kinds scrollable lists alphabetic selectors dates and arbitrary hierarchies Again Greenstone programmers can create new browsing structures 1 4 Multimedia and multilingual documents Collections can contain text pictures audio and video Non textual material is either linked into the textual documents or accompanied by textual descriptions such as figure captions to allow full text searching and browsing Unicode which is a standard scheme for representing the character sets used in the world s languages is used throughout Greenstone This allows any language to be processed and displayed in a consistent manner Collections have been built containing Arabic Chinese English French Maori and Spanish Multilingual collections embody automatic language recognition and the interface is available in all the above languages and more 1 5 Distributing Greenstone Collections are accessed over the Internet or published in precisely the same form on a self installing Windows CD ROM Compression is used to compact the text and indexes A Corba protocol supports distributed collections and graphical query interfaces The New Zealand Digit
21. provided or on the structure of an existing collection If you opt for the default structure the new collection may contain HTML documents files ending in Atm Atml or plain text documents files ending in txt text Microsoft Word documents files ending in doc PDF documents files ending in pdf or E mail documents files ending in email More information about the different document formats that MAKING GREENSTONE COLLECTIONS 59 Figure 16 Continued d e wen ir TAY al erred HOME collec Source data You may base your collection on either e The default structure The new collection may contain html documents htm htm plain text documents txt text MS Word documents doc PDF documents pdf or email documents email e An existing collection The files in your new collection must be exactly the same type as those used to build the existing one Base the collection on default structure Input sources fie w le My Documentsimisc notes whist htul http z fiv greatamericanwomen com ft do MORE a SOURCES If you use file or ftp to specify a file that file will be downloaded If you use http it depends on whether the URL gives you a normal web page in your browser or a list of files If a page that page will be downloaded and so will all pages it links to and all pages they link to etc provided they reside on the same site below the URL If you use file o
22. remove indexes and set a default index Under Design Sections click Search Indexes To add an index type a name for it into the Index Name field Select which of the possible information sources to index by clicking the checkboxes beside them The list shows all the assigned metadata elements as well the full text Having selected the data sources choose the granularity of the index using the At the level menu Once these details are complete Add Index becomes active unless there is an existing index with the same settings Click it to add the new index To edit an index select it and change the index details then click Replace Index To remove an index select it from the list of assigned indexes and click Remove Index To create an index covering text and all metadata click Add All The default index the one used on the collection s search page is tagged with Default Index in the Assigned Indexes list To set it select an index from the list and click Set Default If advanced searching is enabled via the Search Types view the index controls are different There is a new pseudo data source allfields which provides searching across all specified indexes at once Levels are not assigned to a specific index but apply across all indexes thus indexes and levels are added separately Add All creates a separate index for each metadata field in this mode The name of each index will default to the
23. set The system automatically selects the closest match in terms of set and element for the new metadata Having checked the mapping you can choose Add to add the new metadata element to the chosen metadata set This is only enabled if there is no element of the same name within the chosen set Merge maps the new element to the one chosen by the user Finally Ignore does not import any metadata with this element name Once you have specified how to import a certain piece of metadata the mapping information is retained for the collection s lifetime For details on the metadata xml files which Greenstone uses to store the metadata see Chapter 2 of the Greenstone Developer s Guide Getting the most out of your documents Designing Your Collection s Appearance Once your files are marked up with metadata you next decide how it should appear to users as a Greenstone collection What kind of The Design View General Document Plugins MAKING GREENSTONE COLLECTIONS 41 information is searchable What ways are provided to browse through the documents What languages are supported Where do the buttons appear on the page These things can be customized this section describes how to do it This section introduces you to the design view and explains how to navigate between the various views within this pane With the Librarian Interface you can configure how the collection appears to the user The configuration options are d
24. specifying arguments to some of the plug ins The grayed out fields become active when the user adds the option by clicking the tick box beside it Because Greenstone is a continually growing open source system the number of options tends to increase as developers add new facilities To help cope with this Greenstone has a plug in information utility program that lists the options available for each plug in and the librarian interface automatically invokes this to determine what options to show This allows the interactive user interface to automatically keep pace with developments in the software The Create panel Figure 14 is used to construct a collection based on the documents and assigned metadata The brunt of this work is borne by the Greenstone code itself The user controls this external process through a series of separate interaction screens each dealing with the arguments provided to a certain stage of the creation process The user observes the building process though a window that shows not only the text output generated by Greenstone s importing and index building scripts but also progress bars that indicate the overall degree of completion of each script Figure 14 shows the Create view At the top are shown some options that can be applied during the creation process The user selects appropriate values for the options This figure illustrates a popup tool tip that is available throughout the interface to ex
25. to find Folders can be placed inside folders There is virtually no limit to how many folders you can have or how deeply they can be nested To create a new folder optionally select an existing folder in the Collection Tree and click the New Folder button The new folder appears within the selected one or at the top level if none is selected You are prompted for the folder s name default New Folder Folders can also be created by right clicking over a folder choosing New Folder and proceeding as above Files can be copied into the collection by dragging and dropping The mouse pointer becomes a ghost of the selected item or 1f more than one is selected the number of them Drop the selection into the Collection Tree to copy the files there if the source was the Workspace Tree or move them around within the collection if the source was the Collection Tree When copying multiple files they are all placed in the target folder at the same level irrespective of the folder structure they occupied originally When you copy a second file with the same name into the same folder you are asked whether to overwrite the first one Respond No and the file will not be copied but the others will be To cancel all remaining copy actions click the stop button Only the highest items in a selection are moved A folder is higher than its children You cannot select files within a folder and also the folder itself 36 MAKING GREENS
26. use to specify a range of values by selecting AND or alternative 40 MAKING GREENSTONE COLLECTIONS values by selecting OR Below this area is a box that allows you to change the sort order ascending or descending Once you have finished click Set Filter to apply the new filter to the column Click Clear Filter to remove a current filter Note that the filter details are retained even when the filter is cleared For example to sort the All Metadata table choose a column select the default filter setting a Simple filter on and choose ascending or descending ordering Importing Previously Assigned Metadata This section describes how to import previously assigned metadata metadata assigned to documents before they were added to the collection If metadata in a form recognized by the Librarian Interface has been previously assigned to a file for example when you choose documents from an existing Greenstone collection it is imported automatically when you add the file To do this the metadata must be mapped to the metadata sets available in the collection The Librarian Interface prompts for the necessary information The prompt gives brief instructions and then shows the name of the metadata element that is being imported just as it appears in the source file This field cannot be edited or changed Next you choose what metadata set the new element should map to and then the appropriate metadata element in that
27. 0 8859 1 M Interface format Graphical Search preferences set preferences Query box size regular query box pi large query box a o Case differences ignore case differences upper lower case must match Word endings ignore word endings an o whole word must match 2 Query mode simple query mode C advanced query mode allows boolean searching using amp and parentheses Search history do not display search history C display 5 z search history records Return up to 50 F hits with 20 E hits per page a Document Dom is particularly useful for visually impaired users who use large screen fonts or speech synthesizers for output Presentation preferences Depending on the collection there may be other options you can set that control the presentation Collections of web pages allow you to suppress the Greenstone navigation bar at the top of each document page so that once you have done a search you land at the exact web page that matches without any Greenstone header To do another search you will have to use your browser s back button These collections also allow you to suppress Greenstone s warning message when you click a link that takes you out of the digital library collection and on to the web itself And in some web collections you can control whether the links on the Search Results page take you straight to the actual URL in question rather than to th
28. GREENSTONE DIGITAL LIBRARY USER S GUIDE Ian H Witten Stefan Boddie and John Thompson Department of Computer Science University of Waikato New Zealand Greenstone is a suite of software for building and distributing digital library collections It provides a new way of organizing information and publishing it on the Internet or on CD ROM Greenstone is produced by the New Zealand Digital Library Project at the University of Waikato and developed and distributed in cooperation with UNESCO and the Human Info NGO It is open source software available from ttp greenstone org under the terms of the GNU General Public License We want to ensure that this software works well for you Please report any problems to greenstone dcs waikato ac nz Greenstone gsdl 2 70 March 2006 About this manual This manual provides a comprehensive description of how to use the Greenstone software for accessing and building digital library collections Section 1 gives an overview of the capabilities of the software Section 2 explains how to use Greenstone collections The interface is self explanatory the best way to learn is by doing and this section comprises the on line help information for a typical collection Section 3 explains how to build your own library collections using the Greenstone Librarian Interface Section 4 introduces the administration facility that allows the system administrator to monitor what is going on and control who c
29. NSTONE COLLECTIONS Figure 8 Assigning S Greenstone Librarian Interface Mode Librarian Collection UNESCO Example 1 unescoex metadata using Enrich fle ET Metadata Sets B Help VICW he Courier N 157 May June 1996 Dossier C a ag2lae htm ag2lae jpg he Courier ACP 1990 1996 Africa Caribbean care for the refugees _jeci2ie English eci21e htm C D E ec121e jpg he Courier p026 png p033 png p036 png p037a png R p037b png El b pO44 png Dean kek rp e pO56 png pO60b png a ACCU Agenda 21 BOSTID ii10le htm CPS ii1l0le jpg pOO1 png vi FAO Better Farming series International Institute for Rural Reconstruction Figure 9 Viewing all Greenstone Librarian Interface Mode Librarian Collection UNESCO Example 1 unescoex metadata for selected _file__Edit_ Metadata Sets files Gaia A T n S a po liz0le htm Livestock and poultry production Internatio iilise htm Seeds and plant propagation Internatioi 4 INGYY YUIUGCGVUVUNRN KASE LE W COIVUPINCONL UNU pPIEUUUCUUN UI EERE OEE R n MAKING GREENSTONE COLLECTIONS 25 Metadata values can also be assigned to folders in just the same way Documents in these folders for which this metadata is unspecified inherit the metadata values However they can subsequently be overridden by supplying different ones for the document itself Operations at this stage include e Assigning new and existing metadata values to document
30. Plug imports documents in PostScript It works best if a standard Linux program called ps2ascii is already installed on your computer This is available on most Linux installations but not on Windows If this program is not available PSPlug resorts to a simple text extraction algorithm EMAILPlug imports files containing E mail and deals with common E mail formats such as are used by the Netscape Eudora and Unix mail readers Each source document is examined to see if it contains an E mail or several E mails joined together in one file and if so its contents are processed The plugin extracts Subject To From and Date metadata However this plugin does not yet handle MIME encoded E mails properly although legible they often look rather strange ZIPPlug LZ Z tgZ taz bz Zip tar ZIPPlug plugin handles the following compressed and or archived input formats gzip gz Z tgz taz bzip bz zip zip jar and tar tar It relies on the programs gunzip bunzip unzip and tar which are standard Linux utilities ZIPPlug is disabled on Windows computers greenstone org PLD AICI IS tc TI cc 4 Administration An administrative facility is included with every Greenstone installation To access this facility click the appropriate link on the front page The entry page shown in Figure 17 gives information about each of the collections offered by the system Note that a collections are included
31. TONE COLLECTIONS Removing Files Filtering the Tree When you add a file the Librarian Interface searches through the source folders for auxiliary files containing metadata previously assigned to the added file and if it finds one begins to import this metadata As the operation proceeds you may be prompted perhaps several times for extra information to match the imported metadata to the metadata sets in your collection This process involves many different prompts described in the Importing Previously Assigned Metadata section For a more detailed explanation of associating metadata with files read Chapter 2 of the Greenstone Developer s Guide Getting the most out of your documents There are several methods for removing files and folders You must first indicate what items to remove by selecting one or more files and folders as described in The Gather View Once files have been selected click the delete button to remove them or press the Delete key on your keyboard or drag them from the collection to the delete button and drop them there Filtering the collection tree allows you to narrow down the search for particular files The Show Files pull down menu underneath each tree shows a list of predefined filters such as Images Choosing this temporarily hides all other files in the tree To restore the tree change the filter back to All Files These operations do not alter the collection nor do they affect the f
32. a He Muka hemuka2 He Muka tantes tan s test Computer Science Bibhographies yes Knowbase localweb Medical and Health Library niupepa Niupepa M ori Newspapers niupepa places Niupepa M ori Newspapers Hamilton Public Library Youth Oral History Collection knowbase localweb ohist rweq rweq school The New Zealand School Journal scms Search Computing Mathematics and Statistics sjnew sjnew tang tang tescol test collection testword Word plugin demo tidbits TidBITS unu United Nations University whist Women s History Primary Source Documents whistbuldingimages whistbuildingimages wohtex Women s History Excerpt Word plugin demo wordtest tar gz wordtest wordtest tar gz EN Document Dan gt 70 ADMINISTRATION Figure 18 Information about the Women s History Excerpt _ collection Collection info Collection info collection name wohiex host s port ak is public true is beta true build date 978487241 interface languages collection documenttext documents metadata E A This collection is an excerpt for demonstration purposes based on then Women s History Primary Sources collection It consists of primary nsources and associated information on women s history gathered from n Web sites around the world The collection contains _about numdocs ndocuments n n collectionextra collectionname Women s History Excerpt iconcollection format info building info
33. able with this plugin documented in the Greenstone Digital Library Developer s Guide WORDPlug imports Microsoft Word documents There are many different variants on the Word format and even Microsoft programs frequently make conversion errors Greenstone uses independent programs to convert Word files to HTML For some older Word formats the system resorts to a simple extraction algorithm that finds all text strings in the input file PDFPlug imports documents in PDF Adobe s Portable Document Format Like WORDPlug it uses an independent program in this case pdftohtml to convert PDF files to HTML As with WORDPlug by default collections will display the HTML equivalent of the file when the user clicks the document icon however the format strings in the collection configuration file can be adjusted to give the user access to the original PDF file instead and we recommend PSPlug ps EMAILPlug email MAKING GREENSTONE COLLECTIONS 67 that you do this Again just replace the link lt link gt tags by lt srclink gt lt srclink gt ones The pdftohtml program fails on some PDF files What happens 1s that the conversion process takes an exceptionally long time and often an error message relating to the conversion process appears on the screen If this occurs the only solution that we can offer is to remove the offending document from the collection Also PDFPlug cannot handle encrypted PDF files PS
34. action requested EZ Greenstone Librarian Interface Mode Librarian Collection UNESCO Example 1 unescoex Em _ Greenstone Collections greenstone demo demo 1 Development Library Subset collection dls e ie acOine acO2we j ag21ae b17mie b18ase C b20cre C b21wae C b22bue cpOlae lec119e leci2le ec158e EG Ge a a a No action requested 20 MAKING GREENSTONE COLLECTIONS At this point the user decides whether to base the new collection on the same structure as an existing collection or to build an entirely new kind of collection In Figure 4 she has chosen to base it on the Development Library Subset collection This implies that the DLS metadata set which is used in this collection will be used for the new collection In fact this metadata set has been used to build several Greenstone collections that share a common structure and organization but with different content including the Development Library Subset and Demo collections delivered as samples with Greenstone The DLS metadata set contains these items e Title e Subject e Language e Organization e Keyword 1 e Howto There is in addition a metadata item called AZList which is used to determine which bucket of the alphabetic list contains the document s title with values like A B or C D E This is used to give precise control over the divisions in the li
35. age gives feedback on how the operation is progressing updated every five seconds The message visible in Figure 16f indicates that when the snapshot was taken Title metadata was being extracted from an input file Warnings are written if input files or URLs are requested that do not exist or exist but there is no plugin that can process them or the plugin cannot find an associated file such as an image file embedded in a HTML 64 MAKING GREENSTONE COLLECTIONS Viewing the collection document The intention is that you will monitor progress by keeping this window open in your browser If any errors cause the process to terminate they are recorded in this status area You can stop the building process at any time by clicking on the stop building button in Figure 16g If you leave the web page and have not cancelled the building process with the stop building button the building operation will continue and the new collection will be installed when the operation completes When the collection is built and installed the sequence of buttons visible at the bottom of Figures 16b f appears at the bottom of Figure 16g with the View collection button active This takes the user directly to the newly built collection Finally there is a facility for E mail to be sent to the collection s contact E mail address and to the system s administrator whenever a collection is created or modified This allows those responsible to check when
36. al Library nzdl org provides many example collections including historical documents humanitarian and development information technical reports and bibliographies literary works and magazines Being open source Greenstone is readily extensible and benefits from the inclusion of GNU licensed modules for full text retrieval database management and text extraction from proprietary document formats Only through international cooperative efforts will digital library software become sufficiently comprehensive to meet the world s needs with the richness and flexibility that users deserve 4 OVERVIEW OF GREENSTONE greenstone org PLD LIED II tc CI cI CO 2 Using Greenstone Collections The Greenstone software is designed to be easy to use Web based and CD ROM collections have interfaces that are identical Installing the Greenstone software from CD ROM on any Windows or Linux computer is very easy indeed a standard installation setup program is used in conjunction with pre compiled binaries A collection can be used locally on the computer where it is installed also if this computer is connected to a network the software automatically and transparently allows all other computers on the network to access the same collection The next section describes how to install a Greenstone CD ROM Then we look at the searching and browsing facilities offered by a typical Greenstone collection the Demo collection that is supplied with
37. an build collections Appendices list the features of the Greenstone software and give a glossary of terms used throughout the Greenstone documentation Companion documents The complete set of Greenstone documents includes four volumes e Greenstone Digital Library Installer s Guide e Greenstone Digital Library User s Guide this document e Greenstone Digital Library Developer s Guide e Greenstone Digital Library From Paper to Collection Acknowledgements ili The Greenstone software is a collaborative effort between many people Rodger McNab and Stefan Boddie are the principal architects and implementors Contributions have been made by David Bainbridge George Buchanan Hong Chen Michael Dewsnip Katherine Don Elke Duncker Carl Gutwin Geoff Holmes Dana McKay John McPherson Craig Nevill Manning Dynal Patel Gordon Paynter Bernhard Pfahringer Todd Reed Bill Rogers John Thompson and Stuart Yeates Other members of the New Zealand Digital Library project provided advice and inspiration in the design of the system Mark Apperley Sally Jo Cunningham Matt Jones Steve Jones Te Taka Keegan Michel Loots Malika Mahoui Gary Marsden Dave Nichols and Lloyd Smith We would also like to acknowledge all those who have contributed to the GNU licensed packages included in this distribution MG GDBM PDFTOHTML PERL WGET WVWARE and XLHTML greensiono1 AL A A A A A A A eA A eA oD oa Contents About this manual ii
38. arch Types Search Indexes Partition Indexes Cross Collection Search Browsing Classifiers Format Features Translate Text Metadata Sets Appearance and functionality varies between these For example clicking the P ug in button brings up the screen shown in Figure 12 which allows you to add remove or configure plug ins and change the order in which the plug ins are applied to documents Figure 14 Getting ready to create new collection Figure 15 Previewing the newly built collection MAKING GREENSTONE COLLECTIONS 29 S Greenstone Librarian Interface Mode Librarian Collection UNESCO Example 1 unescoex oe JE File Edit Metadata Sets TA Help Gather Pedi Enrich oesion l maxdocs sortmete dic azii v Maximum number of documents to import M allclassifications Build Collection he file at acO lne acO1ne htm has been recognised by the HTMLPlug plugin and is being added he file at acO2we acO2we htm has been recognised by the HTMLPlug plugin and is being added he file at ag21ae ag21ae htm has been recognised by the HTMLPlug plugin and is being added he file at b17mie b17mie htm has been recognised by the HTMLPlug plugin and is being added he file at ec121e ec121e htm has been recognised by the HTMLPlug plugin and is being added he file at fb33fe fb33fe htm has been recognised by the HTMLPlug plugin and is being added he file at fb34fe fb34fe htm has been recognised by the HTMLPlug plugin and is bei
39. are not an advanced user just go to the bottom of the page To alter the configuration settings edit the data that appears below If you make a mistake click on Reset to reinstate the original configuration settings creator annetteblics waikato ac nz maintainer annetteblics waikato ac nz true true document text document text defaultindex ZIPPlug plugin GMLPlug plugin TEXTPlug plugin HTMLPlug file_is_url plugin EMAILPlug plugin ArcPlug plugin RecPlug AZList metadata Title vii Mi Reset N collection source configure build view information data collection collection collection 5 af Document Done Li Configuring the collection Figure 16f shows the next stage The construction and presentation of all collections is controlled by specifications in a special collection configuration file see below Advanced users may use this page to alter the configuration settings Most however will proceed directly to the final stage Indeed in Figure 16d both the configure collection and the build collection buttons are displayed in green signifying that step 3 can be bypassed completely In our example the user has made a small modification to the default configuration file by including the fi e_is_url flag with the HTML plugin This flag causes URL metadata to be inserted in each document based on MAKING GREENSTONE COLLECTIONS 63 Figure 16 Continued g n A n EAT
40. ata sets 1s done with the Greenstone Editor for Metadata Sets GEMS Clicking the Edit Metadata Set button provides information on how to run the GEMS If you no longer need a metadata set select it and press Remove Metadata Set to remove it If you have assigned any metadata to elements in the removed set you will be asked how to deal with this metadata when you next open the collection Producing Your Collection The Create View Having collected the documents for the collection annotated them with metadata and designed how the collection will appear you can now produce the collection using Greenstone This section explains how The Create view is used to create the collection by running Greenstone collection building scripts on the information you have provided Clicking Build Collection initiates the collection building process The time this takes depends on the size of the collection and the number of indexes being created for huge collections it can be hours A progress bar indicates how much of the process has been completed To cancel the process at any time click Cancel Build Once the collection has successfully built clicking Preview Collection will launch a web browser showing the home page of the collection In Expert mode you can use the Message Log entry at the left to review previous attempts to build the collection whether successful or not Select the log you want by clicking on the desired date in t
41. cify a folder or directory or give a http URL that leads to a list of N files everything in the folder and all its sub folders will be included in the collection Click the more sources button to get more input boxes Click one of the green buttons If you are an advanced user you may want to adjust the collection configuration Alternatively go straight to the building stage Remember you can always revisit an earlier stage by clicking its yellow button collection source configure build view information data collection collection collection kaa N Wi Document Done The last case is potentially the most mysterious It occurs if you normally have to present a username and password to access the Internet Sometimes it happens that you can see the page from your Web browser if you enter the URL but the Collector claims that it 1s unavailable The explanation is that the page in your browser may be coming from a locally cached copy Unfortunately locally cached copies are invisible to the Collector In this case we recommend that you download the pages using your browser first 62 MAKING GREENSTONE COLLECTIONS r a Netscape Figure 16 Continued f File Edt View Go Window Help Pa dl Mati HOME cotte M Configure collection The building and presentation of your collection are controlled by specifications in a special configuration file Advanced users may want to alter the configuration settings If you
42. collections Documents can be in any language User interface available in multiple languages Collections can contain text pictures audio and video Uses advanced compression techniques APPENDIX A SOFTWARE FEATURES 75 Metadata which is descriptive information such as author title date keywords and so on may be associated with each document or with individual sections within documents Metadata is used as the raw material for browsing indexes It must be either provided explicitly or derivable automatically from the source documents The Dublin Core metadata scheme is used for most electronic documents however provision is made for other schemes In order to accommodate different kinds of source documents the software is organized in such a way that plugins can be written for new document types Plugins currently exist for plain text HTML Word PDF PostScript E mail some proprietary formats and for recursively traversing directory structures and compressed archives containing such documents A collection may have source documents in different forms In order to build browsing indexes from metadata an analogous scheme of classifiers is used classifiers create browsing indexes of various kinds based on metadata Collections can contain millions of documents making the Greenstone system suitable for collections up to several gigabytes Unicode is used throughout the software allowing any language t
43. d by their full pathname web pages by their absolute web address You specify directories and files just as you do when building a new collection If you add data to a collection and for some reason the building process fails the old version of the collection remains unchanged Advanced users can edit the collection configuration file just as they can when a new collection 1s built You will be asked to confirm whether you really want to delete the collection Once deleted Greenstone can not bring the collection back You can export the collection in a form that allows it to be written to a self contained self installing Greenstone CD ROM for Windows Because commercial software that creates self installing CD ROMs is expensive this facility includes a homegrown installer module When you export the collection the dialogue informs you of the directory name in which the result has been placed The entire contents of the directory should be written on to CD ROM using a standard CD writing utility The immense variety of different possible Windows configurations has made it difficult for us to test and debug the Greenstone installer under all possible conditions Although the installer produces CD ROMs that operate on most Windows systems it is still under development If you experience problems and you possess a commercial installation package e g InstallShield you can use it to create CD ROMs from the information that Greenstone p
44. data such as author title date keywords and so on is associated with each document This information is called metadata Many document collections also contain full text indexes of certain kinds of metadata For example many collections have a searchable index of document titles Users can browse interactively around lists and hierarchical structures that are generated from the metadata that is associated with each document in the collection Metadata forms the raw material for browsing It must be provided explicitly or be derivable automatically from the documents themselves Different collections offer different searching and browsing facilities Indexes for both searching and browsing are constructed during a building process according to information in a collection configuration file Greenstone creates all index structures automatically from the documents and suppporting files nothing is done manually If new documents in the same format become available they can be merged into the collection automatically Indeed for many collections this is done by processes that awake regularly scout for new material and rebuild the indexes all without manual intervention 1 3 Document formats Source documents come in a variety of formats and are converted into a standard XML form for indexing by plugins Plugins distributed with Greenstone process plain text HTML WORD and PDF documents and Usenet and E mail messages New
45. e digital library s copy of the page Search preferences USING GREENSTONE COLLECTIONS 15 Under Search preferences in Figure 3 the first pair of buttons allows you to get a large query box so that you can easily do paragraph sized searching In Greenstone it is surprisingly quick to search for large amounts of text The next two pairs of buttons control the kind of text matching in the searches that you make The first set labeled case differences controls whether upper and lower case must match The second word endings controls whether to ignore word endings or not Using the next button pair you can switch to the advanced query mode described above which allows you to specify more precise queries by combining terms using AND amp OR and NOT You can turn the search history feature described above on and off Finally you can control the number of hits returned and the number presented on each screenful through the last entry in Figure 3 16 USING GREENSTONE COLLECTIONS greenstone org PLD LILI II tc AT A UN 3 Making Greenstone Collections The simplest way to build new collections is to use Greenstone s librarian interface GLI This allows you to collect sets of documents import or assign metadata and build them into a Greenstone collection It supports five basic activities which can be interleaved but are nominally undertaken in this order 1 Copy documents from the comp
46. e on the Greenstone server system beginning with file e an address beginning with http for files to be downloaded from the web e an address beginning with ftp for files to be downloaded using anonymous FTP If you use file or ftp to specify a file that file will be downloaded If you use Attp it depends on whether the URL gives you a normal web page in your browser or a list of files If a page that page will be downloaded and so will all pages it links to and all pages they link to etc provided they reside on the same site below the URL If you use file or ftp to specify a folder or directory or give a http URL that leads to a list of files everything in the folder and all its subfolders will be included in the collection You can specify sources of more than one type In this case Figure 16d the new collection will contain documents taken from a local file system as well as a remote web site which will be mirrored during the building process When you click the configure collection button to proceed to the next stage of building the Collector checks that all the sources of input you specified can be reached This might take a few seconds or even a few minutes if you have specified several sources If one or more of the input sources you specified is unavailable you will be presented with a page like that in Figure 16e where the unavailable sources are marked both of
47. e program used at import or build time to generate the OID of each document 80 APPENDIX B GLOSSARY OF TERMS HTML import pl Importing Index InstallShield Main configuration file Metadata MG mgbuild mgquery mkcol pl New Zealand Digital Library Project OID Perl Ping Plugin Protocol Ranked query Receptionist RTF Searching Server setup bat setup sh setup csh HyperText Markup Language the language in which web documents are written Greenstone program used to import documents Process of bringing collections of documents into the Greenstone system Information structure that is used for searching or browsing a collection Windows program used by Greenstone CD ROMs that allows a system to be installed from a CD ROM File that contains specifications common to all collections served by this site Descriptive data such as author title date keywords and so on that is associated with a document or document collection Managing Gigabytes a program used by the Greenstone system for full text indexing that incorporates compression techniques see Witten I H Moffat A and Bell T Managing Gigabytes compressing and indexing documents and images Morgan Kaufmann second edition 1999 MG program for building a compressed full text index MG program for querying a compressed full text index Greenstone program that creates and initializes the directory structure for a new collection R
48. earching and browsing When searching the Greenstone software looks through the entire text of all documents in the collection this is called full text search In most collections the user can choose between indexes built from different parts of the documents Some collections have an index of full documents an index of paragraphs and an index of titles each of which can be searched for particular words or phrases Using these you can find all documents that contain a particular set of words the words may be scattered far and 2 OVERVIEW OF GREENSTONE wide throughout the document or all paragraphs that contain the set of words which must all appear in the same paragraph or all documents whose titles contain the words the words must all appear in the document s title There might be other indexes perhaps an index of sections and an index of section headings Browsing involves lists that the user can examine lists of authors lists of titles lists of dates hierarchical classification structures and so on Different collections offer different browsing facilities 1 2 Finding information Greenstone constructs full text indexes from the document text that is indexes that enable searching on any words in the full text of the document Indexes can be searched for particular words combinations of words or phrases and results are ordered according to how relevant they are to the query In most collections descriptive
49. ection To permanently delete collections from your Greenstone installation choose Delete from the File menu A list of your Greenstone collections appears Select one to see its description then tick the box at the bottom of the dialog and click Delete to delete the collection This action is irreversible so check carefully that you no longer need the collection before proceeding Downloading Files From the Internet The Download view helps you download resources from the internet MAKING GREENSTONE COLLECTIONS 33 This section explains the Librarian Interface s mirroring process The Download view This section describes how to configure a download task and control the downloading process Access the Download view by clicking its tab The top half of the screen shows the downloading controls The bottom half is initially empty but will show a list of pending and completed downloading jobs Files are downloaded into a folder in the workspace called Downloaded Files only present when mirroring is enabled and can be used in all collections built with the Librarian Interface Files in this area are named by their full web URL A new folder is created for each host followed by others for each part of the path This ensures that each file is distinct Use the first of the download configuration controls Source URL to enter the URL of a target resource Use the Download Depth control to limit how many hyperlinks to
50. ed Greenstone Collections which can be opened and explored like any other directory However the documents therein differ from ordinary files because they already have metadata attached and this is preserved when they are moved into the new collection Conflicts may arise because their metadata may have been assigned using a different metadata set from the one in use for the new collection and the user must resolve these In Figure 6 the user has selected some documents from an existing collection and dragged them into the new one The popup window explains that the metadata element Organization cannot be automatically imported and asks the user to either select a metadata set and press Add to add the 22 MAKING GREENSTONE COLLECTIONS metadata element to that set or choose a metadata set then an element and press Merge to effectively rename the old metadata element to the new one by merging the two Metadata in subsequent documents from the same collection will automatically be handled in the same way When large file sets are selected dragged and dropped into the new collection the copying operation may take some time particularly if metadata conversion is involved To indicate progress the interface shows which file is being copied and what percentage of files has been processed Special facilities are provided for dealing with large file sets For example the user can choose to filter the file tree to show only certain fi
51. ed by Silicon Graphics Greenstone program used at build time to create the GDBM database Standard scheme for representing the character sets used in the world s languages The United Nations University also used to refer to a Greenstone collection created for that organization Standard program that computers use to make information accessible over the World Wide Web A standard format for structured documents and data on the web the Greenstone Markup Language is an XML compliant format
52. ed files at once It is added to all files within the folder or selection and to child folders Keep in mind that if you assign metadata to a folder any new files in it automatically inherit the folder s values Adding Previously Defined Metadata To add metadata that has an existing value first select the file then select the required value from the value tree expanding hierarchy folders as necessary The value of the selected entry automatically appears in the Value field alternatively use the value tree s auto select and auto complete features The process of adding metadata with already existing values to folders or multiple files is just the same MAKING GREENSTONE COLLECTIONS 39 Editing or Removing Metadata To edit or remove a piece of metadata first select the appropriate file and then the metadata value from the table Edit the value field deleting all text if you wish to remove the metadata The process is the same when updating a folder with child folders or multiple files but you can only update metadata that 1s common to all files folders selected The value tree shows all currently assigned values as well as previous values for the current session so changed or deleted values will remain in the tree Closing the collection and then re opening it will remove the values which are no longer assigned Reviewing Assigned Metadata Sometimes you need to see the metadata assigned to many or all files at once f
53. entation of the collection being created As noted earlier the result of this process 1s recorded in a collection configuration file which is Greenstone s way of expressing the facilities that a collection requires This step involves a series of separate interaction screens each dealing with one aspect of the collection design In effect it serves as a graphical equivalent to the usual process of editing the configuration file manually Operations include e Reviewing and editing collection level metadata such as title author and public availability of the collection e Defining what full text indexes are to be built e Creating sub collections and having indexes built for them e Adding or removing support for predefined interface languages e Constructing a list of plug ins to be used and their arguments e Presenting the list to the user for review and modification e Configuring individual plug ins e Constructing a list of classifiers their arguments assignment and configuration e Assigning formatting strings to various controls within the collection thus altering its appearance e Reviewing the metadata sets and their elements used in the collection In Figure 11 the user has clicked the Design tab and is reviewing the general information about the collection entered when the new collection was created On the left are listed the various facets that the user can configure General Document Plug ins Se
54. esearch project in the Computer Science Department at the University of Waikato New Zealand that created the Greenstone software nzdl org Object Identifier a unique identification code associated with a document Programming language used for many of the text processing operations that occur during the building process Message sent to a system to determine whether it is running or not Code module for handling documents of different formats used during the importing and building processes Set of conventions by which a Greenstone receptionist communicates with a collection server Natural language query to an information retrieval system for which the documents that match the query are sorted in order of relevance Program that organizes the Greenstone user interface Rich Text Format a standard format for interchange of text documents Accessing a collection through a full text search of its contents or parts of contents such as section titles See Collection server and Web server Script used to set up your environment to recognize the Greenstone software Site configuration file Stemming STL txt2db Unicode UNU Web server XML APPENDIX B GLOSSARY OF TERMS 81 File that contains specifications used to configure the Greenstone software for the site on which it is installed Stripping endings off a query term to make it more general Standard template library a widely available library of C code develop
55. ete collections Creating a New Collection Saving the Collection To create a new collection open the File menu and choose New Several fields need to be filled out but you can change their values later if you need to in the design view Collection title is the text displayed at the top of your collection s home page It can be any length Description of content should describe in as much detail as possible what the collection is about Use the Enter key to break it into paragraphs Finally you must specify whether the new collection will have the same appearance and metadata sets as an existing collection or whether to start a default New Collection Click OK to create the collection If you chose New Collection you are prompted for the metadata sets to use in it You can choose more than one and you can add others later Clicking Cancel returns you to the main screen immediately Save your work regularly by opening the File menu and choosing Save Saving a collection is not the same as making it ready for use in Greenstone see Producing Your Collection 32 MAKING GREENSTONE COLLECTIONS The Librarian Interface protects your work by saving it whenever you exit the program or load another collection Saved collections are written to a file named for the collection and with file extension col located in a folder of the same name within your Greenstone installation s collect folder Openin
56. follow when downloading Set this to 0 to download a single web page set it to 1 to download a page and all the pages it points to The depth limit is ignored when downloading media other than html pages Next there are several checkbox controls which can be set to turn on the specified feature for a specific download Once the configuration 1s set up click Download to start the new download job There are two other button controls Preferences which links to the connection section of the Preferences where proxy settings can be edited and Clear Cache which deletes all previously downloaded files The download list has an entry for each web page download Each entry has a text region that gives details of the task along with a progress bar showing current activity Three buttons appear to the left of each entry Pause is used for pausing a currently downloading task View Log Opens a window showing the download log file Close terminates the download and removes the task from the list The Preferences section describes how to establish an Internet connection via a proxy If authentication is needed the proxy server prompts for identification and password The Librarian Interface does not store passwords between sessions Collecting Files for Your Collection Once you have a new collection you need to get some files into it These may come from your ordinary file space or from other Greenstone collections Some may already have a
57. g under the terms of the GNU General Public License The software includes everything described above web serving CD ROM creation collection building multi lingual capability plugins and classifiers for a variety of different source document types It includes an autoinstall feature to allow easy installation on both Windows and Unix In the spirit of open source software users are encouraged to contribute modifications and enhancements APPENDIX A SOFTWARE FEATURES 77 greenstone org PLD AICI IS tc TI cc Appendix B Glossary of terms Term autoconf Autorun Boolean query Browsing buildcol pl Building C Casefolding CGI CGI script cgi bin Classifier Collection Collection configuration file Collection server Meaning Unix program used to configure the Greenstone software installation package to suit your system Windows feature that starts a program automatically whenever a CD ROM is inserted Query to an information retrieval system that may contain AND OR NOT Accessing a collection by scanning an organized list of metadata values associated with the documents such as author title date keywords Greenstone program used to build collections Process of creating the indexing and browsing structures that are used to access a collection Programming language in which the majority of the Greenstone software is written Making uppercase and lowercase words look the same for searching pu
58. g an Existing Collection Deleting Collections To open an existing collection choose Open from the File menu to get the Open Collection prompt A list of your Greenstone collections appears Select one to see its description and click Open to load it If you seek a collection that resides outside Greenstone s collect folder click Browse for a file system browsing dialog In case more than one Greenstone Librarian Interface program is running concurrently the relevant directories are locked to prevent interference On opening a collection a small temporary lock file is created in its folder Before opening a collection the Librarian Interface checks to ensure that no lock file already exists You can tell whether a collection 1s locked by the colour of its icon green for a normal collection red for a locked one However when the Librarian Interface is exited prematurely the lock file is sometimes left in place When you open such a collection the Librarian asks if you want to steal control of it Never steal a collection that someone else is currently working on When you open a collection that the Greenstone Librarian Interface did not create you will be asked to select a metadata set or sets If none are selected any existing metadata will be ignored Otherwise metadata will be imported just as it is when you drag in files with existing metadata The process is described in the Importing Previously Assigned Metadata s
59. g the Collector to build a new collection continued on next pages Logging in MAKING GREENSTONE COLLECTIONS 55 a Netscape File Edit View Go Window Help ETA SET HOME colte M The Collector The pen is mighfier than the sword N Building and distributing information collections carries responsibilities that you may want fo reflect on before you begin There are legal issues of copyright being able fo access documents doesn t mean you can necessarily give them fo others There are social issues collections should respect the customs of the community out of which the documents arise And there are ethical issues some things simply should not be made available fo others Be sensifive fo the power of information and use if wisely The Collector helps you to create new collections modify or add to existing ones or delete collections To do this you will be guided through a sequence of Web pages which request the information that is needed First you must decide whether to create an entirely new collection C work with an existing one adding data to it or deleting it In order to build or modify digital library collections you must sign in This is to protect you from others logging in to your computer and altering the information on it Note for security reasons you will be automatically logged out once a 30 minute period has elapsed since you logged in If this happens don t worry you will be invi
60. gned to each user which enables individual user s interactions to be traced through the log file Each line in the user log records a page visited even the pages generated to inspect the log files It contains a the IP address of the user s computer b a timestamp in square brackets c the CGI arguments in parentheses and d the name of the user s browser Netscape is called Mozilla Here is a sample line split and annotated for ease of reading 72 ADMINISTRATION a b c d fast cgi bin niupepalibrary its wwwl massey ac nz Thu Dec 07 23 47 00 NZDT 2000 a p b 0 bcp beu c niupepa cc ccp 0 ccs 0 cl cm cq2 d e er f 0 fc 1 gc 0 gg text gt 0 h h2 hl 1 hp il l j j2 k 1 ky l en m 50 n n2 o 20 p home pw q q2 FEL s 0 sp frameset tel ua uan ug uma listusers umc umnpwl umnpw2 umpw umug umun umus un us invalid v 0 w w X 0 z 130 123 128 4 950647871 Mozilla 4 08 en Win95 I Nav The last CGI argument z is an identification code or cookie generated by the user s browser it comprises the user s IP number followed by the timestamp when they first accessed the digital library The log file usage txt is placed in the etc directory in the Greenstone file structure see the Greenstone Digital Library Developer s Guide When logging is enabled every action by every user is logged However only the
61. guring Arguments instructions for this dialog are just the same as for plugins see Document Plugins Once you have configured the new classifier it is added to the end of the Currently Assigned Classifiers list To remove a classifier select it from the list and click Remove Classifier To change the arguments a classifier select it from the list and click Configure Classifier or double click on the classifier in the list The ordering of classifiers in the collection s navigation bar is reflected in their order here To change it select the classifier you want to move and click Move Up or Move Down For further information on classifiers read Chapter 2 Greenstone Developer s Guide Getting the most out of your documents The web pages you see when using Greenstone are not pre stored but are generated on the fly as they are needed Format commands are used to change the appearance of these generated pages They affect such things as where buttons appear when a document is shown and what links are displayed by the DateList classifier Format commands are not easy to develop and you should read Chapter 2 of the Greenstone Developer s Guide This section discusses the format settings and how the Librarian Interface gives access to them Under Design Sections click Format Features You can apply a format command to anything in the Choose Feature pull down list which includes each classifier and a predefined li
62. h command to insert the name of the file being opened Once these are filled out Add is enabled and can be clicked to add the association To edit an association select an existing file extension Any existing associated command is shown in the launch command field Edit it and then click Replace MAKING GREENSTONE COLLECTIONS 51 To remove an association select an existing file extension and click Remove The file extension remains in the For Files Ending pull down list File associations are stored in the Librarian Interface s main folder in a file called associations xml Exporting Collections to CD DVD Greenstone can export one or more collections to a self installing CD DVD for Windows To do so Greenstone s Export to CD ROM package must be installed This is not included by default so you may need to modify your installation to include it To export a collection open the File menu and choose Write CD DVD Image A list of Greenstone collections appears click on any one to see its description Tick the check boxes of the collections to export You can enter the CD DVD s name in the box this is what will appear in the Start menu when the CD DVD has been installed Then click Export The process involves copying many files and may take a few minutes Upon completion Greenstone will show the name of a folder containing the exported collections Use a CD DVD writer to copy its contents to a blank CD DVD
63. he Log History list MAKING GREENSTONE COLLECTIONS 49 Import and Build Settings Miscellaneous Preferences This section explains how to access the various import and build settings For more information of importing and building read Chapter 1 of the Greenstone Developer s Guide Understanding the collection building process Controlling the various settings is done in a similar way to the Configuring Arguments window described in the Document Plugins section Some fields require numeric arguments and you can either type these in or use the up and down arrows to increase or decrease the current value in some cases the interface restricts the range you can enter Others are enabled by clicking a checkbox click again to disable This section describes features of the Librarian Interface that are not associated with any particular view This section explains the preferences dialog accessed by opening File gt Preferences The first General option is a text field for entering your e mail address This will be used for the creator and maintainer collection metadata items The next option is a pull down list of the languages in which the Librarian Interface can be presented If you change the dictionary by choosing one from the list you must restart the Librarian Interface in order to load the new language strings from the dictionary If View Extracted Metadata is checked the various controls dealing with me
64. idual document yjust the document text In some cases the document is split into pages and you can read sequentially or jump about USING GREENSTONE COLLECTIONS 9 Figure 2 pa Butterfly Farming in Papua New Guinea 1 Introduction and Summary Netscape A book in the Demo File Edit View Go Window Help collection HOME HELP PREFERENCES search subjects titles a z organization how to uneging Thai Asie Arsama Butterfly Farming in Faua New Guinea Vi L Butterfly Farming in Papua Hew Guinea Acknowle doments Panel on Butterfly Farming in Papua New Cine a Contributors Freface 1 Introduction and Summary 2 Butterfly Status and Conservation 5 History and Government Policy 4 Operating a Butterfly Farm Ej 3 Application to Other Nations CO Appendixes j Advisory Committee on Technology Innovation EXPAND EXPAND TEXT CONTENTS NO HIGH DETACH LIGHTING Board on Science and Technology for International Development 1 Introduction and Summary The international demand for tropical butterflies is much greater than is generally recogmzed Each year millions of them are caught and sold throughout the world Many buyers are scientists engaged in research on aspects of systematics ecology ethology evolution and conservation Others are individuals who like expensive curios that mcorporate butterflies Pl Document Done from one page to another What the icons mean When you are browsing around the c
65. ing Metadata Sets Sets of predefined metadata elements are known as metadata sets An 38 MAKING GREENSTONE COLLECTIONS example is the Dublin Core metadata set When you add a metadata set to your collection its elements become available for selection You can have more than one set to prevent name clashes a short identifier that identifies the metadata set is pre pended to the element name For instance the Dublin Core element Creator becomes dc Creator Metadata sets are stored in the Librarian Interface s metadata folder and have the suffix mds To control the metadata sets used in a collection use the Metadata Sets entry on the Design view Appending New Metadata We now add a metadata item both element and value to a file First select the file from the Collection file tree on the left The action causes any metadata previously assigned to this file to appear in the table at the right Next select the metadata element you want to add by clicking its row in the table Type the value into the value field Use the character to add structure as described in The Enrich View Pressing the Up or Down arrow keys will save the metadata value and move the selection appropriately Pressing Enter will save the metadata value and create a new empty entry for the metadata element allowing you to assign multiple values to a metadata element Ele You can also add metadata to a folder or to several multiply select
66. ion For example the query what s a post retrieval scan will first retrieve all documents that match all of the words what s a post retrieval scan and then the documents returned will be checked for the phrase post retrieval scan Phrase matches are case insensitive if ignore case differences 1s set on the Advanced query mode Using search history USING GREENSTONE COLLECTIONS 13 Preferences page In advanced query mode which can be selected on the Preferences page the queries for all of the words described above are actually Boolean queries They consist of a list of terms joined by logical operators amp and or and not Absent operators between search terms are interpreted as amp and thus a query without any operators returns documents that match all the terms If the words AND OR and NOT appear in your query they are treated as ordinary search terms not operators For operators you must use amp and In addition parentheses can be used for grouping When you switch on the search history feature on the Preferences page you will be shown your last few searches along with a summary of how many results they generated Click the button beside one of the previous searches to copy the text into the search box This makes it easy to repeat slightly modified versions of previous queries 2 3 Changing the preferences Collection preferences Language preferences When you click the p
67. ivided into different sections each associated with a particular stage of navigating or presenting information On the left is a list of different views and on the right are the controls associated with the current one To change to a different view click its name in the list To understand the stages and terms involved in designing a collection first read Chapters 1 and 2 of the Greenstone Developer s Guide This section explains how to review and alter the general settings associated with your collection First under Design Sections click General Here the values provided during collection creation can be modified First are the contact emails of the collection s creator and maintainer The following field allows you to change the collection title The folder that the collection is stored in is shown next but this cannot be edited The next one specifies in the form of a URL the icon to show at the top left of the collection s About page and the next is the icon used in the Greenstone library page to link to the collection Then a checkbox controls whether the collection should be publicly accessible Finally comes the Collection Description text area as described in Creating A New Collection This section describes how to configure the document plugins the collection uses It explains how you specify what plugins to use what parameters to pass to them and in what order they occur Under Design 42 MAKING GREENSTONE
68. ization and maintenance Development Library A Greenstone collection of humanitarian information for developing countries Basic unit from which digital library collections are constructed it may include text graphics sound video etc A standard way of describing metadata Facility that allows CGI scripts to remain continuously active so that they do not have to be restarted from scratch every time they are invoked That part of a Greenstone collection server that implements querying and browsing operations A string that specifies how documents and other listings are to be displayed in Greenstone Standard way of encoding the Chinese language GNU DataBase Manager a program used within the Greenstone software to store metadata for each document GNU Image Manipulation Program used on Unix to create icons in Greenstone Greenstone Markup Language an XML compliant format used for storing documents internally Software license that permits users to copy and distribute computer programs freely and modify them so long as all modifications are made publicly available The name of this digital library software Abbreviation for Greenstone Digital Library Operating system variable that represents the top level directory in which all Greenstone programs and collections are stored SGSDLHOME on Unix systems Operating system variable that represents the operating system currently being used GSDLOS on Unix systems Greenston
69. last 100 entries in the log file are displayed by the usage og link in Figure 17 4 3 User management Greenstone incorporates an authentication scheme which can be used to control access to certain facilities At the moment this is only used to restrict the people who are allowed to enter the Collector and certain administration functions If for a particular collection it were necessary to authenticate users before returning information to them this 1s possible too for example documents could be protected on an individual basis so that they can only be accessed by registered users on presentation of a password However no current collections use this facility Authentication is done by requesting a user name and password as illustrated in Figure 16a From the administration page users can be listed new ones added and old ones deleted The ability to do this is of course also protected only users who have administrative privileges can add new users It is also possible for each user to belong to different groups At present the only extant groups are administrator and colbuilder Members of the first group can add and remove users and change their groups Members of the second can access the facilities described above to build new collections and alter and delete existing ones When Greenstone is installed there is one user called admin who belongs to both groups The password for this user is set during the in
70. les using a dropdown menu of file types displayed underneath the trees In Figure 7 only the HTM and HTML files are being shown and only these files will be copied by drag and drop Enriching the documents The next phase in collection building is to enrich the documents by adding metadata The Enrich tab brings up a new panel of information Figure 8 which shows the document tree representing the collection on the left and on the right allows metadata to be added to individual documents or groups of documents Documents that are copied during the first step come with any applicable metadata attached If a document is part of a Greenstone collection previously defined metadata is carried over to the new collection Of course this new collection may have a different metadata set or perhaps just a subset of the defined metadata and only metadata that pertains to the new collection s set is carried over Resolution of such conflicts may require user intervention via a supplementary dialog Figure 6 Any choices made are remembered for subsequent file copies The Enrich panel allows metadata values to be assigned to documents in the collection For example new values can be added to the set of existing values for an element If the element s values have a hierarchical structure the hierarchy can be extended in the same way 1 This option is disabled if an element of the same name already exists MAKING GREENSTONE COLLECTIONS 23
71. n also choose whether to ignore word endings or not this 1s called stemming Under Search options on the Preferences page you will see a pair of buttons labeled ignore case differences and upper lower case must match these control the case sensitivity of your queries Below is a pair of buttons labeled ignore word endings and whole word must match these control stemming For example if the buttons ignore case differences and ignore word endings are selected the query African building will be treated the same as africa builds because the uppercase letter in African will be transformed to lowercase and the suffixes n and ing will be removed from African and building respectively also s would be removed from builds Generally case differences and word endings should be ignored unless you are querying for particular names or acronyms If your query includes a phrase in quotation marks only documents containing that phrase exactly as typed will be returned If you want to use phrase searching you need to learn a little about how it works Phrases are processed by a post retrieval scan First the query is issued in the normal way all the words in the phrase are included as search terms and then the documents returned are scanned to eliminate those in which that phrase does not appear During the post retrieval scan phrases are checked just as they are including any punctuat
72. n toggle between Including documents that match the filter or Excluding them Finally you can specify any of the standard PERL regular expression flags to use when matching e g 1 for case insensitive matching Finally click Add Filter to add the filter to the Defined Subcollection Filters list To remove a filter select it from the list and click Remove Filter To alter a filter select it from the list change any of the values that appear in the editing controls and click Replace Filter to commit the changes Having defined a subcollection filter use the Assign Partitions tab to build indexes for it or for a group of filters Select the desired filter or Assign Languages MAKING GREENSTONE COLLECTIONS 45 filters from the Defined Subcollection Filters list enter a name for your partition in the Partition Name field and click Add Partition To remove a partition select it from the list and click Remove Partition To make a partition the default one select it from the list and click Set Default This section details how to restrict search indexes to particular languages You do this by generating a partition using the Assign Languages tab of the Partition Indexes view To add a new language to partition by use the Assign Languages tab to build an index for it Select the desired language from the Language to add pull down list and click Add Language To remove a language selec
73. nces button at the top of the page Click the title of any document or the little icon beside it to open it The icon may show a book or a folder or a page it will be a book icon if you are searching books otherwise if you are searching sections it will be a folder or page icon depending on whether or not the section found has subsections Whatever you type into the query box is interpreted as a list of words called search terms Each search term contains nothing but alphabetic characters and digits Terms are separated by white space If any other characters such as punctuation appear they serve to separate terms just as though they were spaces And then they are ignored You can t search for USING GREENSTONE COLLECTIONS 11 words that include punctuation For example the query Agro forestry in the Pacific Islands Systems for Sustainability 1993 will be treated the same as Agro forestry in the Pacific Islands Systems for Sustainability 1993 Query type There are two different kinds of query e Queries for all the words These look for documents or chapters or titles that contain all the words you have specified Documents that satisfy the query are displayed e Queries for some of the words Just list some terms that are likely to appear in the documents you are looking for Documents are displayed in order of how closely they match the query When determining the degree of match e the more search terms a
74. nes can be removed from those that have it or appended to the others A folder icon may appear beside some metadata entries This indicates that the values are inherited from a parent or ancestor folder Inherited metadata cannot be edited or removed only appended to or overwritten Click on the folder icon to go immediately to the folder where the metadata is assigned Clicking on a metadata element in the table will display the existing values for that element in the Existing values for area below the table The Value Tree expands and collapses Usually it is a list that shows all values entered previously for the selected element Clicking an entry automatically places it into the value field Conversely typing in the text field selects the Value Tree entry that starts with the characters you have typed Pressing Tab auto completes the typing with the selected value Metadata values can be organised into a hierarchy This is shown in the Value Tree using folders for internal levels Hierarchical values can be entered using the character to separate the levels For example Cards Red Diamonds Seven might be used in a hierarchy that represents a pack of playing cards This enables values to be grouped together Groups can also be assigned as metadata to files Greenstone extracts metadata automatically from documents into a metadata set whose elements are prefixed by ex This has no value tree and cannot be edited Select
75. ng added he file at ii10le ii10le htm has been recognised by the HTMLPlug plugin and is being added he file at iilise iil1se htm has been recognised by the HTMLPlug plugin and is being added he file at wh34te wb34te htm has been recognised by the HTMLPlug plugin and is being added ORK ROKK ROR OK OK OK KOKO Import Finished MAR ROK OK OK OK OK OK KOK kk Of the 10 documents found while building this collection 10 were recognised by plugins and are available in the collection KK KOK KOK OK KK KOK KK Build Started KOKKE OK OK OK KOK OK KK Compressing text reating an index based on section text 4 UNESCO Example 1 Netscape File Edit view Go Window Help AY A rit A MO a HOME HELP PREFERENCES UNESCO Example 1 ab search subjects titles a z organisations howto Search for chapters which contain some of the words Begin Search About this collection A Greenstone Digital Collection built using the GLI Files are sourced from previous collections including the Humanities Development Library DLS and have some pre existing metadata assigned to them How to find information in the UNESCO Example 1 collection ko lag Document Done si L 30 MAKING GREENSTONE COLLECTIONS Building the collection Previewing Plug ins and classifiers have many different arguments or options that the user can supply The dialog box in Figure 13 shows the user
76. ns available at this stage include e Navigating the existing file structure hierarchy and the one being created in the usual way e Dragging and dropping files into the new collection e Multiple selection of files e Dragging and dropping entire sub hierarchies e Deleting documents from the nascent collection e Creating new sub hierarchies within the collection e Filtering the files that are visible in both the local file system and the collection based on predetermined groups or on standard file matching terms e Invoking the appropriate program to display the contents of a selected file by double clicking it Care is taken to deal appropriately with name clashes when files of the same name in different parts of the computer s directory structure are copied into the same folder of the collection In Figure 5 the user is using the interactive file tree display to explore the local file system At this stage the collection on the right is empty the user populates it by dragging and dropping files of interest from the left to the right panel Such files are copied rather than moved so as not to disturb the original file system The usual techniques for multiple selection dragging and dropping structuring the new collection by creating subdirectories folders and deleting files from it by moving them to a trashcan are all available Existing collections are represented by a subdirectory on the left call
77. o hints All these buttons are visible in Figure 1 How to read the documents In the Demo collection you can tell when you have arrived at an individual book because there is a photograph of its front cover Figure 2 Beside the photograph is a table of contents the entry in bold face marks where you are in this case Introduction and Summary Section 1 of the chosen book This table is expandable click on the folders to open them or close them Click on the open book at the top to close it Underneath is the text of the current section The international demand for tropical butterflies in the example beginning at the very bottom of the illustration When you have read through it there are arrows at the end to take you on to the next section or back to the previous one Below the photograph are four buttons Click on detach to make a new browser window for this book This is useful if you want to compare books or read two at once If you have reached this book through a search the search terms will be highlighted the no highlighting button turns this off Click on expand text to expand out the whole text of the current section or book Click on expand contents to expand out the whole table of contents so that you can see the titles of all chapters and subsections In some collections the documents do not have this kind of hierarchical structure In this case no table of contents is displayed when you get to an indiv
78. o be processed in a consistent manner To date collections have been built containing French Spanish Maori Chinese Arabic and English On the fly conversion is used to convert from Unicode to an alphabet supported by the user s web browser The interface can be presented in multiple languages Currently the interface 1s available in Arabic Chinese Dutch English French German Maori Portuguese and Spanish New languages can be added easily Greenstone collections can contain text pictures audio and video clips Most non textual material is either linked in to the textual documents or accompanied by textual descriptions such as figure captions to allow full text searching and browsing However the architecture permits implementation of plugins and classifiers even for non textual data Compression techniques are used to reduce the size of the indexes and text Reducing the size of the indexes via compression has the added advantage of increasing the speed of text retrieval 76 APPENDIX A SOFTWARE FEATURES Administrative function An administrative function enables specified users to authorize new provided New collections appear dynamically Collections can be published on the Internet or on CD ROM Collections can be distributed amongst different computers Operates on both Windows and Unix What you get with Greenstone users to build collections protect documents so that they can only be acces
79. o enter some information about it e title e contact E mail address and e brief description The collection title is a short phrase used through the digital library to identify the content of the collection Example titles include Food and Nutrition Library World Environmental Library Development Library and so on The E mail address specifies the first point of contact for any problems encountered with the collection If the Greenstone software detects a problem a diagnostic report may be sent to this address Finally the brief description is a statement describing the principles that govern what is included in the collection It appears under the heading About this collection on the first page when the collection is presented The user s current position in the collection building sequence is indicated by an arrow that appears in the display at the bottom of each screen in this case as Figure 16c shows the collection information stage The user proceeds to Figure 16d by clicking the green source data button 58 MAKING GREENSTONE COLLECTIONS Figure 16 Continued c SE aren Hee View Go Wi H HOME collec Collection information N Source data When creating a new collection you need to enter some preliminary information about the source data This process is structured as a series of Web pages overseen by The Collector The bar at the bottom of the page shows you the sequence of pages to be completed
80. olders in the tree You can specify a custom filter by typing in a pattern to match files against Librarian Systems Specialist and Expert modes only Use standard file system abbreviations such as or doc matches any characters Enriching the Collection with Metadata Having gathered several files into the collection now enrich them with additional information called metadata This section explains how metadata is created edited assigned and retrieved and how to use external metadata sources also see Chapter 2 of the Greenstone Developer s Guide Getting the most out of your documents MAKING GREENSTONE COLLECTIONS 37 The Enrich View Use the Enrich view to assign metadata to the documents in the collection Metadata is data about data typically title author creation date and so on Each metadata item has two parts element tells what kind of item it is such as author and value gives the value of that metadata element such as the author s name On the left of the Enrich view is the Collection Tree To the right is the Metadata Table which shows metadata for any selected files or folders in the Collection Tree Columns are named in grey at the top and can be resized by dragging the separating line If several files are selected black text indicates that the value is common to all of the selected files while grey text indicates that it is not Black values may be updated or removed while grey o
81. ollection you will encounter the items shown in Table 3 How to search for particular words From the search page follow these simple steps to make a query e Specify what units you want to search in the Demo collection you can search section titles or the full text of the books 10 USING GREENSTONE COLLECTIONS aFoOBoogs DETACH EXPAND EXPAND HiGH LIGHTING Search terms Table 3 Icons that you will encounter when browsing Click on a book icon to read the corresponding book Click on a bookshelf icon to look at books on that subject View this document Open this folder and view contents Click on this icon to close the book Click on this icon to close the folder _ Click on the arrow to go on to the next section or back to the previous section Open this page in a new window Expand table of contents Display all text Highlight search terms e Say whether you want to search for all or just some of the words e Type in the words you want to search for into the query box e Click the Begin Search button When you make a query the titles of up to twenty matching documents will be shown There is a button at the end to take you on to the next twenty From there you will find buttons to take you on to the third twenty or back to the first twenty and so on However for efficiency reasons a maximum of 100 is imposed on the number of documents returned You can change these numbers by clicking the prefere
82. or instance to determine how many files are left to work on or to get some idea of the spread of dates Select the files you wish to examine then right click and choose Assigned Metadata A window called All Metadata dominated by a large table with many columns appears The first column shows file names the rows show all metadata values assigned to those files Drawing the table can take some time 1f many files are selected You can continue to use the Librarian Interface while the All Metadata window is open When it gets too large you can filter the All Metadata table by applying filters to the columns As new filters are added only those rows that match them remain visible To set modify or clear a filter click on the funnel icon at the top of a column You are prompted for information about the filter Once a filter is set the column header changes colour The prompt has a Simple and an Advanced tab The Simple version filters columns so that they only show rows that contain a certain metadata value matches all values You can select metadata values from the pull down list The Advanced version allows different matching operations must start with does not contain alphabetically less than and is equal to The value to be matched can be edited to be any string including and you can choose whether the matching should be case insensitive Finally you can specify a second matching condition that you can
83. ot done for the style of collections we are describing here It is important to remember that you are creating a hierarchical table of contents when you insert section tags into your document This means that sections can be nested within other sections In fact all sections must be nested within a single enclosing section that encompasses the entire document The following example demonstrates a document with two chapters the second of which contains two subsections For real examples of source documents tagged in this way look at the source documents for the Demo or DLS collections lt Section Description Metadata name Title sMy Document lt Metadata gt lt Description gt Section Description Metadata name Title gt Chapter 1 lt Metadata gt lt Description gt SS text of chapter 1 goes here lt lt Section gt Section Description Metadata name Title Chapter 2 Metadata MAKING GREENSTONE COLLECTIONS 53 lt Description gt lt Section gt lt Description gt lt Metadata name Title gt Subsection 1 lt Metadata gt lt Description gt cate text of sub section 1 goes here gle lt Section gt lt Section gt lt Description gt lt Metadata name Title gt Subsection 2 Metadata lt Description gt gt text of sub section 2 goes here lt l lt Section gt lt Section gt lt Section gt Ze Note that metadata assigned from within a section tag
84. plain the function of each argument When satisfied with the arguments the user clicks Build Collection Greenstone continually prints text that indicates progress and this is shown along with a more informative progress bar The Preview Collection button Figure 14 is used to view the collection that has been built Clicking this button launches a web browser showing the home page of the collection Figure 15 In practice previewing often shows up deficiencies in the collection design or in the individual metadata values and the user frequently returns to earlier stages to correct these This button becomes active once the collection has been created The newly created collection will also have been installed on your Greenstone home page as one of the regular collections Help MAKING GREENSTONE COLLECTIONS 31 On line help is always available and is invoked using the Help item at the right of the main menu bar at the top of each of the Figures This opens up a hierarchically structured file of help text and account is taken of the user s current context to highlight the section that 1s appropriate to the present stage of the interaction Furthermore as noted above whenever the mouse is held still over any interactive object a small window pops up to give a textual tool tip as illustrated near the bottom of Figure 14 3 2 Librarian Interface user guide Starting Off This section covers how to create load save and del
85. r ftp to specify a folder or directory or give a http URL that leads to a list of files everything in the folder and all its sub folders will be included in the collection Click the more sources button to get more input boxes Click one of the green buttons If you are an advanced user you may want to adjust the collection configuration Alternatively go straight to the building stage Remember you can always revisit an earlier stage by clicking its yellow button collection source configure build view information data collection collection collection la Document Done Ui can be accommodated is given in the section on Document formats below If you base your new collection on an existing one the files in the new collection must be exactly the same type as those used to build the existing one Note that some collections use non standard input file formats while others use metadata specified in auxiliary files If your new input lacks this information some browsing facilities may not work properly For example if you clone the Demo collection you may find that the subjects organization and how to buttons don t work 60 MAKING GREENSTONE COLLECTIONS Boxes are provided to indicate where the source documents are located up to three separate input sources can be specified in Figure 16d If you need more just click the button marked more sources There are three kinds of specification ea directory nam
86. rce data comes from contigure 3 co ecdion Adjust the configuration options advanced users only build 4 co ecton Build the collection see below view 5 colledion Proudly view your handiwork The fourth step is where the computer does all the work In the building process the computer makes all the indexes and gathers together any other information that is required to make things work But first you have to specify the information N A diagram appears below that will help you keep track of where you are The green button is the one N that you click to carry on in the sequence As you go through the sequence the buttons will change to yellow You can return to a previous page by clicking on the corresponding yellow button in the diagram When you are ready click the green collection information button to begin creating your new digital library collection collection source configure build view information data collection collection collection af Document Done Li in because other people who use the Greenstone system on your computer should not be allowed to build collections without prior permission Dialog structure Upon completion of login the page in Figure 16b appears This shows the sequence of steps that are involved in collection building They are Collection information Source data Configuring the collection Building the collection Viewing the collection koul s d ai OO The first step is to
87. rdering is sometimes important The order of the plugins can be changed in Library Systems Specialist and Expert modes only see Preferences This section explains how to modify a new design feature in Greenstone Search Types which allow fielded searching The search types specify what kind of search interface should be provided form for fielded searching and or plain for regular searching Under Design Sections click Search Types When you enter the Search Types view first check Enable Advanced Searches which activates the other controls This changes the collection to use an indexing mechanism that allows fielded searching Index specification is slightly different in this mode When switching between standard and advanced searching the GLI does its best to convert the Search Indexes MAKING GREENSTONE COLLECTIONS 43 index specification but may not get it completely right To add a search type select it from the Search Types list and click Add Search Type Each type can only appear in the list once The first search type will be the default and will appear on the search page of the built collection Any others will be selectable from the preferences page To remove a search type select it from the Currently Assigned Search Types list and click Remove Search Type The list must contain at least one search type Indexes specify what parts of the collection are searchable This section explains how to add and
88. read Chapter 2 of the Developer s Guide 3 1 The librarian s interface Getting started To convey the operation of Greenstone s librarian interface we work through a simple example Figures 4 to 15 are screen snapshots at various points during the interaction This example uses documents in the Development Library Subset DLS collection which is distributed with Greenstone For expository purposes the walkthrough takes the form of a single pass through the steps listed above A more realistic pattern of use however is for users to switch back and forth through the various stages as the task proceeds The librarian interface can be run in one of four modes Librarian Assistant Librarian Library Systems Specialist and Expert Modes control the level of detail within the interface and can be changed through Preferences in the File menu The walkthrough in this section assumes that the librarian interface is operating in the default mode Librarian Launch the librarian interface under Windows by selecting Greenstone Digital Library from the Programs section of the Start menu and choosing Librarian Interface If you are using Unix instead type cd gsdl cd gli gli sh where gsd is the directory containing your Greenstone system To begin you must either open an existing collection or start a new one Figure 4 shows the user in the process of starting a new collection She has selected New from the file menu
89. rees the shape of the pointer changes and dragging At the bottom of the window is a status area that shows the progress of actions involving files copying moving and deleting These can take some time to complete The Stop button stops any action that is currently in progress Two large buttons occupy the lower right corner of the screen New Folder with a picture of a folder creates new folders see Creating folders Delete with a garbage can removes files Clicking the Delete button will remove any selected files from the Collection file tree Alternatively files can be deleted by dragging them onto the Delete button To select several sequential items select the first and then hold down Creating Folders Adding Files MAKING GREENSTONE COLLECTIONS 35 Shift and click on the last the selection will encompass all intervening items Select non sequential files by holding down Ctrl while clicking Use these two methods together to select groups of non adjacent items Certain folders such as the one containing your own web pages sometimes have special significance The Librarian Interface can map such folders to the first level of the file tree To do this right click the desired folder Select Create Shortcut and enter a name for the folder To remove an item right click the mapped folder and select Remove Shortcut Use folders in the Collection file tree to group files together and make them easier
90. references button at the top of the page you will be able to change some features of the interface to suit your own requirements The preferences depend on the collection an example is shown in Figure 3 When you adjust your search preferences you should press the set preferences button shown in Figure 3 After setting preferences do not use your browser s back button that would unset them Instead click one of the buttons on the access bar near the top of the page Some collections comprise several subcollections which can be searched independently or together as one unit If so you can select which subcollections to include in your searches on the Preferences page Each collection has a default presentation language but you can switch to a different language if you like You can also alter the encoding scheme used by Greenstone for output to the browser the software chooses sensible defaults but with some browsers better visual results can be used by switching to a different encoding scheme All collections allow you to switch from the standard graphical interface format to a textual one This 14 USING GREENSTONE COLLECTIONS greenstone demo Preferences Netscape Iof Xx Figure 3 File Edit View Go Window Help The Preferences page pit HOME HELP ion preferen search subjects titles a z organization how to Presentation preferences Interface language english z Encoding Western 15
91. rovides The above mentioned export directory contains four files that relate to the installation process and three subdirectories that contain the complete collection and software Remove the four files and use InstallShield to make a CD ROM image that installs these directories and creates a shortcut to the program gsdl server exe 66 MAKING GREENSTONE COLLECTIONS Document formats When building collections Greenstone processes each different format of source document by seeking a plugin that can deal with that particular format Plugins are specified in the collection configuration file Greenstone generally uses the filename to determine document formats for example foo txt is processed as a text file foo html as HTML and foo doc as a Word file Here is a summary of the plugins that are available for widely used document formats More detail about these plugins and additional plugins for less commonly used formats can be found in the Greenstone Digital Library Developer s Guide TEXTPlug txt text TEXTPlug interprets a plain text file as a simple document It adds fitle metadata based on the first line of the file ATMLPlug htm html also shtml shm asp php cgi WORDPlug doc PDFPlug pdf HTMLPlug processes HTML files It extracts title metadata based on the lt title gt tag other metadata expressed using HTML s metatag syntax can be extracted too There are many options avail
92. rposes Common Gateway Interface a scheme that allows users to activate programs on the host computer by clicking on web pages Code associated with a button menu or link on a web page that specifies what the host computer is to do when it is clicked Directory in which CGI scripts are stored Greenstone code module that examines document metadata to form an index for browsing Set of documents that are brought together under a uniform searching and browsing interface File that specifies how a collection is to be imported and built what indexes and language interfaces are to be provided etc Program responsible for providing access to a collection when it 1s being used Configuration file CVS db2txt Demo collection Digital library DL Document Dublin core Fast CGI Filter program Format string GB encoding GDBM GIMP GML GNU license Greenstone GSDL GSDLHOME GSDLOS hashfile APPENDIX B GLOSSARY OF TERMS 79 See collection configuration file main configuration file site configuration file Concurrent Versioning System a scheme for maintaining source code used throughout Greenstone Greenstone tool for viewing a GDBM database as text see GDBM A subset of the Humanities Development Library distributed with the Greenstone software and used for illustration in this tutorial Collection of digital objects text audio video along with methods for access and retrieval and for selection organ
93. s e Assigning metadata to an individual document e Assigning metadata to a folder this is inherited by all documents in the folder including those in nested folders e Assigning hierarchical metadata whose structure can be dynamically updated if required e Editing or updating assigned metadata e Reviewing the metadata assigned to a selection of files and directories For our walkthrough example in Figure 8 the user has selected the folder ecl2le and assigned EC Courier as its Organization metadata The buttons for updating and removing metadata become active depending on what selections have been made During the enrichment phase or indeed at any other time the user can choose to view all the metadata that has been assigned to documents in the collection This is done by selecting a set of documents and choosing Assigned Metadata from the metadata sets menu which brings up a popup window like that in Figure 9 that shows the metadata in spreadsheet form For large collections it is useful to be able to view the metadata associated with certain document types only and if the user has specified a file filter as mentioned above only the selected documents are shown in the metadata display The panel in Figure 10 allows the user to edit metadata sets Here the user is looking at the Subject element of the DLS set The values of this element form a hierarchy and the user is examining and perhaps changing the list of values
94. s an example to describe the different ways of finding information If you can t find the Demo collection use the Development Library instead it looks just the same First almost all icons are clickable Several icons appear at the top of almost every page Table 1 shows you what they mean Figure 1 Using the Demo collection How to find information USING GREENSTONE COLLECTIONS 7 greenstone demo Netscape File Edit View Go Window Help CRRA ea stone HOME HELP PREFERENCES search subjects titles a z organization how to Search for chapters v which contain some of the words chapters 4 section titles entire books About this collection Begin Search This is a demonstration collection for the Greenstone digital library software It contains a small subset 11 books of the Humanity Development Library How to find information There are 5 ways to find information in this collection la Document Done Li The search subjects titles a z organization how to bar underneath gives access to the searching and browsing facilities The leftmost button is for searching and the ones to the right of 1t four in this collection evoke different browsing facilities These last four may differ from one collection to another Table 2 shows the five ways to find information in the Demo collection You can search for particular words that appear in the text from the
95. s to build collections and add new material to existing ones All these facilities are accessed interactively from the menu items at the left hand side of Figure 17 Figure 17 Greenstone Administration facility GREENSTONE DIGITAL LIBRARY sore ADMINISTRATION 69 Maintenance and Administration Netscape Administration Maintenance and administration services available include e view on line logs e create maintain and update collections access technical information such as CGI arguments These services are accessed using the side navigation bar on the lefthand side of the page Collection Status Collections will only appear as running if their build cfg files exist are readable contain a valid builddate field i e gt 0 and are in the collection s index directory i e NOT the building directory click abbrev for information on a collection click collection to view a collection abbrev collection public running acrodemo acrodemo yes yes bibdemo greenstone demo yes no bylw bylw yes no cnrub cnrub no csbib Computer Science Bibliographies yes csbib old date Date yes demo greenstone demo yes dimail email plugin demo yes election The Election Collection no fao org www fao org yes fil838 FAO on the Internet 1998 yes folktale folktales language extraction demo yes forestry www fao org yes gsdidocs Greenstone Source and Documentation yes hcibib2 hcibib2 no hcibib4 HCI Bibliogrpahy 4 hemuk
96. se browsing with powerful search facilities The user can search the full text of the documents or choose between indexes built from different parts of the documents For example some collections have an index of full documents an index of sections an index of titles and an index of authors each of which can be searched for particular words or phrases Results can be ranked by relevance or sorted by a metadata element The user can browse lists of authors lists of titles lists of dates classification structures and so on Different collections may offer different browsing facilities and even within a collection a broad variety of browsing interfaces are available Browsing and searching interfaces are constructed during the building process according to collection configuration information The Greenstone software creates information collections that are very easy to maintain All searching and browsing structures are built directly from the documents themselves No links are inserted by hand but existing links in originals are maintained This means that if new documents in the same format become available they can be merged into the collection automatically Indeed for some collections this is done by processes that wake up regularly scout for new material and rebuild the indexes all without manual intervention Makes use of available metadata Plugins extend the system s capabilities Designed for multi gigabyte
97. search page This is just like the about page shown in Figure 1 except that it doesn t contain the about this collection text The search page can be reached from other pages by pressing the search button You can access publications by subject by pressing the subjects button This Table 1 What the icons at the top of each page mean enstone This takes you to the about page This takes you to the Digital Library s home page from which you can select another collection HELP This provides help text similar to what you are reading now This allows you to set some user interface and searching options that will then be used henceforth 8 USING GREENSTONE COLLECTIONS search subjects titles a z organization how to Table 2 What the icons on the search browse bar mean Search for particular words Access publications by subject Access publications by title Access publications by organization Access publications by how to listing brings up a list of subjects represented by bookshelves that can be further expanded by clicking on them You can access publications by title by pressing the titles a z button This brings up a list of books in alphabetic order You can access publications by organization by pressing the organization button This brings up a list of organizations You can access publications by how to listing by pressing the how to button This brings up a list of how t
98. sed by registered users on presentation of a password examine the composition of all collections and so on Logs of user activity can record all queries made to every Greenstone collection Collections can be updated and new ones brought on line at any time without bringing the system down the process responsible for the user interface will notice through periodic polling when new collections appear and add them to the list presented to the user The software can be used to serve collections over the World Wide Web Greenstone collections can be made available in precisely the same form on CD ROM The user interface is through a standard web browser Netscape is provided on each disk and the interaction is identical to accessing the collection on the web except that response times are more predictable The CD ROMs run under all versions of the Windows operating system A flexible process structure allows different collections to be served by different computers yet be presented to the user in the same way on the same web page as part of the same digital library Greenstone runs under both Windows 3 1 3 11 95 98 Me NT 2000 and Unix Linux and SunOS Any of these systems can be used as a webserver Collections cannot be built on low end Windows systems 3 1 3 11 but pre built collections can be transferred to them The Greenstone Digital Library is open source software available from the New Zealand Digital Library nzdl or
99. source name To change the 44 MAKING GREENSTONE COLLECTIONS Partition Indexes Define Filters Assign Partitions name select an index change its details and click Replace Index Indexes are built on particular text or metadata sources The search space can be further controlled by partitioning the index either by language or by a predetermined filter This section describes how to do this Under Design Sections click Partition Indexes The Partition Indexes view has three tabs Define Filters Assign Partitions and Assign Languages To learn more about partitions read about subcollections and subindexes in Chapter 2 of the Greenstone Developer s Guide The Partition Indexes screen is only enables in Library Systems Specialist and Expert modes see Preferences Note that the total number of partitions generated is a combination of all indexes subcollection filters and languages chosen Two indexes with two subcollection filters in two languages would yield eight index partitions Filters allow you to group together into a subcollection all documents in an index for which a metadata value matches a given pattern To create a filter click the Define Filters tab and enter a name for the new filter into the Subcollection filter name field Next choose a document attribute to match against either a metadata element or the name of the file in question Enter a regular expression to use during the matching You ca
100. specify the collection s name and associated information The second is to say where the source data is to come from The third is to adjust the configuration options a step that becomes more Collection information MAKING GREENSTONE COLLECTIONS 57 useful as you gain experience with Greenstone The fourth step is where all the computer s work is done During the building process the system makes all the indexes and gathers together any other information that 1s required to make the collection operate The fifth step is to view the collection that has been created These five steps are displayed as a linear sequence of gray buttons at the bottom of the screen in Figure 16b and at the bottom of all other pages generated by the Collector This display helps users keep track of where they are in the process The button that should be clicked to continue the sequence is shown in green collection information in Figure 16b The gray buttons all the others in Figure 16b are inactive The buttons change to yellow as you proceed through the sequence and the user can return to an earlier step by clicking the corresponding yellow button in the diagram This display 1s modeled after the wizards that are widely used in commercial software to guide users through the steps involved in installing new software The next step in the sequence collection information is shown in Figure l6c When creating a new collection it is necessary t
101. st For most other collections it 1s absent and Greenstone assigns the buckets itself If instead the user had chosen New Collection at this point she would have been asked to select what metadata sets should be used in the new collection Three standard sets are pre supplied Dublin Core the DLS metadata set mentioned above and a set that comprises metadata elements extracted automatically by Greenstone from the documents in the collection The user can also create new metadata sets using a popup panel activated through the metadata menu Several different metadata sets can be associated with the same collection the system keeps them distinct so that for example documents can have both a Dublin Core Title and a DLS Title The different sets are clearly distinguished in the interface Behind the scenes metadata sets are represented in XML Assembling the source material After clicking the OK button on the new collection popup the remaining parts of the interface which were grayed out before become active The Gather panel selected by the eponymous tab near the top of Figure 4 is displayed initially This allows the user to explore the local file space and existing collections gathering up selected documents for the new collection The panel is divided into two sections the left for MAKING GREENSTONE COLLECTIONS 21 browsing existing structures and the right for the documents in the collection Operatio
102. st of features When you select a feature there are two types of control Some features are simply enabled or disabled and this is controlled by a checkbox Others require a format string to be specified For these there is a pull down list Affected Component for selecting which part of the feature the string applies to if necessary a text area HTML Format Translate Text MAKING GREENSTONE COLLECTIONS 47 String for entering the string and a selection of predefined Variables To insert a variable into the current position in the format string select it from the pull down list and click Insert You can specify a default format for a particular component by selecting the blank feature This format is then applied to all applicable features unless otherwise specified To add a new format command fill out the information as explained above and click Add Format The new format command appears in the list of Currently Assigned Format Commands Only one format command can be assigned to each feature component combination To remove a format command select it from the list and click Remove Format To change a format command select it from the list modify the settings and click Replace Format For more information about variables and the feature components read Chapter 2 of the Greenstone Developer s Guide If the Allow Extended Options checkbox is ticked some advanced formatting options are enabled The list
103. stallation process This user can create new names and passwords for users who ADMINISTRATION 73 belong just to the colbuilder group which is the recommended way of giving other users the ability to build collections User information 1s recorded in two databases that are placed in the Greenstone file structure see the Greenstone Digital Library Developer s Guide 4 4 Technical information The links under the Technical information heading show further information on the installation The general link gives access to technical information including the directories where things are stored The protocols menu item gives for each possible protocol type information about each of the collections supported by that protocol Finally user interface code called the receptionist uses actions to communicate the wishes of the user These actions correspond to the CGI argument labeled a For example if a status the receptionist invokes the status action which displays the status page A menu item gives access to lists of all actions supported by the system and another leads to the arguments that these actions take greenstone org Accessible via web browser Full text and fielded search Flexible browsing facilities Creates access Structures automatically PLD AICI IS tc TI cc Appendix A Software features Collections are accessed through a standard web browser Netscape or Internet Explorer and combine easy to u
104. stoms of the community out of which the documents arise And there are ethical issues some things simply should not be made available to others The pen is mightier than the sword be sensitive to the power of information and use it wisely To access the Collector click the appropriate link on the digital library home page In Greenstone the structure of a particular collection is determined when the collection is set up This includes such things as the format of the source documents how they should be displayed on the screen the source of metadata what browsing facilities should be provided what full text search indexes should be provided and how the search results should be displayed Once the collection is in place it is easy to add new documents to it so long as they have the same format as the existing documents and the same type of metadata is provided in exactly the same way The Collector has the following basic functions create a new collection with the same structure as an existing one create a new collection with a different structure from existing ones add new material to an existing collection modify the structure of an existing collection delete a collection and write an existing collection to a self contained self installing CD ROM Sa tee Figure 16 shows the Collector being used to create a new collection in this case from a set of HTML files stored locally You must first decide Figure 16 Usin
105. t it from the Language Selection list and click Remove Language To set the default language select it from the list and click Set Default Cross Collection Search Greenstone can search across several different collections as though they were one This is done by specifying a list of other collections to be searched along with the current one Under Design Sections click Cross Collection Search The Cross Collection Search view shows a checklist of available collections The current collection is ticked and cannot be deselected To add another collection to be searched in parallel click it in the list click again to remove it If only one collection is selected there is no cross collection searching If the individual collections do not have the same indexes including subcollection partitions and language partitions as each other cross collection searching will not work properly The user will only be able to search using indexes common to all collections For further details see Chapter 1 of the Greenstone Developer s Guide 46 MAKING GREENSTONE COLLECTIONS Browsing Classifiers Format Features This section explains how to assign classifiers which are used for browsing to the collection Under Design Sections click Browsing Classifiers To add a classifier select it using the Select classifier to add pull down list near the bottom and then click Add Classifier A window appears entitled Confi
106. tadata always show all metadata that has been extracted automatically from documents Deselecting it hides this metadata although it is still available during collection design and within the final Greenstone collection If Show file sizes 1s checked the file size is shown next to each file in the Workspace and Collection file trees in the Gather and Enrich views The Mode panel is used to control the level of detail within the interface At its lowest setting Library Assistant the design view is disabled arguments requiring regular expressions are hidden and the collection building produces a minimal log of events In contrast the highest setting Expert provides access to all of the features of design including plugin positioning and regular expression arguments and also 50 MAKING GREENSTONE COLLECTIONS File Associations allows the full output from the collection building to be recorded in the logs To change or review modes click the radio button next to the mode you are interested in You can quickly review what mode you are in by looking at the Librarian Interface s title bar The Librarian Interface can support different workflows by determining which of the various view tabs are visible Use the Workflow tab to customise what views are available by checking the boxes next to the views that you want to be available Alternatively use the pull down list at the bottom to select predetermined configurations Closing the
107. ted to log in again and can continue from where you left off Please enter your username and password and click the button to sign in Name admin Password irren sign in laj Document Done WA whether to work with an existing collection or build a new one The former case covers options 1 and 2 above the latter covers options 3 6 In Figure 16a the user opts to create a new collection Either way it is necessary to log in before proceeding Note that in general people use their web browser to access the collection building facility on a remote computer and build the collection on that server Of course we cannot allow arbitrary people to build collections for reasons of propriety if nothing else so Greenstone contains a security system which forces people who want to build collections to log in first This allows a central system to offer a service to those wishing to build information collections and use that server to make them available to others Alternatively if you are running Greenstone on your own computer you can build collections locally but it is still necessary to log 56 MAKING GREENSTONE COLLECTIONS y Netscape Oj x Figure 16 Continued b a en Go Windom Hep RD A AAA HOME collec Creating a new collection The sequence of steps needed to create anew digital library collection is collection 1 lormaton Specify its name and associated information source a data Specify where the sou
108. the Greenstone software Other collections offer similar facilities if you can use one you can use them all The following section explains how to customize the interface for your own requirements using the Preferences page 2 1 Using a Greenstone CD ROM The Greenstone digital library software itself comes on a CD ROM and you or your system manager have probably installed it on your system following the instructions in the Greenstone Digital Library Installer s Guide If so Greenstone is already installed on your computer and you should skip the rest of this section Some Greenstone collections come on a self contained Greenstone CD ROM that includes enough of the software to run just that collection To use it simply put it into the CD ROM drive on any Windows PC Most likely if autorun is enabled on your PC a window will appear inviting you to install the Greenstone software If not find the CD ROM disk drive on current Windows systems you can get this by clicking on the My Computer icon on the desktop and double click it then the Setup exe file inside it The Greenstone Setup program will be entered which guides 6 USING GREENSTONE COLLECTIONS you through the setup procedure Most people respond yes to all the questions When the installation procedure has finished you ll find the library in the Programs submenu of the Windows Start menu under the name of the collection for example Development Library or
109. tion file main cfg The gsdlsite cfg file is used to configure the Greenstone software for the site where it is installed It is designed for keeping configuration options that are particular to a given site Examples include the name of the directory where the Greenstone software is kept the HTTP address of the Greenstone system and whether the fastcgi facility is being used The entries in this file are described in the Greenstone Digital Library Installation Guide The main cfg file contains information that is common to the interface of all collections served by a Greenstone site It includes the E mail address of the system maintainer whether the status and collector pages are enabled whether logs of user activity are kept and whether Internet cookies are used to identify users Three kinds of logs can be examined usage logs error logs and initialization logs The last two are only really of interest to people maintaining the software All user activity every page that each user visits can be recorded by the Greenstone software though no personal names are included in the logs Logging disabled by default is enabled by including the lines logcgiargs true usecookies true in the main system configuration file Both options are false by default so that no logging is done unless they are set It is the ogcgiargs line that actually turns logging on and off By activating usecookies a unique identification code is assi
110. ttached metadata This section 34 MAKING GREENSTONE COLLECTIONS The Gather View describes how to import files This section introduces the Gather area that you use to select what files to include in the collection you are building The Librarian Interface starts with the Gather view To return to this view later click the Gather tab directly below the menu bar The two large areas titled Workspace and Collection are used to move files into your collection They contain file trees graphical structures that represent files and folders Select an item in the tree by clicking it There are other ways see below Double click a folder or single click the switch symbol beside it to expand or collapse its contents Double click a file to open it using its associated application program see File Associations The Workspace file tree shows the sources of data available to the Librarian Interface the local file system including disk and CD ROM drives the contents of existing Greenstone collections and the cache of downloaded files You can copy and view these files but you cannot move delete or edit them with the exception of the downloaded files which can be deleted Navigate this space to find the files you want to include in the collection The Collection file tree represents the contents of the collection so far Initially it is empty You can resize the spaces by mousing over the grey bar that separates the t
111. uter s file space including existing collections into the new collection Any existing metadata remains attached to these documents Documents may also be gathered from the web through a built in mirroring facility 2 Enrich the documents by adding further metadata to individual documents or groups of documents 3 Design the collection by determining its appearance and the access facilities that it will support 4 Build the collection using Greenstone 5 Preview the newly created collection which will have been installed on your Greenstone home page as one of the regular collections The librarian interface allows you to add what people call external metadata to documents metadata that pertains to the document as a whole But documents often need to be structured into sections and subsections and internal metadata might be associated with each part In Greenstone source documents can be tagged with this information and we explain this in Section 3 3 Finally an alternative way of building collections is provided by the Collector which helps you create new collections modify or add to existing ones or delete collections It predates the librarian interface and for most practical purposes the librarian interface should be used instead of the Collector It is described in Section 3 4 18 MAKING GREENSTONE COLLECTIONS To harness the full power of Greenstone to build advanced collections you will also need to

Download Pdf Manuals

Related Search

Related Contents

TR3Check2003 取扱説明書  1. Don`t forget to charge the printer ! 2. Settings 3. Cable connection  取扱説明書  ユーザーガイドで機能をチェック（PDF）  LANKOPRIMER 749  7_Salud - WordPress.com  X-shooter User Manual  KVH Azimuth Sailcomp 103ac 2nd Dis 02 0407 103ac Additional Disp  BT Diverse 7460 User Guide - Home  

Copyright © All rights reserved. Failed to retrieve file