Home

WEKA Explorer User Guide for Version 3-5-5

1. The number of instances data points records in the data 3 Attributes The number of attributes features in the data 3 3 Working With Attributes Below the Current relation box is a box titled Attributes There are four buttons and beneath them is a list of the attributes in the current relation The list has three columns 1 No A number that identifies the attribute in the order they are specified in the data file 2 Selection tick boxes These allow you select which attributes are present in the relation 3 Name The name of the attribute as it was declared in the data file When you click on different rows in the list of attributes the fields change in the box to the right titled Selected attribute This box displays the char acteristics of the currently highlighted attribute in the list 1 Name The name of the attribute the same as that given in the attribute list 2 Type The type of attribute most commonly Nominal or Numeric 3 Missing The number and percentage of instances in the data for which this attribute is missing unspecified 4 Distinct The number of different values that the data contains for this attribute 5 Unique The number and percentage of instances in the data having a value for this attribute that no other instances have Below these statistics is a list showing more information about the values stored in this attribute which differ depending on its type If the attribut
2. Help Online resources for WEKA can be found here Weka homepage Opens a browser window with WEKA s home page Online documentation Directs to the WekaDoc Wiki 4 HOWTOs code snippets etc The general WekaWiki 3 con taining lots of examples and HOWTOs around the development and use of WEKA Weka on Sourceforge WEKA s project homepage on Sourceforge net SystemInfo Lists some internals about the Java WEKA environ ment e g the CLASSPATH About The infamous About box If you launch WEKA from a terminal window some text begins scrolling in the terminal Ignore this text unless something goes wrong in which case it can help in tracking down the cause the LogWindow displays that information as well This User Manual which is also available online on the WekaDoc Wiki 4 focuses on using the Explorer but does not explain the individual data pre processing tools and learning algorithms in WEKA For more information on the various filters and learning methods in WEKA see the book Data Mining 2 2 The WEKA Explorer 2 1 Section Tabs At the very top of the window just below the title bar is a row of tabs When the Explorer is first started only the first tab is active the others are greyed out This is because it is necessary to open and potentially pre process a data set before starting to explore the data The tabs are as follows 1 Preprocess Choose and modify the data being acted on 2 C
3. Selection o Visualizing 8 1 The scatter plot matrix o e 8 2 Selecting an individual 2D scatter plot 8 3 Selecting Instances o ee ee N or PR Oo Doo 10 10 11 11 11 12 14 14 14 14 15 16 16 16 17 17 17 17 1 Launching WEKA The new menu driven GUI in WEKA class weka gui Main succeeds the old GUI Chooser class weka gui GUIChooser Its MDI multiple document in terface appearance makes it easier to keep track of all the open windows IE lolx Program Applications Tools Visualization Help WEKA The University j of Waikato The menu consists of six sections 1 Program e LogWindow Opens a log window that captures all that is printed to stdout or stderr Useful for environments like MS Windows where WEKA is not started from a terminal e Exit Closes WEKA 2 Applications Lists the main applications within WEKA e Explorer An environment for exploring data with WEKA the rest of this documentation deals with this application in more detail e Experimenter An environment for performing experiments and conducting statistical tests between learning schemes e KnowledgeFlow This environment supports essentially the same functions as the Explorer but with a drag and drop interface One advantage is that it supports incremental learning e SimpleCLI Provides a simple command line interface that allows direct execut
4. cost curve Generates a plot that gives an explicit represen tation of the expected cost as described by 1 12 Plugins This menu item only appears if there are Explorer visualization plugins available by default none More about these plugins can be found on the WekaWiki 3 Options are greyed out if they do not apply to the specific set of results 13 5 Clustering Weka 3 5 4 Explorer Program Applications Tools Visualization Windows Help Explorer Preprocess Classify Cluster Associate Select attributes Visualize Clusterer Choose Jem 100 N 1 M 1 0E 6 S 100 Cluster mode Clusterer output ATTLIDUCE MUNIarTy Discrete Estimator Counts 8 8 Total 16 Supplied test set et Attribute windy Discrete Estimator Counts 79 Total 16 Clustered Instances Use training set Percentage split 8 Classes to clusters evaluation Nom play zj v Store clusters for visualization 0 14 100 Log likelihood 3 54934 Ignore attributes Class attribute play Classes to Clusters Start Result list right click for options MECA 0 lt assigned to cluster 9 yes 5 no Cluster 0 lt yes Incorrectly clustered instances 5 1 Selecting a Clusterer By now you will be familiar with the process of selecting and configuring objects Clicking on the clustering scheme listed in the Clusterer box at the top of the wi
5. the Preprocess panel 3 4 Working With Filters Program Applications Tools Visualization Windows Help Explorer Preprocess Classify Cluster Associate Select attributes Visualize Open file Open URL Open DB Generate Filter Ever 2 KTM cS fiters eh dE E AlFilter D MultiFitter Selected attribute Name outlook Type Nominal Missing 0 0 Distinct 3 Unique 0 0 Fil superisad A Count Cf unsupervised Sunny 5 9 C attribute Pattern overcast 4 Dy ada rany 15 D Adacluster D Addexpression O Adao D AdaNoise Addvalues class play Nom Visualize All D center E ChangeDateFormat 5 y classAssigner O ClusterMembership Copy Discretize D Firstorder Bitter jl Removefilter Close The preprocess section allows filters to be defined that transform the data in various ways The Filter box is used to set up the filters that are required At the left of the Filter box is a Choose button By clicking this button it is possible to select one of the filters in WEKA Once a filter has been selected its name and options are shown in the field next to the Choose button Clicking on this box with the left mouse button brings up a GenericObjectEditor dialog box A click with the right mouse button or Alt Shift left click brings up a menu where you can choose either to display the propert
6. well as the setup for running regular attribute selection 18 8 Visualizing Weka 3 5 4 Explorer Program Applications Tools Visualization Windows Help Preprocess Classify Cluster Associate Select attributes Visualize Plot Matrix outlook temperature humidity windy humidity PlotSize 1007 J Update PointSize 3 3 Jitter Select Attributes Colour play Nom SubSample 100 Jl Class Colour WEKA s visualization section allows you to visualize 2D plots of the current relation 8 1 The scatter plot matrix When you select the Visualize panel it shows a scatter plot matrix for all the attributes colour coded according to the currently selected class It is possible to change the size of each individual 2D plot and the point size and to randomly jitter the data to uncover obscured points It also possible to change the attribute used to colour the plots to select only a subset of attributes for inclusion in the scatter plot matrix and to sub sample the data Note that changes will only come into effect once the Update button has been pressed 8 2 Selecting an individual 2D scatter plot When you click on a cell in the scatter plot matrix this will bring up a separate window with a visualization of the scatter plot you selected We descr
7. THE UNIVERSITY OF WAIKATO Te Whare Wananga o Waikato WEKA Explorer User Guide for Version 3 5 5 Richard Kirkby Eibe Frank Peter Reutemann January 26 2007 2002 2006 University of Waikato Contents 1 2 Launching WEKA The WEKA Explorer 2 1 ection Tabs si e oe 2 fed a el a eek BS Ge hee ee Ge 232 Status Box cia a bh A a Ale eee week we Bd 2 3 Los Button s e 629 Bot ered dg ae ek hs a le ee a a 2 4 WEKA StatusIcon 2 2 0 20 0000022 eee ee Preprocessing Sel Loading Data coi a a eee ot de i te Be a 3 2 The Current Relation 3 3 Working With Attributes oce ss rerio raa aer e rai 3 4 Working With Filters a s a os aag oere a E E S e Classification 4 1 Selecting a Classifier o oo a 420 TeSt Options wi 262 3 4 ne ns GA BG ey at a 4 3 The Class Attribute e e 4 4 Training a Classifier o 4 5 The Classifier Output Text o 4 6 The Result List s e oi art ser ooe a a a e e o Clustering 5 1 Selecting a Clusterer aaa 5 2 Cluster Modes soue iS hoe Yate We a 5 3 Ignoring Attributes a a 0020002000 5 4 Learning Clusters 2 0 2 02 eee ee eee Associating 6 1 Setting Ups ss A ERAS EES OE MEU N 6 2 Learning Associations 0 000000 eee Selecting Attributes 7 1 Searching and Evaluating e Zo Options ef Sah Ge ya OR BREE A A 7 3 Performing
8. bering any changes that have been made Once you are happy with the object and settings you have chosen click OK to return to the main Explorer window Applying Filters Once you have selected and configured a filter you can apply it to the data by pressing the Apply button at the right end of the Filter panel in the Preprocess panel The Preprocess panel will then show the transformed data The change can be undone by pressing the Undo button You can also use the Edit button to modify your data manually in a dataset editor Finally the Save button at the top right of the Preprocess panel saves the current version of the relation in file formats that can represent the relation allowing it to be kept for future use Note Some of the filters behave differently depending on whether a class at tribute has been set or not using the box above the histogram which will bring up a drop down list of possible selections when clicked In particular the supervised filters require a class attribute to be set and some of the unsu pervised attribute filters will skip the class attribute if one is set Note that it is also possible to set Class to None in which case no class is set 4 Classification gt weka 3 5 4 Explorer Program Applications Tools Visualization Windows Help Explorer Preprocess Classify Cluster Associate Selectattributes Visualize Classifier Choose ua8 00 25 42 Test
9. e classifier is busy being trained the little bird moves around You can stop the training process at any time by clicking on the Stop button When training is complete several things happen The Classifier output area to the right of the display is filled with text describing the results of training and testing A new entry appears in the Result list box We look at the result list below but first we investigate the text that has been output 4 5 The Classifier Output Text The text in the Classifier output area has scroll bars allowing you to browse the results Clicking with the left mouse button into the text area while holding 11 Alt and Shift brings up a dialog that enables you to save the displayed output in a variety of formats currently JPEG and EPS Of course you can also resize the Explorer window to get a larger display area The output is split into several sections 1 4 6 Run information A list of information giving the learning scheme op tions relation name instances attributes and test mode that were in volved in the process Classifier model full training set A textual representation of the classification model that was produced on the full training data The results of the chosen test mode are broken down thus Summary A list of statistics summarizing how accurately the classifier was able to predict the true class of the instances under the chosen test mode Detailed Accuracy By Class A
10. e classify panel It is also possible to Visualize 17 reduced data or if you have used an attribute transformer such as Principal Components Visualize transformed data The reduced transformed data can be saved to a file with the Save reduced data or Save transformed data option In case one wants to reduce transform a training and a test at the same time and not use the AttributeSelectedClassifier from the classifier panel it is best to use the AttributeSelection filter a supervised attribute filter in batch mode b from the command line or in the SimpleCLI The batch mode allows one to specify an additional input and output file pair options r and s that is processed with the filter setup that was determined based on the training data specified by options i and o Here is an example for a Unix Linux bash java weka filters supervised attribute AttributeSelection E weka attributeSelection CfsSubsetEval S weka attributeSelection BestFirst D 1 N 5 b i lt inputi arff gt o lt outputi arff gt r lt input2 arff gt s lt output2 arff gt Notes e The backslashes at the end of each line tell the bash that the command is not finished yet Using the SimpleCLI one has to use this command in one line without the backslashes e It is assumed that WEKA is available in the CLASSPATH otherwise one has to use the classpath option e The full filter setup is output in the log as
11. e is nominal the list consists of each possible value for the attribute along with the number of instances that have that value If the attribute is numeric the list gives four statistics describing the distribution of values in the data the minimum maximum mean and standard deviation And below these statistics there is a coloured histogram colour coded according to the attribute chosen as the Class using the box above the histogram This box will bring up a drop down list of available selections when clicked Note that only nominal Class attributes will result in a colour coding Finally after pressing the Visualize All button histograms for all the attributes in the data are shown in a separate window Returning to the attribute list to begin with all the tick boxes are unticked They can be toggled on off by clicking on them individually The four buttons above can also be used to change the selection 1 All All boxes are ticked 2 None All boxes are cleared unticked 3 Invert Boxes that are ticked become unticked and vice versa 4 Pattern Enables the user to select attributes based on a Perl 5 Regular Expression E g _id selects all attributes which name ends with _id Once the desired attributes have been selected they can be removed by clicking the Remove button below the list of attributes Note that this can be undone by clicking the Undo button which is located next to the Edit button in the top right corner of
12. elcome to the Weka Explorer 3 1 Loading Data The first four buttons at the top of the preprocess section enable you to load data into WEKA 1 Open file Brings up a dialog box allowing you to browse for the data file on the local file system 2 Open URL Asks for a Uniform Resource Locator address for where the data is stored 3 Open DB Reads data from a database Note that to make this work you might have to edit the file in weka experiment DatabaseUtils props 4 Generate Enables you to generate artificial data from a variety of DataGenerators Using the Open file button you can read files in a variety of formats WEKA s ARFF format CSV format C4 5 format or serialized Instances for mat ARFF files typically have a arff extension CSV files a csv extension C4 5 files a data and names extension and serialized Instances objects a bsi extension NB This list of formats can be extended by adding custom file converters to the weka core converters package 3 2 The Current Relation Once some data has been loaded the Preprocess panel shows a variety of in formation The Current relation box the current relation is the currently loaded data which can be interpreted as a single relational table in database terminology has three entries 1 Relation The name of the relation as given in the file it was loaded from Filters described below modify the name of a relation 2 Instances
13. g is invoked the selected attributes are ignored 14 5 4 Learning Clusters The Cluster section like the Classify section has Start Stop buttons a result text area and a result list These all behave just like their classifica tion counterparts Right clicking an entry in the result list brings up a similar menu except that it shows only two visualization options Visualize cluster assignments and Visualize tree The latter is grayed out when it is not applicable 15 6 Associating Weka 3 5 4 Explorer Program Applications Tools Visualization Windows Help E Explorer Preprocess Classify Cluster Associate Select attributes Visualize Associator Choose Apriori N 10 T 0 C 0 9 D 0 05 U 1 0 M 0 1 S 1 0 c 1 Associator output Start Stop Result list right click fc Size of set of large itemsets L 1 115 10 49 lt nebo Size of set of large itemsets L 2 Size of set of large itemsets L 3 Size of set of large itemsets L 4 Best rules found outlook overcast 4 gt play yes 4 conf 1 temperature cool 4 gt humidity normal 4 conf 1 hunidity normal windy FALSE 4 gt play yes 4 conf 1 outlook sunny play no 3 gt humidity high 3 conf 1 outlook sunny hunidity high 3 gt play no 3 conf 1 outlook rainy play yes 3 gt windy FALSE 3 conf 1 outlook rainy vindy FALSE 3 gt play yes 3 conf 1 temperature cool p
14. ibed above how to visualize particular results in a separate window for example classifier errors the same visualization controls are used here Data points are plotted in the main area of the window At the top are two drop down list buttons for selecting the axes to plot The one on the left shows which attribute is used for the x axis the one on the right shows which is used for the y axis Beneath the x axis selector is a drop down list for choosing the colour scheme This allows you to colour the points based on the attribute selected Below the plot area a legend describes what values the colours correspond to If the values are discrete you can modify the colour used for each one by clicking on them and making an appropriate selection in the window that pops up To the right of the plot area is a series of horizontal strips Each strip represents an attribute and the dots within it show the distribution of values 19 of the attribute These values are randomly scattered vertically to help you see concentrations of points You can choose what axes are used in the main graph by clicking on these strips Left clicking an attribute strip changes the x axis to that attribute whereas right clicking changes the y axis The X and Y written beside the strips shows what the current axes are B is used for both X and Y Above the attribute strips is a slider labelled Jitter which is a random displacement given to a
15. ies in a GenericObjectEditor dialog box or to copy the current setup string to the clipboard The GenericObjectEditor Dialog Box The GenericObjectEditor dialog box lets you configure a filter The same kind of dialog box is used to configure other objects such as classifiers and clusterers see below The fields in the window reflect the available options Clicking on any of these gives an opportunity to alter the filters settings For example the setting may take a text string in which case you type the string into the text field provided Or it may give a drop down box listing several states to choose from Or it may do something else depending on the information required Information on the options is provided in a tool tip if you let the mouse pointer hover of the corresponding field More information on the filter and its options can be obtained by clicking on the More button in the About panel at the top of the GenericObjectEditor window Some objects display a brief description of what they do in an About box along with a More button Clicking on the More button brings up a window describing what the different options do Others have an additional button Capabilities which lists the types of attributes and classes the object can handle At the bottom of the GenericObjectEditor dialog are four buttons The first two Open and Save allow object configurations to be stored for future use The Cancel button backs out without remem
16. ion matrix The confusion matrix of the classifier s pre dictions is included in the output This option is selected by default 5 Store predictions for visualization The classifier s predictions are remembered so that they can be visualized This option is selected by default 6 Output predictions The predictions on the evaluation data are output Note that in the case of a cross validation the instance numbers do not correspond to the location in the data 7 Cost sensitive evaluation The errors is evaluated with respect to a cost matrix The Set button allows you to specify the cost matrix used 8 Random seed for xval Split This specifies the random seed used when randomizing the data before it is divided up for evaluation purposes 4 3 The Class Attribute The classifiers in WEKA are designed to be trained to predict a single class attribute which is the target for prediction Some classifiers can only learn nominal classes others can only learn numeric classes regression problems still others can learn both By default the class is taken to be the last attribute in the data If you want to train a classifier to predict a different attribute click on the box below the Test options box to bring up a drop down list of attributes to choose from 4 4 Training a Classifier Once the classifier test options and class have all been set the learning process is started by clicking on the Start button While th
17. ion of WEKA commands for operating systems that do not provide their own command line interface 3 Tools Other useful applications e ArffViewer An MDI application for viewing ARFF files in spreadsheet format e SqlViewer represents an SQL worksheet for querying databases via JDBC e EnsembleLibrary An interface for generating setups for Ensem ble Selection 5 4 Visualization Ways of visualizing data with WEKA e Plot For plotting a 2D plot of a dataset e ROC Displays a previously saved ROC curve Program Applicatio LogWindow Exit Explorer Experimenter KnowledgeFlow SimpleCLI ns Tools Visualization Arffviewer SqMewer EnsembleLibrary SES ols Visualization Help Plot Roc TreeVisualizer GraphVisualizer Boundaryvisualizer ion Windows Help Minimize Restore SimpleCLI KnowledgeFlow Explorer SqlViewer Arffviewer Mo ion Help Weka homepage Online documentation HOWTOs code snippets etc Weka on SourceForge Systeminfo About TreeVisualizer For displaying directed graphs e g a decision tree GraphVisualizer Visualizes XML BIF or DOT format graphs e g for Bayesian networks Boundary Visualizer Allows the visualization of classifier deci sion boundaries in two dimensions 5 Windows All open windows are listed here Minimize Minimizes all current windows Restore Restores all minimized windows again 6
18. lass nominal 5 play CFS Subset Evaluator Including locally predictive attributes Selected attributes 1 3 2 outlook humidity 7 1 Searching and Evaluating Attribute selection involves searching through all possible combinations of at tributes in the data to find which subset of attributes works best for prediction To do this two objects must be set up an attribute evaluator and a search method The evaluator determines what method is used to assign a worth to each subset of attributes The search method determines what style of search is performed 7 2 Options The Attribute Selection Mode box has two options 1 Use full training set The worth of the attribute subset is determined using the full set of training data 2 Cross validation The worth of the attribute subset is determined by a process of cross validation The Fold and Seed fields set the number of folds to use and the random seed used when shuffling the data As with Classify Section 4 1 there is a drop down box that can be used to specify which attribute to treat as the class 7 3 Performing Selection Clicking Start starts running the attribute selection process When it is fin ished the results are output into the result area and an entry is added to the result list Right clicking on the result list gives several options The first three View in main window View in separate window and Save result buffer are the same as for th
19. lassify Train and test learning schemes that classify or perform regres sion Cluster Learn clusters for the data Associate Learn association rules for the data Select attributes Select the most relevant attributes in the data De EA Visualize View an interactive 2D plot of the data Once the tabs are active clicking on them flicks between different screens on which the respective actions can be performed The bottom area of the window including the status box the log button and the Weka bird stays visible regardless of which section you are in 2 2 Status Box The status box appears at the very bottom of the window It displays messages that keep you informed about what s going on For example if the Explorer is busy loading a file the status box will say that TIP ight clicking the mouse anywhere inside the status box brings up a little menu The menu gives two options 1 Memory information Display in the log box the amount of memory available to WEKA 2 Run garbage collector Force the Java garbage collector to search for memory that is no longer needed and free it up allowing more memory for new tasks Note that the garbage collector is constantly running as a background task anyway 2 3 Log Button Clicking on this button brings up a separate window containing a scrollable text field Each line of text is stamped with the time it was entered into the log As you perform actions in WEKA the log keeps a
20. lay yes 3 gt humidity normal 3 conf 1 outlook sunny temperature hot 2 gt humidity high 2 conf 1 temperature hot play no 2 gt outlook sunny 2 conf 1 6 1 Setting Up This panel contains schemes for learning association rules and the learners are chosen and configured in the same way as the clusterers filters and classifiers in the other panels 6 2 Learning Associations Once appropriate parameters for the association rule learner bave been set click the Start button When complete right clicking on an entry in the result list allows the results to be viewed or saved 16 7 Selecting Attributes Weka 3 5 4 Explorer Program Applications Tools Visualization Windows Help E Explorer Preprocess Classify Cluster Associate Select attributes Visualize Attribute Evaluator Choose _ CfsSubsetEval Search Method Choose BestFirst D1 N5 Attribute Selection Mode Attribute selection output Use full training set oral man Falda Attribute Selection on all input data Search Method Best first Nom play Start set no attributes Search direction forward Stale search after 5 node expansions i 5 m Total number of subsets evaluated 11 Result list right click for options Merit of best subset found 0 247 15 17 28 BestFirst CfsSubsetEval Js Attribute Subset Evaluator supervised C
21. ll points in the plot Dragging it to the right increases the amount of jitter which is useful for spotting concentrations of points Without jitter a million instances at the same point would look no different to just a single lonely instance 8 3 Selecting Instances There may be situations where it is helpful to select a subset of the data us ing the visualization tool A special case of this is the UserClassifier in the Classify panel which lets you build your own classifier by interactively selecting instances Below the y axis selector button is a drop down list button for choosing a selection method A group of data points can be selected in four ways 1 Select Instance Clicking on an individual data point brings up a window listing its attributes If more than one point appears at the same location more than one set of attributes is shown 2 Rectangle You can create a rectangle by dragging that selects the points inside it 3 Polygon You can build a free form polygon that selects the points inside it Left click to add vertices to the polygon right click to complete it The polygon will always be closed off by connecting the first point to the last 4 Polyline You can build a polyline that distinguishes the points on one side from those on the other Left click to add vertices to the polyline right click to finish The resulting shape is open as opposed to a polygon which is always closed Once an area of the
22. more detailed per class break down of the classifier s prediction accuracy Confusion Matrix Shows how many instances have been assigned to each class Elements show the number of test examples whose actual class is the row and whose predicted class is the column The Result List After training several classifiers the result list will contain several entries Left clicking the entries flicks back and forth between the various results that have been generated Pressing Delete removes a selected entry from the results Right clicking an entry invokes a menu containing these items 1 View in main window Shows the output in the main window just like left clicking the entry View in separate window Opens a new independent window for view ing the results Save result buffer Brings up a dialog allowing you to save a text file containing the textual output Load model Loads a pre trained model object from a binary file Save model Saves a model object to a binary file Objects are saved in Java serialized object form Re evaluate model on current test set Takes the model that has been built and tests its performance on the data set that has been specified with the Set button under the Supplied test set option Visualize classifier errors Brings up a visualization window that plots the results of classification Correctly classified instances are represented by crosses whereas incorrectly classified ones show
23. ndow brings up a GenericObjectEditor dialog with which to choose a new clustering scheme 5 2 Cluster Modes The Cluster mode box is used to choose what to cluster and how to evaluate the results The first three options are the same as for classification Use training set Supplied test set and Percentage split Section 4 1 except that now the data is assigned to clusters instead of trying to predict a specific class The fourth mode Classes to clusters evaluation compares how well the chosen clusters match up with a pre assigned class in the data The drop down box below this option selects the class just as in the Classify panel An additional option in the Cluster mode box the Store clusters for visualization tick box determines whether or not it will be possible to visualize the clusters once training is complete When dealing with datasets that are so large that memory becomes a problem it may be helpful to disable this option 5 3 Ignoring Attributes Often some attributes in the data should be ignored when clustering The Ignore attributes button brings up a small window that allows you to select which attributes are ignored Clicking on an attribute in the window highlights it holding down the SHIFT key selects a range of consecutive attributes and holding down CTRL toggles individual attributes on and off To cancel the selection back out with the Cancel button To activate it click the Select button The next time clusterin
24. options Classifier output lt summary Use training set Supplied test set Set Correctly Classified Instances Incorrectly Classified Instances 8 Cross validation Folds 10 xappa statistic Percentage split 3 Mean absolute error Root mean squared error More options Relative absolute error Root relative squared error w Total Number of Instances Nom play izj Detailed Accuracy By Class Result list right click for options TP Rate FP Rate Precision Recall F Measure ROC Area Class 15 15 03 trees J48 0 556 0 6 0 625 0 556 0 588 0 633 yes 0 4 0 444 0 333 0 4 0 364 0 633 no Confusion Matrix ab lt classified as 541 a yes 32 1b n0 4 1 Selecting a Classifier At the top of the classify section is the Classifier box This box has a text field that gives the name of the currently selected classifier and its options Clicking on the text box with the left mouse button brings up a GenericObjectEditor dialog box just the same as for filters that you can use to configure the options of the current classifier With a right click or Alt Shift left click you can once again copy the setup string to the clipboard or display the properties in a GenericObjectEditor dialog box The Choose button allows you to choose one of the classifiers that are available in WEKA 4 2 Test Options The result of applying the chosen classifie
25. plot has been selected using Rectangle Polygon or Polyline it turns grey At this point clicking the Submit button removes all instances from the plot except those within the grey selection area Clicking on the Clear button erases the selected area without affecting the graph Once any points have been removed from the graph the Submit button changes to a Reset button This button undoes all previous removals and returns you to the original graph with all points included Finally clicking the Save button allows you to save the currently visible instances to a new ARFF file 20 References 1 Drummond C and Holte R 2000 Explicitly representing expected cost An alternative to ROC representation Proceedings of the Sixth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining Publishers San Mateo CA 2 Witten I H and Frank E 2005 Data Mining Practical machine learn ing tools and techniques 2nd edition Morgan Kaufmann San Francisco 3 Weka Wiki http weka sourceforge net wiki 4 WekaDoc http weka sourceforge net wekadoc 5 Ensemble Selection on WekaDoc http weka sourceforge net wekadoc index php en Ensemble_Selection 21
26. r will be tested according to the options that are set by clicking in the Test options box There are four test modes 1 Use training set The classifier is evaluated on how well it predicts the class of the instances it was trained on 2 Supplied test set The classifier is evaluated on how well it predicts the class of a set of instances loaded from a file Clicking the Set button brings up a dialog allowing you to choose the file to test on 3 Cross validation The classifier is evaluated by cross validation using the number of folds that are entered in the Folds text field 4 Percentage split The classifier is evaluated on how well it predicts a certain percentage of the data which is held out for testing The amount of data held out depends on the value entered in the field Note No matter which evaluation method is used the model that is output is always the one build from all the training data Further testing options can be set by clicking on the More options button 10 1 Output model The classification model on the full training set is output so that it can be viewed visualized etc This option is selected by default 2 Output per class stats The precision recall and true false statistics for each class are output This option is also selected by default 3 Output entropy evaluation measures Entropy evaluation measures are included in the output This option is not selected by default 4 Output confus
27. record of what has happened For people using the command line or the SimpleCLI the log now also contains the full setup strings for classification clustering attribute selection etc so that it is possible to copy paste them elsewhere Options for dataset s and if applicable the class attribute still have to be provided by the user e g t for classifiers or i and o for filters 2 4 WEKA Status Icon To the right of the status box is the WEKA status icon When no processes are running the bird sits down and takes a nap The number beside the x symbol gives the number of concurrent processes running When the system is idle it is zero but it increases as the number of processes increases When any process is started the bird gets up and starts moving around If it s standing but stops moving for a long time it s sick something has gone wrong In that case you should restart the WEKA Explorer 3 Preprocessing Weka 3 5 4 Explorer Program Applications Tools Visualization Windows Help E Explorer Preprocess Classify Cluster Associate Select attributes Visualize Open file il Open URL Open DB lI Generate Undo Filter Choose None Apply Current relation Selected attribute Relation None Name None Type None Instances None Attributes None Missing None Distinct None Unique None Attributes Remove Status W
28. up as squares 12 8 Visualize tree or Visualize graph Brings up a graphical representation of the structure of the classifier model if possible i e for decision trees or Bayesian networks The graph visualization option only appears if a Bayesian network classifier has been built In the tree visualizer you can bring up a menu by right clicking a blank area pan around by dragging the mouse and see the training instances at each node by clicking on it CTRL clicking zooms the view out while SHIFT dragging a box zooms the view in The graph visualizer should be self explanatory 9 Visualize margin curve Generates a plot illustrating the prediction margin The margin is defined as the difference between the probability predicted for the actual class and the highest probability predicted for the other classes For example boosting algorithms may achieve better performance on test data by increasing the margins on the training data 10 Visualize threshold curve Generates a plot illustrating the trade offs in prediction that are obtained by varying the threshold value between classes For example with the default threshold value of 0 5 the pre dicted probability of positive must be greater than 0 5 for the instance to be predicted as positive The plot can be used to visualize the pre cision recall trade off for ROC curve analysis true positive rate vs false positive rate and for other types of curves 11 Visualize

WEKA Explorer User Guide for Version 3-5-5

Contents

Download Pdf Manuals

Related Search

Related Contents