Home
Jumpshot-4's User's Guide - tp.mcs.anl.gov
Contents
1. p ME 10 0 0060565 16 440893086 216 756850685 7 0728079325 477 634607 10012869 E u E TimeLines a 216 45 216 50 216 55 216 60 216 65 216 70 216 75 216 80 216 85 216 90 216 95 217 00 217 Time tseconds Figure 2 9 The CumulativeExclusionRatio view of Figure Also a zoom in shot of Figure 15 Chapter 3 Graphical User Interface 3 1 Main Window Jumpshot 4 File Edit View Help LogName ViewMap ala 5 8 E BO Figure 3 1 The main control window of Jumpshot 4 The first window that pops up when invoking Jumpshot 4 is called Main window as shown in Figure The buttons shown in toolbar are shortcuts to the sub menu items in the top menubar The function of each of these buttons is listed in the Table 3 2 There are 2 text fields that display crucial information about the logfile being processed The text field which is titled LogName displays the pathname of the logfile being processed The pulldown menu which is titled ViewMap lists all the available ViewMaps in the SLOG 2 file Currently both CLOG and RLOG converted SLOG 2 file contains one ViewMaps it is called the Identity Map Only IBM s UTE trace converted SLOG 2 file contains multiple ViewMaps 3 2 Logfile Convertor Window If a non slog2 file is selected in the Main window the Logfile Convertor as shown in Figure 3 2 will be invoked to pro
2. 3 6 PREFERENCE WINDOW Parameter Values Description Y_AXIS_ROOT_VISIBLE true false Whether to show the top of the Y axis tree styled directory label ACTIVE_REFRESH false Whether to let Jumpshot 4 actively update the timeline canvas BACKGROUND COLOR Black Background color of the timeline canvas DarkGray Gray LightGray White STATE HEIGHT FACTOR 0 0 1 0 Ratio of the outermost rectangle height to row height The larger the factor is the larger the outermost rectangle will be with respect to the row height NESTING HEIGHT FACTOR 0 0 1 0 The gap ratio between successive nesting rectan gles The larger the factor is the smaller the gap will be ARROW_ANTIALIASING default on off Whether to draw arrow with anti aliasing lines Turning this on will slow down the canvas drawing by a factor of 3 MIN_WIDTH_TO_DRAG integer Minimum width in pixel to be considered a dragged operation CLICK_RADIUS_TO_LINE ve integer Radius in pixel for a click to be considered on the arrow LEFTCLICK INSTANT ZOOM true false Whether to zoom in immediately after left mouse click on canvas Table 3 16 Parameters for the section of All Zoomable Windows in Preference window 43 CHAPTER 3 GRAPHICAL USER INTERFACE 3 6 PREFERENCE WINDOW Parameter Values Description STATE BORDER ColorRaised Border style of real states ColorLowered White
3. Histogram for the duration 0 6446801 476 98386 SIX A tins 4 Zoom Level Global Min Time View Init Time Zoom Focus Time View Final Time Global Max Time Time Per Pixel yn 4 2 looo i 103 4345567049 107 6874903786 476 3391903025 0 1604880632 Q h Statistics Cumulati SS PP A E Summary Info Box m E Summary Arrow Between LinelD 4 and LinelD 3 Averaged Number of Real Drawables 7570 0 Inclusive Duration Ratio legend message ratio 0 14288089 iw 00 10 00 20 00 30 00 40 00 50 00 60 00 70 00 80 00 90 00 100 00 Duration seconds Figure 3 26 Arrow Summary Info Box of Figure Right mouse clicking at the summary arrow will display a Summary Info Box for the arrow as in the 40 CHAPTER 3 GRAPHICAL USER INTERFACE 3 6 PREFERENCE WINDOW Figure The info box lists the total number of real arrows and the ratio of the total duration of all real arrows to the duration of canvas Together with the info box summary arrow provides a way to tell which ordered pair of timelines communicates the most 3 6 Preference Window Preferences LEFTCLICK INSTANT Z00M Timeline zoomable window STATE BORDER ColorRaised v ARROW HEAD LENGTH 10 ARROW HEAD HALF WIDTH 3 PREVIEM STATE DISPLAY CumulativeExclusionRatio v PREVIEW STATE BORDER ColorRaised v PREVIEW STATE BORDER Wy PREVI PELE PREV PELOS
4. 3 43 Y axis Label Piel oca e ces oho pedia eR ERR ecd E Re Ree n A 3 4 4 Row Adjustment Panel o a aaa ee ee pie eh AREA a eek eee a NE Bk Ss A te ce ee ee cr bd ERED SSH Ae EH RR OY ORES ORES EY ndo Pigs A AA e A E OR Pc ye Oe Bede CONTENTS CONTENTS 46 4 1 Search and Scan Facility sussa bed a ed ee eG ee wee ARA 46 Sey ae a e le ee ee ee 49 4 3 Estimation of MPI Communication Overhead o 50 Chapter 1 Introduction Jumpshot 4 is the visualization program for the improved scalable logfile format SLOG 2 which provides a hierarchical structure to store a large number of drawable objects in a very scalable and efficient way for visualization The new scalable logfile format allows the display program to provide functionalities never made possible before Level of detail support through preview drawables which provides high level abstraction of the details without reading in huge amount of data into the graphical display engine New Jumpshot allows seamless scrolling from the beginning till the end of logfile at any zoom level In addition new functionalities like dragged zoom grasp and scroll instant zoom in out easy vertical expansion of timelines cut and paste of timelines are available as well A new search and scan facility is provided to locate the hard to find objects in very large logfile Also the histogram module based on user selected duration provides a convenient and graphical way to anal
5. PREVI OC 5 SEARCH ARROW LENGTH 20 SEARCH FRAME THICKNESS 3 SEARCHED OBJECT ON TOP false Histogram zoomable window HISTOGRAM ZERO ORIGIN true SUMMARY STATE BORDER ColorRaised v SUMMARY ARROW LOG BASE 5 Ame Figure 3 27 The Preference window that shows PREVIEW STATE DISPLAY As shown in Figure is the Preference window that adjusts the various display properties of the visualization program A list of all the parameters and their definitions are listed in Tables 3 1448 16 Al CHAPTER 3 GRAPHICAL USER INTERFACE 3 6 PREFERENCE WINDOW 819 82 ana 527 Parameter Values Description Y_AXIS ROOT LABEL any text Label for the root node of the Y axis tree label in the left panel INIT SLOG2 LEVEL READ ve integer The number of slog2 levels being read into mem ory when the Timeline window is initialized the integer affects the zooming and scrolling perfor mance exponentially in a asymptotic sense AUTO_WINDOWS_LOCATION true false Whether to let Jumpshot 4 automatically set win dows placement SCREEN_HEIGHT_RATIO 0 0 1 0 Ratio of the initial timeline canvas height to the screen height TIME_SCROLL_UNIT_RATIO 0 0 2 1 0 Unit increment of the horizontal scrollbar in the fraction of timeline canvas s width Table 3 14 Parameters for the section of Zoomable Window Reinitialization in Preference window 42 CHAPTER 3 GRAPHICAL USER INTERFACE
6. RR E a RE T TR 725216 737816 75 216 762816 775216 787816 80 216 812816 825216 837816 85 nosso z Time seconds Figure 2 3 The next zoom in view of Figure Figure 2 3 is the zoom in view of the region marked by the pair of white lines in Figure 2 2 Comparing these 2 figures all the preview drawables have disappeared and are replaced by real drawables Each white preview state are replaced by hundreds of white real states the same is also true for the gray preview states that sit to the right of the turquoise stated The preview arrows are all replaced by the real arrows It becomes apparent that the white lines marked region in Figure provides a good description of what is going on in Figure 2 3 but at the same time it reduces the number of drawables drawn on the canvas by a factor of 100 Another way of seeing this benefit is to find out the exact number of real drawables amalgamated by the preview objects within the zoomed region 3Only in slog2 file that has multiple ViewMaps and where timelines can be collapsed i e AIX s UTE generated slog2 file preview state can be nested with other preview state in collapsed Y axis label view 4when a preview state contains only real states of one single category it may appear like a real state in the timeline canvas The only sure way to tell the difference is to bring up the Drawable Info Box by right clicking on the state 5In order to speed up graphics performance of the
7. The tallest strip at the bottom of the preview state corresponds to the category of states that contribute the longest total duration in the specified time range inclusively i e disregarding the nesting state order This visual representation aims to tell what state categories could be within the span of the preview state and which state category contributes the most statistically to the specified time range so user can decide where to zoom in to find out more details In a sense the preview states provide a global coarse grain summary of what is going on without losing as much details as the preview found in older Jumpshot i e Jumpshot 3 Compared with Jumpshot 3 s preview which has averaged out the information about timeline IDs the new preview states retain the timeline ID information and that may lead to early detection of load balancing problem before zooming in to see all the real states Timeline cellular2d_paramesh3 slog2 lt Identity Map gt Lowest Max Depth 4 Zoom Level Global Min TimeView Init TimeZoom Focus TimeView Final TimeGlobal Max TimeTime Per P 4 ta tE 4 10 0 0060565 116 440893086 216 7590448339 7 0771962547 477 634607 10012959 Cumulativelnclusion Y a TimeLines 216 45 216 50 216 55 216 60 216 65 216 70 216 75 216 80 216 85 216 90 216 95 217 00 217 1 Time seconds 4 Figure 2 2 The next zoom in view of Figure Figure shows a more zoom in vie
8. 00 300 00 350 00 400 00 450 00 Duration seconds 4 EA Figure 4 5 An overall MPI overhead histogram for Figure 52
9. 2 1 and 2 2 are shown in Figures 2 8 and 2 9 respectively The CumulativeExclusion Ratio view does provide an extra dimension of information when compared to its inclusion ratio counterpart at the expense of being a bit more complicated to digest visually SMost of times neighoring preview states in CumulativelnclusionRatio view has similar total sum of inclusion ratios Because of this fact one can compare adjacent preview states But bear in mind that the total sum of inclusion ratios between nearby preview states can change drastically without any visual indication When in doubt right click on the preview state to get Drawable Info Box to confirm the ratios 14 CHAPTER 2 DATA MODEL 2 2 UNDERSTANDING THE PREVIEW DRAWABLE Lowest Max Depth Timeline cellular2d_paramesh3 slog2 lt Identity Map gt 4 Zoom Level Global Min TimeView Init TimeZoom Focus TimeView Final TimeGlobal Max TimeTime Per P 4 3 13 Lowest Max Depth Ji 0 0060565 5 6312523003 216 8474579533 7 7659065162 477 634607 1 0043882 A A E mm AR do EE TimeLines i 5 60 215 80 216 00 216 20 21640 216 60 216 80 217 00 217 20 21740 217 60 Time seconds 4 Timeline cellular2d_paramesh3 slog2 lt Identity Map gt 4 Zoom Level Global Min TimeView Init TimeZoom Focus TimeView Final TimeGlobal Max TimeTime Per P 1 13 CumulativeExclusio
10. as shown in the Search Box and Drawable Info Box 47 CHAPTER 4 SPECIAL FEATURES 4 1 SEARCH AND SCAN FACILITY search facility returns a searched state which is marked by a transparent box with a 3D raised border and whose starttime is marked by a yellow search cursor an upper and a lower 3D arrowheads The upper 3D arrow s color matches that of the returned state In the figure since the returned state is a preview state so the upper 3D arrow is gray in color as it is shown in Legend window Accompanied with the 3D raised bordered box is a popup Search Box that shows the detailed of the preview state like the Drawable Info Box in Figure Since the search in the figure is looking for state eos a Drawable Info Box is shown to indicate the returned 3D bordered box does contain category eos graphically In order to locate the real state eos a dragged zoom is performed around the 3D raised bordered box and the result is shown in Figure 4 2 In the figure the real eos is located in the middle of the original 3D bordered box and it is pointed by the Drawable Info Box TimeLine cellular2d_paramesh3 slog2 lt Identity Map gt 4 Zoom Level Global Min Time View Init Time Zoom Focus Time View Final Time Global Max Time Time Per Pixel IQ e 12 0 0060565 216 4380505742 216 4887924597 216 5395344743 477 634607 0 0001618561 bd TimeLines ITI gl ee l I Ap O es Ee yy 17 ON E
11. display Out of the 4 categories mentioned in the text area only 3 are visible noticeably in the figure given the limited pixel height available to the preview state The least significant category ALLREDUCE is barely visible But the limitation can be improved by selecting another display option for preview state in Preference window that does not rely on the category ratid As indicated there are altogether 58 real drawables in the preview state but no information is provided about how many real drawables are in each real category TimeLine cellular2d Aid zog lla Map gt 14 JE 0 0060565 216 8402335254 216 756850685 216 8613486285 477 634607 0 time 216 813730 LinelD 6 y 1 time 216 853472 LinelD 1 msg_tag 454 msg_size 1600 i close O guard cell 6 85 216 852 216 854 216 856 216 858 216 86 duration 0 5367 sec 0 time 216 47006025 LinelD 4 Time seconds 4 f 1 time 217 00675525 LinelD 4 Figure 3 17 Drawable Info Box for real state and arrow The Drawable Info Box for the arrow shows the message size 1600 byte and tag ID 454 Drawable Info Box for Real Drawable Similarly for real drawables Drawable Info Box can be brought up by right mouse clicking on the real drawables In Figure 3 17 Drawable Info Boxes for a real arrow and a real state are shown The Drawable Info Box for the arrow is invoked by clicking anywhere
12. operation can be carried out by pressing either the SearchForeward or SearchBackward buttons shown in Table As shown in Figure the 46 CHAPTER 4 SPECIAL FEATURES 4 1 SEARCH AND SCAN FACILITY TimeLine cellular2d_paramesh3 slog2 Identity Map gt 4 Zoom Level Global Min Time View Init Time Zoom Focus Time View Final Time Global Max Time Time Per Pixel 10 0 0060565 216 245738857 216 756850685 216 8820420257 477 63461 634607 0 0012959331 Q TimeLines Preview State O es duration max 84 9205 msec 0 time min 216 4470215 Search Box E Preview State duration max 84 9205 msec 0 time min 216 4470215 LinelD O 1 time max 216 531942 LinelD 0 216 60 216 65 216 70 216 75 216 80 216 85 Time seconds 4 duration ave 0 31219 msec 0 time ave 216 4810505711 LinelD O 1 time ave 216 4813627605 LinelD 0 Number of Real Drawables 190 Exclusive Duration Ratio legend IRECY ratio 0 008372537 legend SSEND ratio 0 009614876 legend ALLREDUCE ratio 0 009685529 legend BARRIER ratio 0 035874728 legend PACK ratio 0 06448974 legend UNPACK ratio 0 1410732 legend WAJTALL ratio 0 19260368 legend eos ratio 0 2367744 Figure 4 1 Search of state eos in preview stage The returned state is a preview state containing state eos
13. overhead a histogram window over the whole duration of the timeline canvas can be obtained and is shown in Figure The vacuum region in each timeline is assumed to be used by user computation 2it is true for a binary tree 3A typical timeline canvas with arrows will draw roughly a factor 3 slower with anti aliasing on 50 CHAPTER 4 SPECIAL FEATURES ESTIMATION OF MPI COMMUNICATION OVERHEAD Timeline cellular2d_paramesh3 slog2 lt Identity Map gt lt 2 gt pu ae gt ay a yo A aja pj lt gt ajea Bea Laa epth 4 Zoom Level Glo bal Min Time View Init Time Zoom Focus Time View Final Time Global Max Time Time Per Pixel 0 0 0060565 0 006056 E l 477 634607 TOO AA AN DECO DRM UE I TU TO EUA ANC n On Tn TOO Figure 4 4 Graphical MPI overhead profiling through the use of BaseAlignedCumulativeErclusion Ratio view of Timeline window in Figure 51 CHAPTER 4 SPECIAL FEATURES ESTIMATION OF MPI COMMUNICATION OVERHEAD Histogram for the duration 0 6446801 476 98386 gt lt gt ja q eaja ela Zoom Level Global Min Time View Init Time Zoom Focus Time View Final Time Global Max Time Time Per Pixel e on I Rom ow Qa Hb Row Count Statistics 17 0 0 0 00 0 00 238 1695951512 476 3391903025 476 3391903025 0 6186223251 gt 100 00 150 00 200 00 250
14. state are formed based on the PREVIEW_STATE_DISPLAY discussed earlier in section 2 2 1 Different representation of summary state can be selected through SUM MARY_STATE_DISPLAY pulldown menu located at the top of the left panel in the histogram win dow or through a similar variable defined in Preference window and in Table Figure is actually a CumulativeExclusionRatio view Since the most time consuming timeline is the last one we will zoom in the last three timelines and use them to discuss the visual representation of sum mary state Figure 3 23 shows the last three timelines of Figure 3 22 Each summary state has a gray bordered box Right mouse clicking at the bordered box pops up the Summary Info Box for the whole summary state The info box lists the total number of real states it contains and detailed information of what state categories it contains In the figure the summary info boxes at timeline 15 and 13 show that the timeline 15 summary state contains about 148006 real states and the timeline 13 summary state has about 859613 real states i e timeline 13 has 5 8 times the number of real Sordered pair of timelines means timeline pair 1 2 is different from pair 2 1 38 CHAPTER 3 GRAPHICAL USER INTERFACE 3 5 HISTOGRAM ZOOMABLE WINDOW states than that of timeline 15 within the same duration Each summary state also displays the ratios of the total duration of each member state category to the duration of the canvas as color
15. state is 0 8 sec The sum of durations for the 2 yellow states is 0 5 sec Figure 2 6 shows a typical zoomed in view of some nested states In this view the yellow states are deeply nested in the navy blue state which is in turns nested in the orange state The pair of green lines mark the region where a preview state is being created for The inclusion and exclusion ratios are computed for the region marked by the pair of green lines and are shown in Table The table shows that the most dominant state among all inclusion ratios 12 CHAPTER 2 DATA MODEL 2 2 UNDERSTANDING THE PREVIEW DRAWABLE Icon Description Duration Inclusion Ratio Exclusion Ratio CI Innermost Nested State 0 5 sec 50 50 E Intermediate Nested State 0 8 sec 80 30 u Outermost Enclosing State 1 0 sec 100 20 Table 2 2 The breakdown of real states contribution to a preview state of duration 1 0 sec as it is marked by a pair of green lines in Figure is the orange outermost state but the most dominate state among all exclusion ratios is the yellow innermost state which is the least dominant state in inclusion ratios One obvious observation is that the inclusion and exclusion ratios of the innermost state category are the same E Timeline nesting slog2 Identity Map gt 0 006185 Cumulativeln TimeLines Overlapinclus TimeLines TimeLines OverlapExclus TimeLines L
16. to be less than or equal to 1 The motivation of computing these 2 ratios is to satisfy two opposite needs of preview state If you are a MPI application developer and you have put a lot of user defined states in your SLOG 2 file through either MPE or AIX s PCT utility you most likely would be interested in the profiling information of the user defined states which enclose MPI states and other user defined states In this case inclusion ratio will be very useful Because inclusion ratios of user defined states usually dominate all state inclusion ratios including those of MPI states Therefore the inclusion ratio highlights the outermost enclosing states even at high preview level On the other hand if you are a MPI implementor or are interested in the low level MPI networking overhead you are most likely interested in the profiling information of MPI and its internal calls Exclusion ratio will come in handy Exclusion ratios for the innermost nested states i e MPI states tend to dominate all state exclusion ratios So the exclusion ratio highlights the innermost nested states at very high preview level Timeline nesting slog2 lt Identity Map gt 0 25 1 003092 TimeLines E 0 125 0 25 0 375 0 50 0 625 0 75 0 875 l 1 125 1 8 Time seconds d Figure 2 6 A zoomed in view of some nested states where the duration of the orange state is 1 0 sec The duration of the navy blue
17. will increase the size of the images managed by Jumpshot 4 This may cause the Java Virtual Machine to exhaust all its memory if the virtual machine is not set to have enough memory when Jumpshot 4 is started or there isn t enough physical memory in machine that Jumpshot 4 runs on Hence the row height cannot be adjusted all the way to zero 35 CHAPTER 3 GRAPHICAL USER INTERFACE 3 5 HISTOGRAM ZOOMABLE WINDOW a b Row Row Count Height mode mode Figure 3 21 Row Adjustment Panel determines the Timeline window s resize scheme When one of the mode sliders or text fields is adjusted the other 3 components will be adjusted simultaneously 36 CHAPTER 3 GRAPHICAL USER INTERFACE 3 5 HISTOGRAM ZOOMABLE WINDOW Histogram for the duration 0 6446801 476 98386 _ lt gt ajajaja eale Zoom Level Global Min Time View Init Time Zoom Focus Time View Final Time Global Max Time Time Per Pixel a on row Qa 0 0 00 0 00 238 1695951512 476 3391903025 476 3391903025 0 6186223251 Al Row Count Statistics 17 0 100 00 150 00 200 00 250 00 300 00 350 00 400 00 450 00 Duration seconds q EA Figure 3 22 A histogram window of the whole duration shown in Figure 37 CHAPTER 3 GRAPHICAL USER INTERFACE 3 5 HISTOGRAM ZOOMABLE WINDOW There is only 1 summary state per timeline and 1 summary arrow for each ordered pair of timelin
18. within the vicinity of the arrow body and the info box shows the starttime start timeline tie by setting the PREVIEW STATE DISPLAY pulldown menu in Timeline window or Preference window to FitMostLegends message as listed in Table The vicinity width can be adjusted by modifying the parameter CLICK RADIUS TO LINE in Preference window as listed in Table 3 16 The default is 3 pixels 30 CHAPTER 3 GRAPHICAL USER INTERFACE 3 4 TIMELINE ZOOMABLE WINDOW ID endtime and ending timeline ID and some extra information implemented by the native format In this example the message size carried by the specific arrow is 1600 byte TimeLine cellular2d_paramesh3 slog2 lt Identity Map gt 4 Zoom Level Global Min Time View Init Time Zoom Focus Time View Final Time Global Max Time Time Per Pixel 16 0 0060565 216 8436089526 216 756850685 216 8513068661 477 634607 0 00001 22774 ia TimeLines gt e i SS y l l 216 849 216 85 216 8 Time seconds 4 216 844 216 845 Figure 3 18 Duration Info Box shows the duration starttime and endtime of a time region marked by a pair of green lines Duration Info Box Duration Info Box is created by right dragging in the timeline canvas or the time ruler canvas to mark a region in time The dragged region will be marked by a pair of green lines and is lightly shaded as well Duration Info Bo
19. 325 477 634607 P p E dl 0 0012869956 IQ ai A quinta gt nai TimeLines ES 1 aa fo hm lef r Preview State __ carrier 49 372 msec 216 47016225 LinelD 4 216 51953425 LinelD 4 Ei max 0 time min 1 time max 0 72861 msec 216 505816 LinelD 4 216 5065446121 LinelD uration ave 0 time ave 1 time ave 4 Number of Real Drawables 58 Exclusive Duration Ratio legend ALLREDUCE ratio 0 02265454 legend PACK ratio 0 10689258 legend SSEND ratio 0 17300291 legend BARRIER ratio 0 55339056 lt Figure 3 16 Drawable Info 29 27 525 msec 216 74728075 LinelD 3 216 77480575 LinelD 3 uration max 0 time min 1 time max duration ave 0 10163 msec 0 time ave 216 7609935074 LinelD 3 1 time ave 216 761095136 LinelD 3 Number of Real Drawables 136 Exclusive Duration Ratio legend PACK ratio 0 5021433 lt Box for Preview State CHAPTER 3 GRAPHICAL USER INTERFACE 3 4 TIMELINE ZOOMABLE WINDOW on the different color strip in the same preview state will pop up a Drawable Info Box with a different labeled icon but the content of the text area remains the same In general not every category listed in the text area is visible in the preview state
20. 65536 bytes h h help help Display this message 1c Check increasing endtime order exit when 1st violation occurs tcc Check increasing endtime order continue when violations occur nc number_of_children_per_node Default value is 2 Is max_byte_size_of_leaf_node Default value is 65536 o output filename with slog2 suffix Output File Size J l Output to Input Logfile Size Ratio 0 Figure 3 2 The Logfile Convertor window that allows conversion of supported trace file format to SLOG 2 format 17 CHAPTER 3 GRAPHICAL USER INTERFACE 3 2 LOGFILE CONVERTOR WINDOW currently 3 supported convertors CLOG gt SLOG 2 RLOG gt SLOG 2 and UTE gt SLOG 2 Convertor is generally selected based on the input file s file extension In the case that wrong file convertor is selected user can correct it through the pale blue pulldown menu located at the top of the window The Logfile Convertor window can also be invoked by directly clicking on the Logfile Conversion button shown in the Table The text field of the Output File Name usually displays the default slog2 filename recommended by the convertor based on the text field in the Input File Specification If the text field does not display the default name as expected hitting return key in the Input File Specification field will force the update of the Output File Name field with the default name There a
21. Backward Alt LEFT Scroll Backward by half a screen gt Forward Alt RIGHT Scroll Forward by half a screen 4 ZoomUndo Alt U Undo the previous zoom operation as ZoomOut Alt O Zoom Out by 1 level in time ZoomHome Alt H Reset zoom to the initial resolution in time ZoomIn Alt I Zoom In by 1 level in time A ZoomRedo Alt R Redo the previous zoom operation pe SearchBackward Alt B Search backward in time AA SeachInitialize Alt S Search Initialization from last popup InfoBox s time 8 SearchForward Alt F Search forward in time E cms o Seen cms fo arson cme Fon Print none Print the Timeline window Exit none Exit the Timeline window Table 3 12 Table of toolbar s functionalities 33 3 4 TIMELINE ZOOMABLE WINDOW CHAPTER 3 GRAPHICAL USER INTERFACE 3 4 TIMELINE ZOOMABLE WINDOW Lowest Max Depth Lowest Max Depth 10 13 f 10 13 gf CumulativeExclusionRatio v FitMostLegends i OverlapInclusionRatio CumulativelnclusionRatio OverlapExclusionRatio BaseAlignedCumulativeExclusionRatio Figure 3 20 A simple 1 level Y axis label tree The blue highlighted labels are those that have been selected The pulldown menu at the top of panel indicates the value in PREVIEW_STATE_DISPLAY in Preference window 34 CHAPTER 3 GRAPHICAL USER INTERFACE 3 5 HISTOGRAM ZOOMABLE WINDOW 3 4 4 Row Adjustment Panel The concealable right panel in Timeline window contains the row adjustment pane
22. GR IM a EE pm 7 7e LS Search Box l L Preview State 49 2650 21651 21652 21653 Time seconds uration max 84 9205 msec 0 time min 216 4470215 LinelD O 1 time max 216 53 1942 LinelD O duration ave 0 31219 msec 0 time ave 216 4810505711 LinelD O 1 time ave 216 4813627605 LinelD 0 Number of Real Drawables 190 Exclusive Duration Ratio legend IRECY ratio 0 008372537 legend SSEND ratio 0 009614876 legend ALLREDUCE ratio 0 009685529 legend BARRIER ratio 0 035874728 legend PACK ratio 0 06448974 legend UNPACK ratio 0 1410732 legend WAITALL ratio 0 19260368 legend eos ratio 0 2367744 Figure 4 2 Dragged zoom the region around the 3D raised bordered box in Figure 4 1 shows the real state eos he transparency of the 3D raised box can be made opaque by selecting the SEARCHED OBJECT ON TOP true 48 CHAPTER 4 SPECIAL FEATURES 4 2 TUNING OF THE TIMELINE WINDOW In general when searching on big slog2 file all preview categories should be set searchable otherwise searching for real drawables may not return anything Because at lower zoom level there may not be any real drawables of the categories of interest only preview drawable contains the categories of interest Also the search facility is carried out for the drawables that are in the physical memory In some rare occasions drawables in the memory m
23. In order to see the smallest ratios one needs to zoom in around the beginning of the canvas In Figure the largest inclusion ratios in the 3 visible timelines are all royal blue and take up about the same amount of time The 2nd largest ratios are all orange colored and is smallest in the timeline 15 Therefore OverlapInclusionRatio is good for comparison of member category contribution among different timelines 3 5 2 Summary Arrows Figure 3 25 is the Arrows Only view of the histogram window shown in Figure 3 22 There is a summary arrow per ordered pair of timelines The duration of each summary arrow is the total The view cannot be drawn within same duration as marked in the timeline window 39 CHAPTER 3 GRAPHICAL USER INTERFACE 3 5 HISTOGRAM ZOOMABLE WINDOW Histogram for the duration 0 6446801 476 98386 4 Zoom Level Global Min Time View Init Time Zoom Focus Time View Final Time Global Max Time Time Per Pixel IQ j 0 0 00 0 00 103 4345567049 476 3391903025 476 3391903025 0 6552120912 as Al Statistics gt 100 00 150 00 200 00 250 00 300 00 350 00 400 00 450 00 Duration seconds Figure 3 25 The Arrows Only view of the Figure 3 22 duration of all real arrows taking place between the ordered pair of timelines within the duration of the canvas Notice that it is possible the duration of summary arrow is longer than that of the canvas
24. Jumpshot 4 s User s Guide Anthony Chant David Ashton Rusty Lusk William Gropp Mathematics and Computer Science Divsion Argonne National Laboratory 19th September 2003 Ichan mes anl gov 2ashtonQmes anl gov 3lusk mcs anl gov 4 ropp mcs anl gov Acknowledgments We would like to thank Dave Wootton of IBM Poughkeepsie for his valuable suggestions and com ments during the development of this tool This work has been supported in part through the Center for Astrophysical Thermonuclear Flashes at the University of Chicago by the United States Department of Energy under contract B532820 This work was also supported by the Mathematical Information and Computational Sciences Division subprogram of the Office of Advanced Scientific Computing Research Office of Science U S Department of Energy under Contract W 31 109 ENG 38 Contents 1 Introduction 2 Data Model 2 1 Understanding the Drawable wd eed E o Bd e E Dog E E DAP Be SD E E E 2 2 Understanding the Preview Drawable o o CEA a ee E e be A a a OE A AAA AER e SR LTS A RO AS EN ic RE e e a oe A ee A a 3 4 1 Zoomable and Scrollable Canvas o 3 4 1 1 Dragged ZOOM ee ek has se e SUA E RS 3 4 1 2 Instant OI Sata Grasp and Scroll o s o se soem re siei eoa ESM ee 3 4 1 4 Information Dialog Box oaoa aaa 0008 842 Toolbar ses se s pa Gura Gna E E Bede Bed ee eed GEO pd aa
25. Raised WhiteLowered WhitePlain Empty ARROW_HEAD_LENGTH ve integer Length of arrow head in pixel ARROW HEAD HALF WIDTH ve integer Half width of arrow head s base in pixel PREVIEW STATE DISPLAY FitMostLegends Display option of Preview state when OverlapInclusionRatio CumulativelnclusionRatio OverlapExclusionRatio CumulativeExclusionRa Timeline window starts up tio BaseAlignedCumulative ExclusionRatio PREVIEW STATE BORDER ColorRaised Border style of Preview state ColorLowered ColorXOR WhiteRaised WhiteLowered WhitePlain Empty PREVIEW STATE BORDER W integer The empty border insets width in pixel for the Preview state PREVIEW STATE BORDER H integer The empty border insets height in pixel for the Preview state PREVIEW STATE LEGEND H integer Minimum height of the legend di vision category strip in pixel inside THICKNESS the Preview state PREVIEW ARROW LOG BASE integer The logarithmic base of the number of real arrows amalgamated in Preview arrow Hence this determines the Pre view arrow s thickness SEARCH_ARROW_LENGTH integer Length of the search marker s arrow in pixel SEARCH_FRAME_THICKNESS integer Thickness in pixel of the popup frame that highlights the searched drawable SEARCHED_OBJECT_ON_TOP true false Whether to display the searched ob ject on top of the search frame Table 3 18 Parameters for the section of Timeline Zoomable Window in Preference wi
26. algamate real drawables of same topological type e g preview state amalgamates only states So preview drawable is always a primitive drawable in the renormalization scheme There are currently 3 different types of preview drawables Preview_State Preview_Arrow and Preview_Event Therefore one preview drawable is for each supported topology of primitive drawable Up to three preview categories could show up in the Legend window of the display program as shown in Figure The Legend window contains a table of legends which are basically visual representation of category objects mentioned earlier Each legend provides an interface to the user modifiable part of the corresponding category that is relevant to the display program Figures to illustrate the visual transition from preview drawable to its detailed content of the first 5 processes of a 16 processes MPI slog2 file when the timeline canvas is being zoomed in The sequence of figures is generated by zooming in a marked region in each successive figure in the sequence The marked region is shaded and is bounded by a pair of white lines A magnifying glass with plus sign in the center is the cursor that marks the end of the zoom region Figure is a typical timeline canvas where most of real drawables are still buried inside their preview drawables In the figure there are preview arrows preview states in the front and some long running real states in the back Each thick yellow line is a preview ar
27. and as in Figure It indicates the canvas will move in the same direction that the cursor moves as long as the left mouse button remain pressed The grasp and scroll mode in time ruler canvas can only move horizontally but the grasp and scroll mode in timeline canvas allows movement in both vertical and horizontal axes 27 CHAPTER 3 GRAPHICAL USER INTERFACE 3 4 TIMELINE ZOOMABLE WINDOW 3 4 1 4 Information Dialog Box Jumpshot 4 wouldn t be complete if it cannot provide a way to tell user what exactly are being displayed It is particularly important when there are many preview drawables Following standard user interface practice Jumpshot 4 uses right mouse clicking as an interface for user to tell Jumpshot 4 what object that more information is needed In general anywhere on the canvas both timeline and time ruler canvases can be inquired with right mouse clicks Information dialog box will pop up accordingly to tell user more about object that is being clicked There are 3 different types of information dialogs Drawable Info Box Duration Info Box and Time Info Box All these info boxes remain in memory as long as they are not closed even if the canvas has been scrolled or zoomed One of the usages of the info boxes is to serve as time markers in between zooming and scrolling Drawable Info Box Drawable Info Box is a popup dialog box that provides detailed information about the drawable object that is being clicked There are 2 differ
28. as in Table the initial Timeline window is redisplayed and is shown in Figure The new Timeline window has 27 bands of preview states instead of 14 The increase preview resolution does offer a more detailed description of logfile but at the expense of graphical performance Because every increment of INIT SLOG2 LEVEL READ will roughly double the num ber of drawables to be iterated during every zooming or scrolling The biggest demand of graphical performance occurs when the zooming to the level of only pure real drawables from the lower zoom level The value of INIT SLOG2 LEVEL READ should be chosen so that Jumpshot does not ap pear to be too slow during the zooming to the pure real drawable level For a fast graphics system INIT_SLOG2_LEVEL_READ should be set higher than the default value 4 e g 5 so that more in formation is present during each view Slow graphics system should set INIT SLOG2 LEVEL READ lower e g 3 Another parameter also significantly affects the graphical performance is ARROW_ANTIALIASING in Preference window Setting the parameters to ON will force Jumpshot to draw all arrows in cluding preview arrows with anti aliasing lines This proves to be an expensive graphical opera tion Except when high quality picture is needed like during screen capture for picture or when anti aliasing lines are drawn with graphics hardware support it is not recommended to turn on ARROW_ANTIALIASING 4 3 Estimation of MPI Communication Overhea
29. as well as 2 right mouse clicking in any column cell Figure 3 6 is the Color Chooser dialog that will pop up when one of the icon buttons in column Topo is pressed The color editor provides 3 different ways of choosing a new color After selecting a new color from the dialog the new color will be used to update the icon button The update won t be carried out in the timeline canvas automatically explicit screen redraw is needed Figure 3 7 shows the popup dialog box either when the title icon of column Name is pressed or when right mouse button is clicked somewhere in the column There are altogether 6 different sort orders The first 4 orderings are various combination of alphabetical and case sensitive order e g z a Z A refers reverse case sensitive alphabetical ordering The second last order in the list is called Creation Order which refers to the order in which categories are stored in slog2 file when they are being created The 4 alphabetical ordering has 2 hidden sort orders One is called Preview Order which puts the preview drawable category before all the real drawable categories of the same topology The other is Topo Order which refers to topological ordering i e arrow is ahead of state The preview and topo sort orders can be turned on or off through the Preference window as shown in Table Figure 3 8 shows a popup dialog box when the title icon of column V Visibility or S Searchability is pressed or when right mouse butt
30. ay have been exhausted for searching before the end of the logfile has been reached user may need to advance the search by scroll forward or backward to read in more drawables and to restart the search again For a very big logfile the search process of a real state may require repeated operations of search and dragged zoom before the real state can be found This process will be automated in the later version of Jumpshot 4 4 2 Tuning of the Timeline Window Timeline cellular2d_paramesh3 slog2 lt Identity Map gt lt 2 gt I 7 B Fan PR me Sofa aja a ajaja elale Lowest Max Depth 4 Zoom Level Global Min Time View Init Time Zoom Focus Time View Final Time Global Max Time Time Per Pixel 9 13 I 0 0 0060565 0 0060565 o j238 81427525 477634607 _ 477 634607 0 62031255 J 7 CEGA Court CumulativeEx Y E i i 17 0 100 00 150 00 200 00 250 00 300 00 350 00 400 00 450 00 i Time seconds 4 7 Figure 4 3 The initial Timeline window with finer preview resolution One of the major improvements in the new Jumpshot and SLOG 2 is the scalability in terms of visual ization performance As shown in Figure 3 9 there are 14 bands of preview states covering the whole 49 CHAPTER 4 SPECIAL FEATURES ESTIMATION OF MPI COMMUNICATION OVERHEAD canvas in the initial Timeline window By incrementing the parameter INIT SLOG2 LEVEL READ by 1 in Preference window
31. ble timeline IDs and searchable categories 1 3 Search Time is the time that search starts It is marked by a yellow line called search cursor There are 2 different ways of setting the search cursor When the timeline canvas is in Hand mode as described in Figure 3 11 of section 3 4 1 left mouse clicking will set the search cursor The other way can be done in either Hand or Zoom mode First popup an information dialog box of any kind using right mouse clicking then press the SearchInitialize button in the toolbar to replace the green line by the yellow search cursor When there are more than one information dialog box the information dialog box that is shown up last will have its green line used to initialize the search cursor When Timeline window first starts up the search cursor is set at the starttime of the logfile Searchable Timeline IDs are the timelines that search will operate on i e only states on the marked timelines will be returned by the search facility These marked timelines can be selected by clicking on their timeline IDs on Y axis label panel with rules described in Table When nothing is selected all timelines are searchable Searchable Categories are categories that have their searchable checkboxes enabled as in Figure Only drawable with searchable category can be returned by the search facility By default all categories in Legend window are searchable After setting any needed search criteria the search
32. cellular2d_paramesh3 slog2 lt Identity Map gt Lowest Max Depth 4 Zoom Level Global Min TimeView Init TimeZoom Focus TimeView Final TimeGlobal Max TimeTime Per P A 0 0060565 6 8436089526 216 8474579533 6 6513068661 477 634607 1 0000156 TimeLines i 216 844 216 845 216 846 216 847 216 848 216 849 216 85 216 Time seconds Figure 2 5 The next zoom in view of Figure 11 CHAPTER 2 DATA MODEL 2 2 UNDERSTANDING THE PREVIEW DRAWABLE 2 2 1 Understanding the Preview State Display So far only one of the representations of preview state CumulativelnclusionRatio is used to illustrate the concept and representation of the preview state Jumpshot 4 actually uses several different representations of preview state All these representations are based on 2 ratios stored in SLOG 2 file They are called Inclusion Ratio and Exclusion Ratio Inclusion ratio is computed without taking into account of the nesting order of the states States which are either nested inside or enclose other states contribute equally to the inclusion ratio The end result is that the sum of all inclusion ratios from all state categories in a preview state could easily be larger than 1 On the other hand exclusion ratio is specifically computed to exclude the overlap of the nested state from the enclosing state Therefore the sum of exclusion ratios of all state categories in a preview state is guaranteed
33. d One of the questions that most MPI application developers always want to know is the overhead of MPI calls in their programs Essentially they would like to know what is the communication overhead in their parallel programs New SLOG 2 viewer provides a graphical answer to this question for most MPI profiling system In MPE profiling system MPI states are alway nested deeper than the user defined states Therefore disabling user defined states and arrows in CumulativeExclusionRatio mode in the Timeline window still leaves all MPI exclusion ratios intact without distorted the collective meaning of exclusion ratios Figure shows a CumulativeExclusionRatio view in BaseAligned mode which looks like a 2 dimensional projection of a 3 dimensional histogram for a timeline vs time coordinate system The base aligned feature is for easy comparison of preview states heights It becomes apparent from the figure that not only do we know the yellow state i e MPI Barrier takes up most time in the program we also know when and where MPI_Barrier consumes most time The combination of disabling user defined states and use of BaseAlignedCumulativeExclusion Ratio Timeline view provides a powerful and convenient way to estimate MPI communication overhead Together with the zoomable capability of the Timeline window user can easily zoom in to identify the time and location of the bottleneck that causes the biggest communication overhead For an overall estimate of MPI
34. display program an aggressive algorithm has been employed to eliminate drawing states that are closely packed together within the nearest neighboring pixels Together with the fact that the number of pixels available is less than the number of non overlap states in the region the number of the real states may sometimes not appear as numerous as the Drawable Info Box of preview state indicates In that case a further zoom in will be needed to confirm the case as shown in Fig 9 CHAPTER 2 DATA MODEL 2 2 UNDERSTANDING THE PREVIEW DRAWABLE This can be achieved by right clicking on the preview drawable and the result is shown in Figure 3 16 Timeline cellular2d_paramesh3 slog2 lt Identity Map gt 6 8402335254 216 8507910265 6 6613466265 477 634607 100004300 TimeLines i i a 6 84 216 842 216 844 216 846 216 848 216 85 216 852 216 854 216 856 216 858 216 86 5 5 Time tseconds Figure 2 4 The next zoom in view of Figure Further zooming into the white lines marked region in Figure enlarges the real drawables that are displayed in the figure The enlarged view is shown in Figure The densely packed states and arrows become more distinguishable Another zooming in around the white lines marked region in Figure 2 4 enlarges the real drawables into easily separable objects as shown in Figure CHAPTER 2 DATA MODEL 2 2 UNDERSTANDING THE PREVIEW DRAWABLE 5 Timeline
35. e Currently 3 different views are available in Histogram window States Only Arrows Only and All In States Only view only summary states are displayed In Arrows Only view only summary arrows are displayed In All view both summary states and arrows are displayed 3 5 1 Summary States Histogram for the duration 0 6446801 476 98386 S san 4 Zoom Level Global Min Time View Init Time Zoom Focus Time View Final Time Global Max Time Time Per Pixel Y 4 ous O 0 00 238 1695951512 476 3391903025 476 3391903025 0 6186223251 Q Statistics Cumulati Y Summary Info Box lt 2 gt L Summary State at LinelD 13 Averaged Number of Real Drawables 859612 87 Exclusive Duration Ratio TED Summary Info Box XII fr Summary State L Summary State At LinelD 15 Averaged Number of Real Drawables 148006 44 Exclusive Duration Ratio legend ISEND ratio 6 771861E 6 1 1 At LinelD 15 Exclusive Duration Ratio legend WAJTALL ratio 0 103350356 18 gt Figure 3 23 State Summary Info Boxes of the Histogram window Since summary states are created through the statistics of real and preview states summary states inherit properties of preview states i e inclusion and exclusion ratios Because of this different representations of summary
36. e amalgamated within the time range of the preview state Depending on the PREVIEW STATE DISPLAY value selected in the pulldown menu at the top of left side Y axis label the distribution and the heights of the strips Im Preference window as shown in Figure and in Table there is also a PREVIEW_STATE_DISPLAY variable The variable determines the initial PREVIEW_STATE_DISPLAY used when Timeline window is first made visible CHAPTER 2 DATA MODEL 2 2 UNDERSTANDING THE PREVIEW DRAWABLE Timeline cellular2d_paramesh3 slog2 lt Identity Map gt Lowest Max Depth 4 Zoom Level Global Min TimeView Init TimeZoom Focus TimeView Final TimeGlobal Max TimeTime Per P 3 13 a 0 0060565 15 63125230 216 7577884778217 78590651 8 477 634607 0 0035149 TimeLines eel eg a p a sm A e gt z z a 5 60 215 80 216 00 216 20 21640 216 60 216 80 217 00 217 20 217 40 217 60 Time seconds Figure 2 1 A typical zoom out view of preview states and arrows The region that is marked by a pair of white lines and the zoom plus cursor is being zoomed in i e enlarged in the next figure CHAPTER 2 DATA MODEL 2 2 UNDERSTANDING THE PREVIEW DRAWABLE can be changed drastically One of the display options for preview state is CumulativelnclusionRatio With this option the strips are arranged in decreasing height order sort of like a small cumulative histogram
37. ed boxes inside the gray bordered box Right clicking at any of the colored boxes will display a summary info box that indicates the color and name of category and the corresponding ratio for the duration as the highlighted summary info box in the Figure 3 23 The remaining duration at the end of each timeline is unaccounted for In this particular logfile remaining time could be thought of being used for computation Histogram for the duration 0 6446801 476 98386 4 Zoom Level Global Min Time View Init Time Zoom Focus Time View Final Time Global Max Time Time Per Pixel IQ 4 238 1695951512 476 3391903025 476 3391903025 0 6186223251 h Statistics DI a a mA ale i i IE F 100 00 150 00 200 00 250 00 300 00 350 00 400 00 450 00 Duration tseconds Figure 3 24 The OverlapInclusionRatio view of Figure 3 23 Switching the SUMMARY_STATE_DISPLAY pulldown menu in histogram window in the figure to OverlapInclusionRatio redraws the histogram canvas The histogram canvas now looks like one shown in Figure Since the sum of all inclusion ratios is greater than 1 0 CumulativelnclusionRatio view is not provided in the histogram window All the member categories of the summary states in OverlapInclusionRatio view are drawn from the beginning of the histogram canvas and they are nested one inside others in decreasing inclusion ratio order so the largest inclusion ratios are easily noticeable
38. el At the bottom of the canvas is the time ruler canvas Both Y axis label and the row adjustment panels can be put out of sight by clicking the tabs in the dividers or dragging the dividers to the side of the window The top toolbar can be dragged out of the window or be repositioned in the other 3 sides of the window A bare minimal zoomable window can be obtained by the removal of toolbar and the hiding of the left and right panels An almost bare minimal Timeline window looks like the one shown in Figure 24 CHAPTER 3 GRAPHICAL USER INTERFACE 3 4 TIMELINE ZOOMABLE WINDOW Time Line cellular2d_paramesh3 slog2 Identity Map gt o me D a F lalo ra 4 lt gt aq aa a jals 8 0 Lowest Max Depth 4 Zoom Level Global Min Time View Init Time Zoom Focus Time View Final Time Global Max Time Time Per Pixel IQ K Row v 10 13 h 0 0060565 0 0060565 238 81427525 477 634607 477 634607 0 62031255 Q E E GEA CumulativeEx v TimeLines LinelD Fit All Ro 50 00 100 00 150 00 200 00 250 00 300 00 350 00 400 00 450 00 alt E Time seconds J 5 Fal Figure 3 9 The initial display of the Timeline window of a 514 MB 16 processes slog2 file with default preview resolution 25 CHAPTER 3 GRAPHICAL USER INTERFACE 3 4 TIMELINE ZOOMABLE WINDOW 3 4 1 Zoomable and Scrollable Canvas When viewing a big slog2 file like t
39. ent kind of Drawable Info Box one for preview drawable one for real drawable Drawable Info Box for Preview Drawable Right mouse clicking on 2 of the preview states in the timeline canvas shown in Figure 2 9 will pop up 2 Drawable Info Boxes for the preview states They are displayed in Figure The popup Info Box s upper left hand corner will be positioned at exactly where right mouse click is detected and a green line marker will appear on the canvas to indicate what time has been clicked in case the dialog box is moved from its original popup location In order to best illustrate what information is presented by the Drawable Info Box let s take the highlighted Drawable Info Box in Figure as an example The Drawable Info Box for preview state contains a pink label Preview State and the icon inside the dialog box shows the color and shape of the drawable Below the icon there is a big text area that prints all the detailed statistical information about this preview state There are 6 timestamps in the text area maximum duration minimum starttime maximum endtime average duration average starttime and average endtime Here 0 refers to starting point and 1 refers to the ending point The 3 average timestamps are averaged over all the real drawables represented by this preview drawable Besides timestamps the info box also tells Number of Real Drawables represented by the preview object In this case 136 real s
40. ew box Strictly speaking CumulativelnclusionRatio view cannot be used to compare different preview states because of the arbitrary rescaling If one is interested in the comparison of inclusion ratios across different preview states OverlapInclusionRatio view can be used instead OverlapInclusionRatio view draws all inclusion ratios proportional to the height of the preview state but in an overlapping way i e draw them in decreasing inclusion ratios order and stack one on top of the other sort of like nested state The overlap view of exclusion ratios is OverlapExclusionRatio view which is shown at the bottom of Figure OverlapExclusionRatio view draws exclusion ratios exactly the same way as OverlapInclusionRatio In general overlap view cannot fill up the full height of the preview state This is apparent in OverlapExclusionRatio view in 2 7 where the white bordered box indicates the full height of the preview state The white bordered box is necessary in comparing the ratios across different preview states with respect to the preview states duration However the white bordered box can sometimes be confusing because whatever in the back of the preview state can show through the empty space within the white bordered box In that case the bordered box can be turned off by selecting Empty in PREVIEW STATE BORDER in Preference window For the sake of comparison and continuity with our preview discussion the CumulativeExclusion Ratio view of Figures
41. g in the slog2 file Reverse Creation reverse of Creation order Table 3 8 The Description of the Sort Order operation menu in the Legend window Legend cellular2d_paramest 7 5 Enable Selected Y C Disable Selected lv Toggle All v Enable All 7 Disable All Iv o update_soln Preview_Event Figure 3 8 Checkbox Operation menu for column Category Visibility and Searchability 23 CHAPTER 3 GRAPHICAL USER INTERFACE 3 4 TIMELINE ZOOMABLE WINDOW allow easy enabling and disabling of visibility as well as searchability checkboxes With the help of continuous selection of the category rows in the legend table and various sort ordering available users can easily make a huge number of categories disappear in the Timeline or Histogram window For instance in CLOG converted SLOG 2 file where upper case name always refers to MPI names the case sensitive alphabetical ordering allows all MPI names to be put before all user defined categories With continuous mouse selection user can easily toggle the visibility of user defined states in the Timeline or Histogram window Also every element in the column Name is editable This allows user to correct undesirable category names set during logfile creation or even facilitate sorting of the names for selection purposes Left Mouse Operation Action Click on an object deselects any existing selection and selec
42. he one shown in Figure the whole timeline canvas is filled up with preview drawables Though it provides a reasonable description at high leve it is pretty obscure to know the details Hence a well designed zoomable and scrollable user interface ZSUI of the timeline canvas becomes an absolute necessity to facilitate the location of events of interest The ZSUI of the timeline canvas includes many parts and operations But the most handy ones are dragged zoom grasp and scroll and instant zoom in and out All these features are supported by the Zoomable and Scrollable canvas There are 2 such canvases in the Timeline window They are Timeline Canvas and Time Ruler Canvas In these canvases left mouse clicking can be alternated in 2 different modes by a pair of toggled buttons as shown in Figures 3 10 and 3 11 They are called Zoom and Hand modes Each canvas in the Timeline window has its own set of toggled buttons that determine its left mouse click behavior The timeline canvas s toggled buttons are located above the canvas and sit at the end of the time display panel The time ruler s toggled buttons are located at the bottom of row adjustment panel i e sit right next to the end of the ruler By default the timeline canvas is in zoom mode and the time ruler canvas is in hand mode so user can do zooming when the cursor is in the timeline canvas and can scroll easily by simply moving the cursor over the ruler canvas Also the scrolling can be d
43. imeline window is called Y axis label panel which contains a tree like representation for Y axis label for the timelines For a SLOG 2 file convertible from CLOG or RLOG with the default viewmap the typical Y axis label panel looks like that is shown in Figure 3 20 Together with toolbar s label buttons e g LabelMark and LabelMove and standard mouse selection methods listed in Table labels can be rearranged easily to create a more easily understood timeline canvas For multiple viewmaps SLOG 2 file from IBM s UTE trace environment LabelExpand and LabelCollapse buttons will come in handy to expand and collapse the label tree by one whole level In order to minimize unnecessary redraw of the timeline canvas the synchronization between the label panel and the timeline canvas is carried out passively i e user needs to press the CanvasReDraw button in the toolbar to update the Timeline window with the changes from the label panel 32 CHAPTER 3 GRAPHICAL USER INTERFACE Icon Description Shortcut Function amp Up Alt UP Scroll upward by half a screen a Down Alt DOWN Scroll downward by half of a screen pi LabelMark none Mark the timeline s LabelMove none Move the marked timeline s til LabelDelete none Delete the marked timeline s E LabelExpand Alt E Expand the Y axis tree label by 1 level Es LabelCollapse Alt C Collapse the Y axis tree label by 1 level
44. inelD 0 25 0 50 0 75 OO 212255 1 50 1 75 Time seconds Figure 2 7 Different preview state displays of the zoomed in view of the Figure 2 6 Starting from the top the first one is CumulativelnclusionRatio view the second one is OverlapInclusionRatio view the third one is CumulativeExclusionRatio view and the last one is OverlapExclusionRatio view With data computed in Table 2 2 various different preview displays can be drawn and are shown in 13 CHAPTER 2 DATA MODEL 2 2 UNDERSTANDING THE PREVIEW DRAWABLE Figure All colored strips inside the preview state will be drawn proportional to the height of the preview state For instance if the ratio of the category for the strip is 0 9 the corresponding colored strip will occupy 90 of the preview state s height The statement is true for all preview state display except CumulativelnclusionRatio which could have its total sum of ratios in exceed of 1 0 especially when the slog2 file is highly nested First consider the CumulativelnclusionRatio and CumulativeExclusionRatio views i e the first and the third ones from the top in the figure Notice that yellow state is least important in the top CumulativelnclusionRatio view but becomes most significant in the third CumulativeExclusionRatio view Since the sum of all inclusion ratios is larger than 1 in this case the sum is 2 3 the CumulativelnclusionRatio view reweights all ratios to fill up the previ
45. input file size as in the Figure If the logfile conversion fails the error message will be printed in the text area for diagnosis or bug report 18 CHAPTER 3 GRAPHICAL USER INTERFACE 3 2 LOGFILE CONVERTOR WINDOW Logfile Convertor Input File Spec shome chan slog2 slog2_logflles cellular2d_paramesh3 clog d_paramesh3 clog Output File Name shome chan slog2 slog2_logflles cellular2d_paramesh3 slog2__ logfiles cellular2d_paramesh3 slog2 note max bye size of leaf node can be specified with suffix k K m or M where k or K stands for kilobyte m or M stands for megabyte e g 64k means 65536 bytes gt Ending with exit status 0 DE Output File Size Output to Input Logfile Size Ratio Loo aW JVM Path pkgs lang java j2sdk1 4 2 jre bin java JVM Option Xms32m Xmx64m JAR Directory fhome chan slog2 build lib JAR Option TraceLibrary Path By conven Help F retum Figure 3 3 The hidden parameters panel of the Logfile Convertor Logfile Convertor Input File Spec home chan slog2 slog2 logfles cellutar2d paramesh3 clog d_paramesh3 clog Output File Name home chan slog2 slog2_logfiles cellular2d_paramesh3 slog2 tc Check increasing pei order exit when 1st violation occurs tcc Check increasing endtime order continue when violations occur nc number_of_children_per_node Default value is 2 Is max_byte_size_of_leaf_node Default value is 65536 o o
46. is updated with the latest time related information of the zoom in region Notice that the zooming as well as scrolling can be achieved by explicitly editing the text fields in the time display panel 3 4 1 2 Instant Zoom Figure 3 13 Zoom minus cursor that indicates the left mouse clicking is ready for zooming out While the canvas is still in zoom mode instant zoom is enabled by default Instant zoom allows zooming in at the point of left mouse clicking by a factor of 1 2 i e the region centered at the point of left clicking will be magnified by a factor or 2 Also the Zoom Focus Time in the time display panel will be updated with the time where left clicking on the canvas is detected In the process the cursor remains zoom plus cursor Shift click on the other hand will do the opposite While holding down Shift key the cursor will be changed to a zoom minus cursor as in Figure to indicate zooming out is the action associated with left clicking The zoom factor is 2 in this case 3 4 1 3 Grasp and Scroll Figure 3 14 Open hand cursor indicates that left mouse clicking is ready to grasp and scroll Figure 3 15 Close hand cursor indicates that left mouse clicking is scrolling Grasp and Scroll is active only when the left mouse click is in hand mode i e when the open hand button is pressed as in Figure The cursor in hand mode is an open hand as in Figure As soon as left mouse button is pressed down the cursor turns to a close h
47. ked by the Duration Info Box so that the histogram window functions like a graphical display of statistical summary of the duration of interest For instance it is obvious from Figure that the yellow state it is MPI Barrier in this case cumulatively takes up the most time This is especially true in the last timeline Since Histogram window is also a zoomable window like Timeline window a lot of features like those described in section 3 4 1 for Timeline window are available for Histogram window as well e g dragged zoom grasp and scroll instant zoom in out easy vertical expansion of timeline cut and paste of timelines If some state categories or timelines need to be made invisible in histogram window it can be achieved through disabling the corresponding categories in Legend window s column V or S or selected corresponding timelines in histogram window It is just like that of Timeline window Only summary objects can be displayed in the histogram window Summary object is similar to preview object discussed earlier Preview objects are created during logfile creation stage and cannot be modified during visualization Summary objects on the other hand are created dynamically during visualization i e during creation of a Duration Info Box so they can be modified easy by end users There are 2 different kinds of summary objects summary state and summary arrow SIf the slog2 file contains numerous timelines increasing the Row Height
48. l which is used to determine the row adjustment scheme There are 2 different modes in row adjustment panel row count mode and row height mode These 2 modes can be selected by the pulldown menu at the top of the panel The row count mode attempts to keep the number of timelines constant as indicated in the Row Count text field when the Timeline window resizes On the other hand the row height mode fixes the height of each timeline as indicated by the Row Height text field Currently the height of the timeline can be adjusted up to the height of the timeline canvas in that case the Row Count text field shows a number 1 The maximum number of timelines that can be displayed is set to the total number of rows represented by the whole Y axis label tred For multiple viewmaps slog2 file the Y axis label tree can be expanded or collapsed This could change the maximum number of rows in the row count slider after user hits the CanvasReDraw button Coupling with window resize the row adjustment panel allows user to magnify or shrink the height of the timeline as one desires 3 5 Histogram Zoomable Window The Histogram window is created through clicking the statistics button located in the middle of Duration Info Box shown in Figure In Figure the histogram window is created for the whole duration of the timeline canvas in Figure i e same duration as the complet slog2 file In general the total duration of the histogram canvas is the same as the duration mar
49. mpt user to convert the file to SLOG 2 format readable by this viewer There are la low overhead native trace format from MPE 2an internal MPICH2 profiling format 16 CHAPTER 3 GRAPHICAL USER INTERFACE 3 2 LOGFILE CONVERTOR WINDOW Icon Description Function ea File Selection display a File Chooser dialog to select logfile to be processed E Logfile Conversion invoke the Logfile Convertor to convert non slog2 file to slog2 format 5 Show Legend Window display the Legend window of the selected logfile if it is hidden Show Timeline Window display the Timeline window of the selected logfile if it is hidden J Edit Preferences display the Preference window that adjusts Jumpshot s properties el Show User s Manual show the User s Manual of this program E Show FAQs show the FAQs of this program Table 3 2 Functions of the toolbar buttons Logfile Convertor CLOG SLOG 2 Input File Spec home chan slog2 slog2_logfiles cellular2d_paramesh3 clog Output File Name home chan slog2 slog2 _logfiles cellular2d_paramesh3 slog2 Executing pkgs lang java j2sdk1 4 2 jre bin java Xms32m Xmx64m jar home chan Output gt Usage java slog2 output Clog2Slog options clog_filename Output gt options note max bye size of leaf node can be specified with suffix k K m or M where k or K stands for kilobyte m or M stands for megabyte e g 64k means
50. ndow 44 CHAPTER 3 GRAPHICAL USER INTERFACE 3 6 PREFERENCE WINDOW Parameter Values Description HISTOGRAM_ZERO_ORIGIN true false Whether the time ruler is in duration i e starts with 0 0 seconds SUMMARY STATE BORDER ColorRaised Border style of Summary state when His ColorLowered togram window starts up ColorXOR WhiteRaised WhiteLowered WhitePlain Empty SUMMARY_ARROW_LOG_BASE integer The logarithmic base of the number of real arrows amalgamated in Summary arrow Hence this determines the Summary ar row s thickness Table 3 20 Parameters for the section of Histogram Zoomable Window in Preference window Parameter Values Description LEGEND_PREVIEW_ORDER true false Whether to arrange the legends with a hid den Preview order LEGEND_TOPOLOGY_ORDER true false Whether to arrange the legends with a hid den Topology order Table 3 22 Parameters for the section of Legend Window in Preference window 45 Chapter 4 Special Features 4 1 Search and Scan Facility The Level of detail support provided in SLOG 2 and Jumpshot 4 tends to help locate states which are either longer in time or occur very frequently States that are short and occur rarely in a big logfile are very difficult to locate without any special tool In Jumpshot 4 a search and scan facility is provided to facilitate this goal There are 3 search criteria search time searcha
51. on is clicked somewhere in either columns The rule of selection in the legend table follows the standard practice of other graphical user interfaces as in the Table Together with this standard selection rules the operations provided in checkbox operation menu 20 CHAPTER 3 GRAPHICAL USER INTERFACE 3 3 LEGEND WINDOW N N R message Efacar E areouce NNNNNNENNNNNENNNNNENE RI Figure 3 5 A typical Legend window when slog2 file is first loaded into Jumpshot 4 21 CHAPTER 3 GRAPHICAL USER INTERFACE 3 3 LEGEND WINDOW Pick a Color Recent Preview a O Sample Text Sample Text Cox Cancel IL E J Figure 3 6 Color Chooser Dialog for column Category Topology Legend cellular2d_paramest m Preview Arrow FG v pe message lv vi Preview_State la ALLGATHER E autrecuce Mi Jaroa la Za ZA Ad ZZ ZZ aA Creation Order Reverse Creation Order Figure 3 7 Sort Order operation menu for the column Category Name in the Legend window 22 CHAPTER 3 GRAPHICAL USER INTERFACE 3 3 LEGEND WINDOW Ordering Description A Z Dic case sensitive alphabetical ordering z 0Z A reverse case sensitive alphabetical ordering Aa Zz case insensitive alphabetical ordering 2Z 0A reverse case insensitive alphabetical ordering Creation category storage orderin
52. one by simply dragging on scrollbar s knob clicking the end buttons and in the space between the knob and scrollbar s end buttons Figure 3 10 Canvas s left mouse click is in zoom mode ee Figure 3 11 Canvas s left mouse click is in hand mode 3 4 1 1 Dragged Zoom Figure 3 12 Zoom plus cursor that indicates the left mouse clicking is ready for zooming in Dragged zoom is active only when the left mouse click is in zoom mode i e when the the magnifying glass button is pressed in the toggled buttons as in Figure In zoom mode the cursor within the canvas will appear like a magnifying glass with plus sign in the center as in Figure It is called 3Reasonable description here means that user can still get a vague sense of where the long and or frequent drawables are 26 CHAPTER 3 GRAPHICAL USER INTERFACE 3 4 TIMELINE ZOOMABLE WINDOW zoom plus cursor The dragged zoom operation is initialized by pressing the left mouse button at the beginning of the zoom in region a white line will then appear As soon as dragging is detected another white line will appear to mark the current ending of the zoom in region The region that is marked by pair of white lines is lightly shaded as shown in Figure The process can be canceled anytime by hitting the ESC key during dragging Once the left mouse button is released zooming will be carried out and the Timeline window will then be updated as in Figure 2 5 The time display panel
53. re 4 major functions of the Logfile convertor and each of them is associated with a button in the lower panel of the window They are listed in the Table Icon Description Function E Start Conversion Start the logfile conversion of the selected convertor KR Stop Conversion Stop the ongoing logfile conversion of the selected convertor Usage of Convertor Print the usage information of the selected convertor et Return Home Return to the previous component that spawns the Logfile Convertor Table 3 4 Functions of the major functions in the Logfile Convertor window Since the Logfile Convertor launches a separate java process to do the logfile conversion it requires certain parameters to launch the process correctly All the parameters that are needed by any logfile convertor are supplied through a panel hidden by a splitter in the convertor window The splitter has a divider which can be lifted up to display all the parameters used to launch the java process as in the Figure In the rare occasion that the default parameters are not correct the text fields can be modified to reflect the situation The standard output and error streams of the process are being piped to the text area located in the middle of the window as the process is running The Output File Size field displays the current size of the slog2 file as it is being generated also the progress bar will be incremented to show the current ratio of the output to
54. row which represents a collection of arrows between its 2 ending timelines The start and final timestamps of preview arrow are the extremes of all real arrows amalgamated inside the preview object Notice that the beginning or ending timestamp of a preview arrow does not necessarily mean that there is any arrow starting and ending at that times it just indicates that there are arrows starting or ending within these 2 times and between the 2 marked timelines The thickness of the preview arrow denotes the number of real arrows represented by the preview object Because of the limitation on the available thickness that preview arrow can have the thickness of the preview object is set to equal to the order of magnitude of the number of real objects amalgamated So same thickness in two different preview arrows does not mean that they contain exactly the same number of real arrows but does mean that the numbers of real arrows contained in the preview objects are within the same order of magnitude i e within a constant multiplicative factor as defined by PREVIEW ARROW LOG BASE in Preference window shown in Figure 3 27 and in Table Different thickness in preview arrows indicates more than one multiple of the constant factor difference in the number of real arrows between the preview objects The rectangle that has horizontal strips of colors is preview state The different colors inside a preview state represent the various categories of real states that ar
55. tates are amalgamated by the pure white preview state Also the text area lists all the categories of real drawables amalgamated and their ratios of the total duration of all real drawables to the duration of the preview states In this case there is only 1 category of real states in this preview state so all 136 states are all PACKs The sum of the durations of all PACKs is about half of the duration of the preview state as it is indicated by ratio 0 5021433 Another Drawable Info Box which is shown in Figure has its upper left hand pointed at a preview state that has 4 different strips of colors yellow royal blue white and purple Right mouse clicking at the yellow strip pops up a Drawable Info Box with a yellow state icon with label BARRIER As shown in the figure this preview state amalgamated 4 different categories of real states ALLREDUCE PACK SSEND and BARRIER and the statistically most significant one is BARRIER It proportionally and exclusively occupies 55 of the length of the preview state Hence BARRIER strip has the tallest height among all the color strips shown in the preview state Clicking 28 CHAPTER 3 GRAPHICAL USER INTERFACE 3 4 TIMELINE ZOOMABLE WINDOW 10 Eo 0060565 216 440893086 216 756650685 21 TimeLine cellular2d_paramesh3 slog2 lt Identity Map gt 4 Zoom Level Global Min Time View Init Time Zoom Focus Time View Final Time Global Max Time Time Per Pixel 7 0728079
56. te in the way that arrow s start and final timeline IDs may be different Event consists of only 1 point in the timeline canvas i e it has only 1 timestamp and 1 timeline ID Composite drawable is more complicated and is constructed by a collection of primitive drawabled In order to centralize the properties of drawables all the displayable attributes of a drawable are stored in its corresponding Category object e g color legend name topology and other shared description of a drawable Both the category and drawable definitions are stored in the SLOG 2 file These definitions are interpreted and displayed by the display program Jumpshot 4 One of the distinct features of Jumpshot is that it uses nested states to show the relationship of functions in the call stack i e nested states corresponds to the nested subroutine calls Current implementation of the SLOG 2 format stores some of the state nesting information to optimize the performance of the visualization program In general composite drawable can be seen as composed of other simpler composite drawables CHAPTER 2 DATA MODEL 2 2 UNDERSTANDING THE PREVIEW DRAWABLE 2 2 Understanding the Preview Drawable A preview drawable is created as a result of the renormalization process of the SLOG 2 format The renormalized object provides a high level description of what is going on within the timeline vs time region where the preview object spans Preview drawable is designed to am
57. ts the object Control click on an object toggles its selection without affecting the selection of any other objects Shift click on an object extends the selection from the most recently selected object to the current object Dragging that is moving the mouse while holding down DRAGGING left mouse button through a range of TEXT deselects any existing selection and selects the range of text CLICK CONTROL CLICK SHIFT CLICK Table 3 10 Standard Selection Rules NOTE Any changes done in the Legend window that alters the appearance of drawables won t be automatically updated in the timeline canvas until the CanvasReDraw button in the Timeline window is pressed 3 4 Timeline Zoomable Window Most of the advanced features in the SLOG 2 viewer are provided through the Zoomable window There are two zoomable windows in Jumpshot 4 Timeline and Histogram windows Figure 3 9 is the initial display of the Timeline window of a half gigabyte 16 timelines slog2 file Zoomable window consists of several concealable and removable components In the center of the window it is the zoomable and scrollable canvas For Timeline window the center canvas is called timeline canvas Directly on top of the zoomable canvas is the time display panel On top of the display panel there is the removable toolbar To the left of the canvas is the concealable Y axis label panel To the right of the canvas is the concealable row adjustment pan
58. utput_filename_with_slog2_suffix note max_byte_size_of_leaf_node can be specified with suffix k K m or M where k or K stands for kilobyte m or M stands for megabyte e g 64k means 65536 bytes Output File Size Output to Input Logfile Size Ratio 238 1918K8 191 8 KB E assi Figure 3 4 Logfile conversion in progress 19 CHAPTER 3 GRAPHICAL USER INTERFACE 3 3 LEGEND WINDOW 3 3 Legend Window As soon as a SLOG 2 file is selected in Main window and ready for visualization the Legend window like the one shown in Figure 3 5 will be displayed All the features that are going to be discussed in the Legend window affects both the Timeline and Histogram windows The Legend window contains mainly a 4 columns legend table The 4 columns are labeled as Topo Name V and S as in Table 3 6 Right Mouse Click on Col Icon Description Left Mouse Click on umn Cell or Left Mouse Column Cell Click on Column Title Topology Pick new Color Figure 3 6 None Mead Edit Name Sort Order menu Figure sY Checkbox Operations Menu Figure 3 8 Checkbox Operations Menu Figure 3 8 Visibility Check or Uncheck Searchability Check or Uncheck Table 3 6 Operations on the Legend window s columns Table 3 6 also lists out all defined mouse operations that are provided in each column The operations are 1 left mouse clicking on the column title icon and on the column cell
59. w of the region marked by the pair of white lines in Figure In Figure 2 2 some of the preview arrows have disappeared and are replaced by real arrows i e the white arrows Also some of the stripped preview states have split into several small preview states of identical color i e the white and gray states to show more detailed distribution Another important feature of preview state becomes apparent in the figures Preview states are properly nested within real states In the most expanded Y axis label view preview state is always on top of other nested CHAPTER 2 DATA MODEL 2 2 UNDERSTANDING THE PREVIEW DRAWABLE stateg i e states that enclose the preview state are alway real states A good visual example is shown in Figure 2 2 where all the white turquoise and gray preview states are sitting on top of the long orange and dark royal blue states This indicates that the white turquoise and gray real states are all nested inside the long running orange and dark royal blue states 5 Timeline cellular2d paramesh3 slog2 lt ldentity Map gt Ei Lowest Max Depth 4 Zoom Level Global Min TimeView Init TimeZoom Focus TimeView Final TimeGlobal Max TimeTime wrt 0 13 ea l 0 0060565 l6 7305343657 216 8115299986 6 8925259567 477 634607 10003299 p Cumulativelnclusion Y ap TimeLines TI aa ES A A a A ads a i A 7 E
60. x could serve a marker to facilitate the process of zooming in and out The information provided by Duration Info Box could also be used to compare different durations or to measure the total duration of a collection of subroutine calls For instance in Figure 3 18 the Duration Info Box marks all consecutive green states on the fifth timelines The Duration Info Box says the total duration of the 9 green states is about 1 74 msec Time Info Box Time Info Box is created by right clicking in the empty space in either timeline or the time ruler canvas as in Figure This Info Box is usually used as a marker for a single event in time 31 CHAPTER 3 GRAPHICAL USER INTERFACE 3 4 TIMELINE ZOOMABLE WINDOW TimeLine cellular2d_paramesh3 slog2 lt Identity Map gt Bm 4 Zoom Level Global Min TimeView Init TimeZoom Focus TimeView Final TimeGlobal Max TimeTime Per Pi 4 0 0060565 9 7512145236 398 6955230133 19 8320112543 477 634607 100016388 TimeLines An a pere 249 al _ 5 dose l l a 249 76 249 77 249 78 249 79 249 80 249 81 249 82 2411 Time seconds Figure 3 19 Time Info Box displays the time of where it pops up 3 4 2 Toolbar The buttons in the toolbar of Timeline window provides various basic services to the Timeline window Table contains the list of functionalities of the buttons found in the toolbar 3 4 3 Y axis Label Panel The concealable left panel in T
61. yze the statistics of logfile e g easy detection of load imbalance among timelines The new legend table makes manipulation of the different categories of objects easy The new viewer also provides an integrated logfile convertor for all known SLOG 2 convertible trace formats like CLOG RLOG and UTE and it attempts to conform to the standard Look and Feel that is expected by most users Chapter 2 Data Model 2 1 Understanding the Drawable The main visual component in the SLOG 2 visualization program Jumpshot 4 is the timeline canvas which is zoomable and scrollable in both horizontal and vertical axes The timeline canvas can be thought of as a TIMELINE vs TIME coordinate system Each point on the canvas is identified by two numbers a timestamp and a timeline ID The canvas is where the graphical objects contained in SLOG 2 file are being drawn on These objects are called Drawables There are 2 kinds of drawable objects They are Primitive and Composite drawables The primitive drawables are the simplest drawables and are considered to be basic elements of SLOG 2 file They are categorized based on their topological structures Currently there are 3 topologies supported in SLOG 2 They are State Arrow and Event Both state and arrow are drawables identified by 2 points in the timeline canvas i e a pair of timestamp timeline ID coordinates State s start timeline ID is the same as its final timeline ID but arrow is different from sta
Download Pdf Manuals
Related Search
Related Contents
SUP`OPERATS BLOC - Alliance E-FUN Nextbook Premium7 ...Maintenant : Mode d`emploi Avant... 1 2 3 ダウンロードファイル:1.1MB Saeco RI9913 010R - B230 Industrial IP67 Outdoor Access Point, Single RF, Dual Band, 802.11 User Manual Network 3D Blu-ray Disc™ / DVD Player - Migros Samsung CX716XD User Manual Copyright © All rights reserved.
Failed to retrieve file