Running De
Contents
1. UNMOVED Lists all files that were not moved by the most recent CONDENSE or MAKEROOM USE lt filename gt Tells De Frag X to read input from specified file USEQ lt filename gt A quiet version of USE which does not echo input VERSION Displays the current version of De Frag X ZOOM ROW COL CHUNKS lt LAST NEXT gt Displays detail info about the pages in a particular chunk from a De Frag X disk map 14 GETTING STARTED Before running De Frag X we recommend running the Hewlett Packard provided utility FSCHECK MPEXL TELESUP both before and after performing any of the data intrusive commands This program will analyze and report the status of the file system and any problems associated with file labels etc To run this program do the following RUN FSCHECK MPEXL TELESUP CHECKDIRC ALL IGNORE CHECKLABEL ALL IGNORE CHECKEXTENTS ALL EXIT OO A O N Be sure that you are not running De Frag X when you execute this program NOTE You may get a misleading error message if FSCHECK runs at the same time as De Frag X FSCHECK will also incorrectly report errors on any open files Running De Frag X To run the De Frag X program enter the following DEFRAGX DEFRAGX LPS NOTE When using any of the data intrusive De Frag X commands described later in this manual i e CONDENSE MAKEROOM DEFRAGMENT FRAGMENT CLONEDISK and TRIM you will need to be logged on with2. 2 cs0tdcadined aus PERERA 9 Database Internal Fragmentation 22222 nnneer nee 9 Commands List uuus2uu detente ER Rennen ae 11 Getting Slanted secc erario ias 15 HunnindDe FragiX AAA tea 15 PINGIVSIS carcasa utes see ne ae uate ao sides evade aa es 16 Disk CONAN vegetariana ube ea ete tease eae pee eee e ene need 19 File level Defragmentation 0 002 es 19 Disk level Defragmentation 0000 ce es 21 so ne en ana shee ene ee a era nes DE a Reber 22 FSCHECK Questions and Answers 0ooooooooooo oo nun 25 Running De Frag X in Batch 2 cee ees 27 Quick Reference Tasks Guide 0 00 cece eee 29 e AAA ORTE ene ee ben E TEE T EEE 31 INTRODUCTION Welcome to De Frag X an exciting MPE iX tool from Lund Performance Solutions De Frag X is an extremely helpful and timely product that measures up to the standards you have come to expect from Lund Performance Solutions De Frag X is available for MPE iX versions 5 5 and beyond This brief User s Guide is intended to provide a clear and concise overview of the features and benefits of the De Frag X product On line help also exists for your convenience To access the De Frag X on line help sub system simply type H or a question mark at the De Frag X gt prompt See Reference Materials on page 5 for more defragmentation information Chapter 1 lays out the advantages of using De Frag X any special precautions you shou
3. 1 H A ee ee E A PERFORMANCE SOLUTIONS WHAT YOU NEED TO KNOW WHEN YOU NEED TO KNOW IT De Frag X Disk Manager User Guide Legal Notices Lund Performance Solutions makes no warranty of any kind with regard to this manual including but not limited to the implied warranties of merchantability and fitness for a particular purpose Lund Performance Solutions shall not be held liable for errors contained herein or direct indirect special incidental or consequential damages in connection with the furnishing performance or use of this material Restricted Rights Legend All rights are reserved No part of this document may be photocopied reproduced or translated to another language without the prior written consent of Lund Performance Solutions The information contained in this document is subject to change without notice LUND PERFORMANCE SOLUTIONS 240 2nd Avenue SW Albany OR 97321 USA Use of this manual and flexible disk s tape cartridge s or CD ROM s supplied for this pack is restricted to this product only Additional copies of the programs may be made for security and back up purposes only Resale of the programs in their present form or with alterations is expressly prohibited Copyright Notices Copyright 2002 Lund Performance Solutions all rights reserved Reproduction adaptation or translation of this document without prior written permission is prohibited except as allowed under the copyright la
4. used to evaluate file level fragmentation Once you have identified the files which are fragmented beyond acceptability you can perform DEFRAGMENT commands against each selected file 19 20 DE FRAG X DISK MANAGER User s Guide Remember this is an intrusive operation and should be preceded by a backup of the affected files Figure 4 5 shows sample output of a DEFRAGMENT command performed against the file illustrated in the DISPLAYEXTENTS command in Figure 4 4 De Frag X gt defragment diskinfo sample lps File LPS SAMPLE DISKINFO Fragmentation 8 8 Extents 2 Pages 10 160 sectors will move to 18 59 838 10 done Figure 4 5 DEFRAGMENT Command Output Figure 4 6 shows the output of a DISPLAYEXTENTS command performed against the DEFRAGMENT ed file De Frag X gt displayextents diskinfo sample lps File LPS SAMPLE DISKINFO 1 extent Ldev Disk Page Pages File Page 18 59 838 fragmented 0 Figure 4 6 DISPLAYEXTENTS Command Output The DEFRAGMENT ed file is now a single extent This should guarantee optimal I O performance against that file provided that the file is accessed serially De Frag X includes two other commands TRIM and FRAGMENT that function on the file level to perform data intrusive functions The TRIM command causes unused disk space after the EOF marker on a desired file or fileset to be released When performed system wide this can recover a large amount of free space We r
5. 10007401 LOGSG CAROLIAN 10008101 LOGSG CAROLIAN 10006601 LOGSG CAROLIAN 10008300 LOGSG CAROLIAN SOSWKDEF PUB LPS TEST29 PGMS SOSDEV SLO01058 LOGFILES LPS RO009100 LOGSV CAROLIAN 10008900 LOGSV CAROLIAN 89 FRAG12 DATA DEFTEST 80 100 RO008600 LOGSV CAROLIAN 8 48 10008601 LOGSG CAROLIAN 22 51 Fragmentation by fileset Frag Pages MBs Extents Files files shown 11 192 884 753 26 304 945 files examined 0 2 870 455 11 212 39 518 12 247 Sectors savable by a TRIM files shown Space savable by a TRIM 4 378 pages 17 1 MBs files examined 180 209 pages 703 9 MBs Figure 4 3 ANALYZE Command Output partial The DISPLAYEXTENTS command abbreviated as DE allows you to see the fragmentation and extent allocation of individual files Figure 4 4 contains a sample partial DISPLAYEXTENTS output GETTING STARTED a Disk Condensing De Frag X gt displayextents diskinfo sample lps File LPS SAMPLE DISKINFO 2 extents Ldev Disk Page Pages File Page 18 41 923 17 74 981 extents in file pages in file 10 pages fragmented 8 8 Figure 4 4 DISPLAYEXTENTS Command Output Disk Condensing Let s now assume that you have completed the analysis phase and have determined to perform some maintenance against Idev 15 as well as to some files resident on that device Now you need to make a decision do you address the disk level fragmentation or the file level fragmentation first In a
6. Monday through Friday during the hours of 8 00 A M to 5 00 P M Pacific time excluding holidays Fax Number Transmit fax messages to 541 812 7611 E mail Addresses Send e mail messages to Sales Team info lund com Technical Support Team support lund com Documentation Team documentation O lund com Certified Trainers Iti lund com Consulting Team Ics lund com Lund Performance Solutions Sales Team Lund Performance Solutions professional sales team is available to answer your sales and customer support questions Monday through Friday during the hours 8 00 A M to 5 00 P M Pacific time excluding major holidays DE FRAG X DISK MANAGER User s Guide Please contact your sales representative for information about the latest Lund Performance Solutions products the Lund Software Subscription Plan upgrade options and prices and more Lund Performance Solutions Technical Support Team At Lund Performance Solutions we are working hard to provide you with intuitive software products Additionally we try to provide superior online and printed documentation However should you find yourself with a technical question that you cannot answer with the tools provided please contact our technical support team NOTE You must be a registered user to access Lund Performance Solutions support services Lund Performance Solutions support services are subject to Lund Performance Solutions prices terms an
7. info for one or all drives DisplayExtents FILE filename matchldev options or DE FLAB file_label_address options LDEV Idev entry ALL options Displays a list of extents for specified file DO prefix Executes the last command without editing DSTAT ALLdisks ONVS vsetname options DSTAT Idev ONVS options Displays an expanded form of MPE s dstat command DUMPFI file 1 lt file 2 files gt options Displays information about files found during the most recent disk analysis DUMPPF page 1 lt page 2 pages gt UNMOVED INUSE TRANsient FREE WALKLT TEMP FILENAME FILENUM Displays information about pages on the most recent disk that was analyzed ECHO text Echos the rest of the line to STDLIST ERRor Translates an error into a message using the system error message catalog EXIT Exit or FILEs lt MOVED UNMOVED UNUSABLE gt Displays file info based on De Frag X file number FINDPAGE lt ANYIdev Idev gt page page options FINDSECTOR lt ANYldev Idev gt sector sector options Find a file with an extent that includes the specified page or sector FINDSID lt ALL sid sid sid va va va gt options What objects are associated with the specified virtual addresses 12 DI Command Name amp Syntax FRAGMENT lt filename fileset gt TO Idevlist COMMANDS LIS
8. 2 2 222 Col 0 10 20 30 40 4 50 4 60 Row Available Permanent Disk 142 MB 582 096 sectors disk size 1 279 MB MAP characters Free Permanent P Transient T unmovable X part Perm p part Trans t same ldev x Figure 4 2 MAP lt ldev gt Command Output 17 18 DE FRAG X DISK MANAGER User s Guide NOTE While the MAP ALL command is limited to representing chunks of disk space no smaller than 11 4 megabytes i e 2 of the disk drive the MAP 15 command showed 1 5 megabytes for each chunk 0 12 As you can see with Figure 4 2 the disk drive is more fragmented than it would appear solely based on the MAP ALL display for that disk drive You can go one level deeper via the ZOOM command and see what each chunk contains Up to this point we have performed only disk level analysis For the sake of discussion let s assume that we have determined that the fragmentation level on Idev 15 is at an unacceptable level We know only that the disk drive itself is not at its greatest efficiency We do not as yet know whether the files on that device are fragmented There are two commands used to measure the level of individual file fragmentation ANALYZE and DISPLAYEXTENTS The ANALYZE command provides a listing of files on a system wide basis or on a drive by drive basis which are fragmented beyond a desired user defined percentage Filename Extents TrimmablP X00C0038 LOGFL CAROLIAN
9. Adager database defragmenter 9 C Chunk 16 Commands ANALYZE 17 CONDENSE 17 21 DISCFREEA 23 DISPLAYEXTENTS 18 20 FRAGMENT 20 MAKEROOM 23 MAP 17 17 MAPALL 16 TRIM 20 ZOOM 18 Contiguous Extents 7 D Database Defragmenters Adager 9 HOWMESSY 9 Database Fragmentation 9 De Frag X disk condensing 19 disk level defragmentation 21 file level defragmentation 19 free space 22 in batch 27 running 15 Disk Fragmentation 8 Disk level Defragmentation 21 E Extents Contiguous 7 Non Contiguous 8 F File Fragmentation 7 File level Defragmentation 19 Fragmentation types Database Internal Fragmentation 9 Disk Fragmentation 8 File Fragmentation 7 System Fragmentation 9 Free Space 22 FSCHECK errors 15 FAQ 25 running 15 L Lund Consulting Services 5 Lund Performance Institute 5 Lund Performance Solutions certified training 5 consultingteam 5 31 DE FRAG X DISK MANAGER User s Guide documentation team 4 main offices e mail addresses 3 fax number 3 internet URL 3 postal address 3 telephone number 3 technical supportteam 4 N Non contiguous Extents 8 R References 5 32 Robelle HOWMESSY 9 S System Fragmentation 9 Tasks Analysis Tasks 29 Data Manipulative Tasks 29 Utility Tasks 30 Technical Support 4
10. As stated above save the output from FSCHECK and contact the HP Response Center for advice Q Can I run FSCHECK in batch A Absolutely not There are situations when running FSCHECK in batch can cause system failures 25 DE FRAG X DISK MANAGER Q Is running FSCHECK mandatory before running De Frag X A No we recommend running FSCHECK for customers confidence only However we believe that it would be irresponsible for us not to recommend running FSCHECK 26 RUNNING DE FRAG X IN BATCH Included with De Frag X is a jobstream JDEFRAGX DEFRAGX LPS which can be used to run De Frag X in batch mode This jobstream is set up to perform a MAP command on each Idev before and after an execution of the TRIM command on all files and the CONDENSE commands on all drives You should modify this jobstream to reflect the particular drives on your system that you wish to MAP and or CONDENSE The following sequence of commands demonstrates the JDEFRAGX jobstream job jdefragx manager sys outclass 1 Itellop Starting JDEFRAGX Ishowtime Irun defragx defragx ips set permyes set log reset fscheck analyze map all map each trim cond all map all map each exit Ishowtime Itellop JDEFRAGX all done leo 27 QuiCK REFERENCE TASKS GUIDE Following are three tables of common tasks performed using De Frag X These three tables consist of Analysis Tasks Data Manipulative Tasks and Ut
11. PPPPPPPPpPPPPPPPPPPPPPPPPPPPPpP PPPpPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPpPPP PPPPPPPPPPPPPPPPPPPPPPPPPPPpPPPPPpPPPPpPPPPPPPPPPPPPPPPPPPPpPPPP PpPPPPPPPPPpPPPPPPPPPPpPPPPPPPPPpPPPPPPPPPPPPPPPpPPPPpPPPPpPPPPP PPPPPPPPPPpPPPPpPPPPpPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPP PPPPPPPpPPPPPPPPPPPPPPPPPPPPPPPPPPPpPpPPPPpPPPPPPPPPPPpPpPPpppPP PPPPPPPPPPPPPPPPPPPPPpppppPPPPPPPPpPpPPPPPppPPPpppppppPPPPPppPPP PPPPpppPPPPPPPPPPPpPpppPPppPPPPPPPPPPp kk d dde KKK KKK KKK KKK k k k KEKE ARAARERARARA KK AAA RARA RA RARA RA RARA RARA RA RARA RARA KARA KARA KA AAA COL O vs stories lar ir sr Available Permanent Disk 142 MB 582 096 sectors disk size 1 279 MAP characters Free Permanent P Transient T unmovable X part Perm p part Trans t same ldev x Figure 4 9 ldev 15 after CONDENSE command Figure 4 9 shows the sample output of a MAP 15 command after the CONDENSE command has been run Notice the differences between Figure 4 9 and Figure 4 2 As you can tell by examining lines 11 and 12 fragmentation is lessened by performing the CONDENSE command Free Space Every MPE iX system manager has experienced the problem of not having enough free space on a specific Idev This particularly concerns free space on Idev 1 prior to an operating system update Up to this point the process by which that additional free space was acquired was to 22 GETTING STARTED Free Space perform tedious time consuming moves of f
12. T Description Spreads file s over multiple drives HELP lt prefix gt Displays help for every command with given prefix LISTLT Lists label table for specified disk LISTREDO Displays list of approximately last 100 executed commands MAKEROOM Idev MB TO Idevlist options options are INOJCONDENSE NOJCONFIRMYES Creates specified mbytes free space on given Idev MAP lt ALL Idev gt Displays graphic summary of disk fragmentation MEMMAP lt ALL Idev EACH SUMMARY gt Shows what pages of the disk are currently in memory PAGE Reports the name of the file that contains the specified disk page if any PSCREEN PARTIAL Does a PSCREEN of your terminal REDO lt prefix gt Executes the last command after prompting for edits RESET Q option Disables the option previously set by SET command SECTOR Reports the name of the file that contains the specified disk sector if any SET Q option Enables the specified De Frag X option SSM Idev page Displays the Secondary Storage bitmap for the specified Idev and page SUSPEND Typically used within QEDIT or MPEX to suspend itself and awaken its parent process 13 DE FRAG X DISK MANAGER DI Command Name amp Syntax Description TRIM lt filename fileset gt NO JTRIM Releases unused disk space after the EOF marker
13. d conditions in place at the time the services are used E mail Tech Support Ask questions and receive detailed answers from the technical support team by sending an e mail message to support lund com Please include the product serial number with your question You will receive a reply by e mail Telephone Tech Support You can reach the technical support team by phone at 541 812 7600 Monday through Friday during the hours 8 00 A M to 5 00 P M Pacific time excluding major holidays Emergency technical support is also available after hours seven days a week When you call please be at your computer have the product documentation in hand and be prepared to provide the following information Product name and version number Type of computer hardware you are using Software version number of your operating system s Exact wording of any messages that appear on your screen What you were doing when the problem occurred How you tried to solve the problem Lund Performance Solutions Documentation Team Lund Performance Solutions makes every effort to produce the highest quality documentation for our products and we welcome your feedback If you have comments or suggestions about our online Help or printed guides send an e mail message to documentation lund com or contact your account manager INTRODUCTION Product Documentation Lund Training Institute Certified Trainers Lund Training Institute pr
14. ecommend using the TRIM command in conjunction with the CONDENSE command to free up disk space on systems where free space is a concern By doing a TRIM NOTRIM you will find out how much space will be returned by the system without actually invoking the data intrusive TRIM command The FRAGMENT command is the reciprocal of the DEFRAGMENT command It intelligently fragments i e spreads out a desired file over multiple drives in order to more equally distribute disk I O for that file GETTING STARTED Disk level Defragmentation Disk level Defragmentation The command used to perform disk level defragmentation is the CONDENSE command You can perform the CONDENSE command on a disk by disk basis e CONDENSE lt Idev gt or ona system wide basis i e CONDENSE ALL Keep in mind that except for the DEFRAGMENT up to this point you have performed only non intrusive activities While De Frag X can perform its work without a backup and with users on the system you should always have a backup before you perform data intrusive activities such as the CONDENSE command or any similar type of commands from products by Hewlett Packard or third party vendors Figure 4 7 and Figure 4 8 show sample output for the CONDENSE command used against Idev15 in the above examples The output of the CONDENSE command is similar to the output of the MAP command A notable difference between the output of the two commands is the presence of the x and X c
15. ent files t Displayed if the chunk contains mostly temporary files Displayed if predominantly free space NOTE Any MAP commands run before CONDENSE or ANALYZE will not display the x or X types Examining Figure 4 1 on page 16 the system displayed appears to be only mildly fragmented However a closer examination may be more revealing To look deeper a MAP lt Idev gt command can be used Figure 4 2 below shows a MAP 15 command issued on Idev 15 De Frag X gt map 15 15 Each chunk represents 394 pages or 1 5 MB PPPPPPPpPPPPPPPPPPpppPPPPPpPPPPPPPpPPPPPPPPPPPPPPPPPPPPPPPPPPPPP PPPPPpPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPpPPppPpPPpPPPPpppppppPppPP PPPPPPPPPPPPPPPPPPPPPPPPppppppppPPppPPPpPPpPPPPPPpPpppPpPPpPPPPP PPPPPPPPPPPpPPPPPpPPPPPPPPPpPPPPPPPPPpPPPPPPPPPPpPPPPPPPPPPPPPPP PPPPPPPPPPPPPPPpPPPPPPPPPPPPPPPPPPPPpPPPPpPPPPpPPPPpPPPPPpPPPPPP PPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPpPPP PPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPpPPPP PPPPPPPPPPPpPPPPPPPPPPpPPPPPPPPPpPPPPPPPPPPPPPPPpPPPPpPPPPpPPPPP PPPPPPPPPPpPPPPpPPPPpPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPP PPPPPPPpPPPPPPPPPPPPPPPPPPPPPPPPPPPpPpPPPPpPPPPPPPPPPPpPpPPpppPP PPPPPPPPPPPPPPPPPPPpPpppppPPPPPPPPpPpPPPPpppPPppPpppppPPPpPppPPP PPPpppPpp kpPPPPPPPpPPPPPPPPPPpPPPPPPPPPPPPPp kkkkkkkk 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2
16. esents system performance training courses at their corporate training center in Oregon and at various locations across the United States and Canada throughout the year The Certified Trainer Program is designed for trainers from all educational areas including academia consulting and business For information about Lund Training Institute or to receive an application please review our website send an e mail message to Iti lund com or contact your account manager Lund Consulting Services IT Consultants Lund Consulting Services a division of Lund Performance Solutions offers strategic IT solutions and expert support to a wide range of businesses Our team of experienced IT professionals provides onsite consulting training and project management services to help businesses optimize their computer resources and achieve long lasting success For information about Lund Consulting Services please review our website send an e mail message to Ics lund com or contact your account manager Product Documentation User s Guide This document accompanies the De Frag X Disk Manager software as a guide for the new user and as a quick reference for experienced users This guide assumes that you have a working knowledge of the MPE operating environment Online Help System In the online Help system you will find explanations of the many features of De Frag X Disk Manager as well as tips to guide you through the program s basic functionalit
17. haracters These characters differentiate between 1 regular permanent disk files 2 files which are movable but not off the current Idev and 3 files not movable at all primarily operating system files from the System Load Tape SLT The CONDENSE output and any MAP output subsequent to a CONDENSE command will show the movable and unmovable files NOTE Any MAP commands run before CONDENSE or ANALYZE will not display the x or X types De Frag X gt condense 15 Wait analyzing files Will condense ldev 15 first free page 3 129 Largest contiguous free space currently 29 636 pages 474 176 sectors Want to continue with Condense def N y Figure 4 7 CONDENSE command prompt 21 DE FRAG X DISK MANAGER User s Guide Unable to move 1 files 1 extents extents not moved other 1 Files moved 105 179 extents 10 600 pages 41 MB Biggest chunk of free space Sectors Pages MBs before 474 176 29 636 115 after 565 280 35 330 138 Figure 4 8 CONDENSE Command Output Figure 4 8 shows sample output of a CONDENSE 15 command De Frag X gt map 15 15 Each chunk represents 394 pages or 1 5 MB XXXPPPPPPPPPPPPPPPPPxPPPPPPPPPPPPPxPPPPPPPPPPPPPPPPPPPPPPPPPPPPP PPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPxPppPpppPPPPpppPppPPpPPP PPPPPPPPPPPPPPPPPPPPPPPppppPppppPPppPPPpPPpPPPPPPpPpppPpPPpPPPPP PPPPPPPPPPPpPPPPPpPPPPPPPPPpPPPPPPPPPpPPPPPPPPPPpPPPPPPPPPPPPPPP PPPPPPPPPPPPPPPpPPPPPPPPPPPPPPPpP
18. iguous or if the file consisted of a single extent If however these extents were located on 32 different disk devices then the impact of the non contiguous nature of the file distribution would be somewhat decreased by the fact that much of the disk access could be performed simultaneously over the 32 spindles Be aware that the FOO1 and FOO2 examples represent a simplified view of the internal operation of MPE iX systems There are other issues particularly multi page prefetching that play a role in the overall efficiency of disk I O on MPE iX systems Disk Fragmentation Disk fragmentation is best defined as the process by which logically related data become physically disassociated on disk Disk fragmentation can be considered a measurable current state of your data as well as the dynamic process by which such fragmentation gradually occurs Disk fragmentation is when the free space on a disk drive is spread throughout the disk in many small pieces We list this as a separate category because the more fragmented a particular disk device is the more impact there is on overall system performance Additionally the more fragmented a particular disk device is the harder it is for certain important system functions to be System FRAGMENTATION CONCEPTS System Fragmentation performed on that device For example let s say that LDEV 1 the system disk has 1 000 000 sectors of free space but is so fragmented that the largest free chunk
19. iles De Frag X has a command MAKEROOM which is specifically intended to simplify that process For example Figure 4 10 shows the DISCFREE A output of a sample Idev 16 LDEV 16 U2 MEMBER5 LARGEST FREE AREA 262144 TOTAL FREE SPACE 652672 CONTIG SECTORS 0 SECTORS O BLOCK S OF 1 9 22 12 3 3 BLOCK S OF BLOCK S OF BLOCK S OF BLOCK S OF BLOCK S OF 10 100 1000 99 999 9999 10000 99999 CONTIG CONTIG CONTIG CONTIG 100000 AND UP CONTIG SECTORS SECTORS SECTORS SECTORS SECTORS 7776 7648 28240 110224 498784 SECTORS SECTORS SECTORS SECTORS SECTORS Figure 4 10 DISCFREE A Command Output This drive has available 998384 sectors of free space Let s say an additional 300 megabytes of free space is needed Figure 4 11 shows output to the MAKEROOM command required to make this available De Frag X gt makeroom 16 20 Will use the following ldevs as destinations 13 165 MBs avail 12 avail 18 136 MBs avail 10 avail 14 117 MBs avail 9 avail 15 80 MBs avail 6 avail 12 77 MBs avail 6 avail 17 71 MBs avail 5 avail 11 69 MBs avail 5 avail Wait analyzing files Will make room on ldev 16 Want to continue with MakeRoom def N y Figure 4 11 MAKEROOM Command Output 23 FSCHECK QUESTIONS AND ANSWERS Q What is FSCHECK A FSCHECK is a utility provided by Hewlett Packard to look for corrupted file labels and other file syste
20. ility Tasks More detailed information about all of these commands is available in the Commands List in Chapter 3 in the on line help facility within De Frag X or in the De Frag X User Reference Manual available from Lund Performance Solutions Analysis Tasks Description Measure fragmentation on all disk drives De Frag X Command Sequence MAP ALL Measure fragmentation on one disk drive MAP lt Idev gt where Idev is desired logical device or MAP EACH will map each Idev Measure fragmentation on one chunk of a MAP output ZOOM ROW lt row gt COLUMN lt column gt where row and column dictate the chunk s position in the MAP command output Find fragmented files on all disk drives ANAlyze MIN where is the minimum fragmentation percentage to report Find fragmented files on one disk drive ANAlyze lt Idev gt where Idev is desired device Find fragmentation within a particular file DisplayExtents lt filename gt Counts the files on each disk COUNT Files lt EACH gt Data Manipulative Tasks Description De Frag X Command Sequence Measure fragmentation on all disk drives MAP ALL Remove disk level fragmentation on all disk drives CONDense ALL Remove disk level fragmentation on one disk drive CONDense lt Idev gt where Idev is desired device Create a desired amount of additional free space on a particular disk drive MAKEROOM lt Idev gt
21. increasingly important that MPE iX system managers maintain a tighter ship from the perspective of I O performance DE FRAG X DISK MANAGER Advantages Some of the advantages of using De Frag X center around the fact that to date Hewlett Packard does not provide the ability to perform similar functionality for MPE iX systems MPE iX systems as of release 5 0 of the operating system will have available a CONTIGVOL command in the VOLUTIL utility program This command only addresses issues of contiguous free space and has some limitations at that It is by no means a comprehensive fragmentation utility product like De Frag X Although De Frag X can perform its functions while users are actively engaged in application work you may find some files that users have opened for work may very well be those files which require the most maintenance from a defragmentation standpoint If this is the case there is no other option than to bring those users off the system back the files up and then perform the defragmentation maintenance Special Precautions While we at Lund Performance Solutions have developed the De Frag X product with the highest regard for the integrity of user data it is very important to understand that we are performing tasks which are considered privileged in nature and are not available through Hewlett Packard supported file system interfaces Because of this and we cannot stress it enough be sure to perform system backup
22. is 13 000 sectors In the event of an operating system update MPE iX requires a certain amount of contiguous free space on LDEV 1 If the required amount of contiguous disk space is not available you will be unable to perform the update without intervention That intervention may now take the form of a simple execution of the TRIM and CONDENSE commands If you still do not have enough free space for the update you can use the MAKEROOM command to make as much room as necessary NOTE The amount needed may change from release to release of the operating system Also it is commonly thought that a lack of free space throughout a system can cause performance problems There is a role for fragmentation in this same scenario In other words there is a fundamental level of free contiguous free space required on your system below which you must not go Fragmentation System fragmentation is yet another extension of file fragmentation This is the perspective by which you must consider your whole system This would include a file level perspective a disk level perspective a volume set level perspective and a complete system level perspective Database Internal Fragmentation Database fragmentation is fragmentation within the skeletal structure of a DBMS such as Turbo Image While specific internal DBMS fragmentation is outside the scope of De Frag X all DBMS s exist on top of the MPE iX file system This means that there is still significant im
23. ld take before running De Frag X and where to look for product support Fragmentation Concepts on page 7 addresses the types of fragmentation issues commonly found in the MPE iX world If you have any doubt that fragmentation issues affect system performance simply analyze your system s performance perform defragmentation and re analyze your system s performance You will then be able to objectively quantify the effect of disk fragmentation on your system s performance Overview Lund Performance Solutions is in the business of providing software consulting and training in the Hewlett Packard system performance arena As such we have examined literally hundreds of MPE iX systems While it is true that there have been significant strides made in the I O performance of MPE systems MPE V systems have significant I O bottleneck issues it is not true that disk I O bottlenecking is a thing of the past A purist may say that all I O issues on MPE iX systems disappear with sufficient main memory resources This may be true in the theoretical realm but in practical application this concept isn t entirely true As MPE systems have grown the application environment has grown enormously It is not uncommon to see systems with millions and millions of records of application data We have seen systems with as many as 100 disk devices As such the ratio between disk storage and main memory has actually increased significantly Therefore it is becoming
24. lt mb gt where Idev is the desired device and mb is megabytes of free space at add 29 User s Guide Data Manipulative Tasks Description DE FRAG X DISK MANAGER De Frag X Command Sequence Remove fragmentation within a particular file fileset DEFRAGment lt filename fileset gt Release unused space after the EOF on a particular file fileset TRIM lt filename fileset gt Balance the set of Idevs in the volume set specified BALance lt Idev gt where Idev is the device to be balanced Fragments the specified file s FRAGment lt filename fileset gt Utility Tasks Description Measure fragmentation on all disk drives De Frag X Command Sequence MAP ALL Measure fragmentation on one disk drive MAP lt Idev gt where Idev is desired logical device or MAP EACH will map each Idev Measure fragmentation on one chunk of a MAP output ZOOM ROW lt row gt COLUMN lt column gt where row and column dictate the chunk s position in the MAP command output Find fragmented files on all disk drives ANAlyze MIN where is the minimum fragmentation percentage to report Find fragmented files on one disk drive ANAlyze lt Idev gt where Idev is desired device Find fragmentation within a particular file DisplayExtents lt filename gt Counts the files on each disk COUNT Files lt EACH gt 30 INDEX A Adager Corporation
25. m problems Q Why do we ask users to run FSCHECK before running De Frag X A MPE iX systems may have corrupted file labels that the system manager may be unaware of Corrupted file labels can remain undetected for years especially if no one ever attempts to access those files Some types of corrupted labels won t even show up if you do access the files De Frag X is extremely cautious with your data If it detects anything wrong with a file it will skip over that file and report the error In fact De Frag X checks for these errors and more and using a Hewlett Packard supported utility will satisfy the Response Center requirements for proof of a problem Q FSCHECK reported several or hundreds or thousands or of errors that look like this WARNING FILE LABEL CORRUPTION DETECTED FOR 153 91 File label virtual address of corrupted file is 000000D1 00061 200 What s wrong A FSCHECK reports this particular error 153 91 when it encounters any open files You can safely ignore this error Note that you really should run FSCHECK when NO other users or jobs are running Q What should I do if FSCHECK encounters any other kinds of errors A Save the output from FSCHECK and contact the HP Response Center for advice Q Should I use the FIX option within FSCHECK to correct any errors reported A NO The HP Response Center says that you are in great danger of damaging your system if you try to use FSCHECK to do repairs
26. n of all the disk drives on your system This helps to give you an idea of the level of disk fragmentation on a global system wide basis Each character in the display represents a chunk of disk space The chunk size represents 2 of the disk drive and therefore varies based on the size of the disk drive for which it is reported For example on a 571 megabyte disk drive a chunk is equal to approximately 11 4 megabytes On a 670 megabyte disk drive a chunk is approximately 13 4 megabytes NOTE The word chunk is used here for purposes specific to the De Frag X product and has no technical meaning or merit outside of a discussion about De Frag X Chunk is not a standard HP e3000 term and thus will not be familiar to people outside of this context The character used to label each chunk identifies the predominant nature of that disk space The following list shows all the MAP label characters and their significance X Displayed if there is any unmovable file present in the chunk This preempts all other designations x Displayed if there are any Idev specific i e specified for a given drive files This pre empts all other designations except X GETTING STARTED Analysis P Displayed if the entire chunk contains permanent files T Displayed if the entire chunk contains temporary transient files The following three designations are displayed only when none of the above apply p Displayed if the chunk contains mostly perman
27. pact of defragmenting Turbo Image data sets at the file level In other words given the database TRXDB1 you should still defragment the individual files of TRXDB101 TRXDB102 TRXDB103 etc It should still be said that the internal fragmentation of data within a DBMS is still a critical performance issue Tools such as DBLOADNG from the INTEREX Contributed Library or HOWMESSY from Robelle were created to measure the internal fragmentation of Turbo Image databases Included with any Lund Performance Solutions product is a copy of the DBLOADNG program courtesy of INTEREX Additionally a product such as Adager from Adager Corporation has the ability via the DETPACK command to actually fix DBMS level fragmentation on Turbo Image databases Information about this product can be obtained from a Lund Performance Solutions representative see Product Support on page 3 or directly from Adager at 1 800 533 7346 For more information regarding Turbo Image database performance issues refer to Taming the HP3000 Volume 2 by Robert Lund available from Lund Performance Solutions COMMANDS LIST The following is an alphabetized listing of the commands available within De Frag X More detailed information about these commands is available in the on line help facility and in the De Frag X User Reference Manual available from Lund Performance Solutions NOTE Commands flagged with an asterisk are data intrusive DI A backup of your sy
28. perfect world it would be desirable to perform file level defragmentation before performing disk level defragmentation This would insure that individual files are as contiguous as possible Performing disk level defragmentation first will consolidate the scattered chunks of free space on the drive but won t necessarily consolidate scattered chunks of the same file together In some situations however there could be a need to perform disk level defragmentation first For example you may have to perform a disk condense in order to have enough room for efficient defragmentation of a particular file The variables surrounding the answer to this question are The amount of free space available The size of the disk file you wish to defragment The nature of the disk file you wish to defragment For example one of the rules regarding individual file defragmenting is that the file cannot be more than half the size of the disk drive on which it resides This is because it is a current requirement of De Frag X that any file that is to be defragmented must remain on the same disk drive For ease of discussion and to more quickly introduce you to the global capabilities of De Frag X we will begin by addressing file level defragmentation File level Defragmentation Before you attempt to perform the CONDENSE command against all selected disk drives you need to consider the issue of file level fragmentation Once again the ANALYZE command is
29. s before executing any of the data intrusive De Frag X commands Additionally we recommend that you run the Hewlett Packard provided utility FSCHECK MPEXL TELESUP both before and after performing any of the data intrusive commands This program will analyze and report the status of the file system and any problems associated with file labels etc NOTE You should run FSCHECK when NO other users or jobs are running To encourage this practice of running FSCHECK first De Frag X programmatically restricts data intrusive functions if FSCHECK was not run first You may override this restriction by using the RESET FSCHECK statement before executing any of the data intrusive commands Please see FSCHECK Questions and Answers on page 25 for more information regarding FSCHECK INTRODUCTION Product Support Product Support Lund Performance Solutions Main Offices When you purchase support from Lund Performance Solutions you benefit from the knowledge and experience of our technical support team We are glad to help you interpret data and resolve performance issues Our contracted product support entitles you to receive timely updates bug fixes documentation and direct technical support Postal Address Lund Performance Solutions 240 2nd Avenue SW Albany OR 97321 USA Internet URL Visit the Lund Performance Solutions website at http www lund com Telephone Number For customer and technical support call 541 812 7600
30. stem is recommended before using the data intrusive commands DI Command Name amp Syntax Description ANAlyze Idev fileset options Reports file level fragmentation options NOJSIZE NOJSORT MIN LDEV iS ages extents etc NO SUMMARY PAGES lt PAGES gt tt pages ex NEEDTRIM NOJTRIM Default SIZE NOSORT MIN 1 SUMMARY BALance lt idev ONVS vsetname gt options Balances set of Idevs in specified options EXCEPT Idevlist volume set NoJCONFIRM nNoJFAST no LOGcopy no Quiet no VERbose no WALKIts no Yes INOI CHECKFILE lt file fileset gt FIXGID YES NO Examines the specified files for non O GroupID CLEARREDO Clears redo command stack CLONEdisk source_ldev TO destination_Idev ALLOWbigger Copies every bit of data from one disk to another CONDense lt ALL Idev gt lt CONFIRM NOconfirm YES gt Disk level defragmenter 11 DI DE FRAG X DISK MANAGER User s Guide Command Name amp Syntax COUNTFiles lt Idev ALL EACH volumeset gt Description Counts the files on one or all disks DEFRAGment lt filename fileset gt NO TRIM YES NO File level defragmenter DISC ALL Summary DETAIL ONVS vsetname BYVS DISCfree Idev Summary DETAIL ONVS Idev Summary DETAIL ONVS or DISK same as DISC DISKFREE same as DISCFREE Displays miscellaneous
31. system manager SM capability 15 DE FRAG X DISK MANAGER Analysis 16 The first step in using De Frag X is to analyze the current nature and level of fragmentation on your system To do this use the MAP ANALYZE ZOOM and DISPLAYEXTENTS commands The MAP command gives a graphic representation of the nature of disk level fragmentation on your system Figure 4 1 shows the output of aMAP ALL command on an 18 drive system De Frag X gt map all Disk Size of Available Size chunks disk usage map PermMBs MBs MBs PPPPppPppPppppPPPPPPPPPPPPPPPP PPPP pp pp p p 347 1 292 25 PPPPpppppppppppppPPPpPppppPPPPPPPPPPPPPPPPpppPPPPp 49 1 292 25 PPPPppppppPpPPPPPPPpPpPPppPPpppppPpPPpPPPPPPPPPPPP PP 119 1 279 25 PpPPpppPpPppPpPpPPpppPPPpPppPpPPPPPPPPPPPPPPPP PPPP 93 1 279 25 pPPPppPPPPppPPPPPPpPPPPPPPpPPpppPPPPPPPPPPPPPPPPP 102 1 279 25 pPPPPppppppppPPPppppPpppPPPPPpPppPpPpppppppppPp p 119 1 279 25 pppPpPppPppppppPpppPPPpPPPpppppppPPppPPPPPPPP PPPpPp 112 1 279 25 PPPPppPPpppPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPP p 111 1 279 25 pPPPpPPppppPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPP PPPp 103 1 279 25 LPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPP 117 1 279 25 MAP characters Free Permanent P Transient T unmovable X part Perm p part Trans t same ldev x DDDADA AHN AWA YO Figure 4 1 MAP ALL Command Output As you can see the MAP ALL command creates a visual picture of the fragmentatio
32. the file system doesn t have to obtain 100000 80 bytes of available contiguous disk on a single disk drive Rather it has only to obtain 100000 80 32 of available contiguous bytes of disk initially Additionally you only lose the availability of 100000 80 32 bytes of disk space at build time You will acquire the rest of the disk space only as required as your application adds records to the file As you can see these are significant advantages MPE iX system users must have and cannot live without these advantages especially in these days of true mainframe equivalent HP e3000 environments However the disadvantage to building FOO2 in this manner can become apparent when subsequent extents are allocated If the extents are allocated contiguously then there will be no performance degradation There is some slight overhead associated with multiple extents resulting from more label table activity but it is negligible in terms of any performance impact If however the extents are allocated non contiguously there can be significant performance impact Let s examine these ramifications Taking FOO2 as our example we ll look at the worst case extent allocation scenario If the worst possible allocation occurs the FOO2 file will be located in 32 separate non contiguous areas of disk on one disk device This means that a serial read of this file could result in 32 times the amount of physical disk accesses required than if all extents were cont
33. ular disk device In addition this allows us to build files which exceed the capacity of the largest disk drive available A performance cost occurs when a file s extents get spread out over the disk devices This can present significant performance issues For example let s assume you build a file using the following file build BUILD FOO1 REC 80 F ASCII DISC 100000 1 1 This will build the file FOO1 with space for 100000 records in one physical extent and allocate all that disk space immediately The advantage of this is that you are guaranteed to have all of the records that will ultimately go into this file physically contiguous on disk The disadvantages are that you must have 100000 80 bytes of available contiguous disk on a single disk device and you must lose the availability of all of that disk space up front perhaps long before it is needed Non contiguous Extents DE FRAG X DISK MANAGER User s Guide Now consider the following file build BUILD FOO2 REC 80 F ASCII DISC 100000 32 1 This will build the same file with a few differences By specifying the 32 in the DISC parameter we are telling the operating system to break this file up into multiple extents The exact number is not controlled on MPE iX The 1 in the DISC parameter tells the operating system that we only want a portion of the file allocated up front In general MPE will allocate about 1 32 of the file at that time The advantage of this is that
34. ws Printed in the United States of America Trademark Notices De Frag X Disk Manager Developer s Toolbox and System Manager s Toolbox Forecast Capacity Planner Intact Dynamic Rollback Intact D R Performance Gallery Performance Gallery Gold SOS 3000 Performance Advisor SOS 9000 Performance Advisor SOS SOLARIS Performance Advisor Q Xcelerator Resource Manager and Shadow Data Replicator Shadow D R are trademarks owned by Lund Performance Solutions in the USA and other countries Other brands and their products are trademarks or registered trademarks of their respective holders and should be noted as such De Frag X Disk Manager version C 03 Whitney Olsen Laura Bryngelson Rodica Popa 03152002 TABLE OF CONTENTS Chapter 1 Chapter 2 Chapter 3 Chapter 4 Appendix A Appendix B Appendix C IH OOUCHON zent aos eds es oe 1 OVETVIEW sb a aa css adas pto dada ae 1 PON AINA CS ire sp peas eso o o lr ean bie e E oe he gees 2 Special PrecaullonsS oee 240240028 2200 20a 40 wes 0 naar ns 2 Product SUDDOM 24 25208 ER ER 3 ProductiDOCUMEeNIGION eu nera ie bee de goede Sod eee ee nee ee we Pee Bes 5 Weer SU sosa ee be ew oo a a ee ee ae ee 5 Online Help System 0 0 0 0 cc tenet eens 5 Reference Materials x2 2264 cdc dna a a ae a bbws dee ha ad 5 Fragmentation ConceptS 0000 eee eee eee 7 PGP GOMEN UN csi sea gee menge 7 Disk Fragmenta dess asha suda 2 40 SA aaa ae een 8 System Fragmentation
35. y Reference Materials Taming the HP3000 Volume 2 Copyright 1992 by Robert Lund Albany Oregon USA SOS 3000 Performance Advisor for MPE iX systems User Manual Copyright 1999 2000 by Lund Performance Solutions Albany Oregon USA For additional information regarding fragmentation problems and corrections go to the Allegro web site www allegro com papers fragmentation html FRAGMENTATION CONCEPTS There are four types of fragmentation found on HP e3000 MPE X systems e File Fragmentation e Disk Fragmentation e System Fragmentation Database Internal Fragmentation File Fragmentation Within the context of disk fragmentation is the concept of a file extent File fragmentation occurs when a file s set of extents becomes physically discontinuous on disk The impact of file fragmentation is determined by the severity of fragmentation the adequacy of main memory the speed of disk devices and the efficiency of MPE iX s built in pre fetch mechanism Contiguous Extents A file on an MPE iX system can be broken up in to pieces known as extents These extents do not need to be next to each other on a disk nor do they need to be on the same disk drive This allows the file system to have very large files up to four gigabytes but not require that all the space be physically contiguous on the disk drive A file which is contiguous means that all its extents are next door neighbors on a partic
Download Pdf Manuals
Related Search