Home

DataCheck

1. 72 Log Item Definitions Error Number Description Detail Action 118 Bitmap Error Data for Record lt 1 gt There was a problem processing the bitmap for the the given record Most likely this means that this object overlaps another object Check previous items to see the actual situation Follow directions for the previ ous items Most likely you ll be doing a 4D Tools Compact 119 Bitmap Error Node for Index Node lt 1 gt There was a problem processing the bitmap for a node in this index Most likely this means that this object overlaps another object Check previous items to see the actual situation Follow directions for the previ ous items Most likely you ll be doing a 4D Tools Compact 120 Bitmap Error Second ary Address Table lt 2 gt for Table lt 1 gt There was a problem processing the bitmap for the secondary address table for this table Most likely this means that this object overlaps another object Check previous items to see the actual situation Follow directions for the previ ous items Most likely you ll be doing a 4D Tools Compact 121 Cannot read Primary Address Table for Table lt 1 gt There was a problem processing the bitmap for the primary address table for the given table Most likely this means that the object overlaps another object Check previous items to see the actual situation Follow directions for the
2. etect lt is suggested that Be gware that 40 tod Reported item and matching explanation 34 DELGTO i o mole E aii Log Entry Explanation invoices Data 10 27 96 2 35 PM when the scan began on what data file it was run Indices shows the group that the items below belong to Taxes Code 7 shows the index name and its number only useful for reference within DataCheck Error Index 17 represents the same field as this index the item number generated for the index 148 the item number which matches to the item numbers at the bottom of the log For each item reported in the log an explanation of that item type is included at the bottom of the log Additional information about all reported items is included in Log Item Definitions on page 52 Using the Start Pause Resume Button One button allows you to start pause and resume the processing of a data file If your scan is currently running then the button will say Pause If you have pressed the Pause button then the button will say Resume If you press the Resume button the scan will continue where it left off When the scan is complete the scan button will say Start as it does above If you close the window or quit the application the scan will be stopped you will be asked before terminating the scan 35 DataCheck Runtime This chapter
3. 125 Bitmap Error Index Headers There was a problem processing the bitmap for the index headers Most likely this means that this object overlaps another object Check previous items to see the actual situation Follow directions for the previ ous items Most likely you ll be doing a 4D Tools Compact 126 Space incorrectly claimed pos lt 1 gt size lt 2 gt DataCheck builds a bitmap while it is processing your data file This bitmap represents all spaces on disk that are used This bitmap is then compared against the bitmap that 4D has kept for your data file If the two do not correspond then either this item or item 127 is gener ated When this item is gener ated it means that 4D has claimed that a space on disk is being used however DataCheck could find no object that claims that disk space This means that the disk space is unused and will never be used it is dead space in your file This will cause no problems However if the sum of these items becomes large you may wish to do a 4D Tools Compact to help save disk space Note however that doing a 4D Tools Compact will create extra unused space unless you have done a Force Drop All Indices before hand So the proper procedure would be 1 Force Drop All Indices 2 run 4D Tools Compact 3 open data file with 4D to re index 127 Space should be claimed pos lt 1 gt size lt 2 gt DataCheck builds a
4. ous deleted record lt 2 gt The given record was found to be in the deletion chain Since it is an active record it should not be in the deletion chain Duplicate this record and then delete the record that is causing problems 171 Deleted record lt 1 gt offset lt 2 gt size lt 3 gt DataCheck has deleted the given record This is informational 172 Cannot delete records in table lt 1 gt until all indices have been dropped from the table DataCheck cannot delete records from a table until all indexes for that table have been dropped This is due to the fact that DataCheck cannot delete records from the index and reor der the index b trees accord ingly Drop the indexes for this table rerun DataCheck rebuild the indexes 173 Loop in deleted record chain DataCheck has found that the deleted record chain loops on itself This situation will cause crashing within 4D in many cases Actions 1 Export all data in this table then Force Delete the table then reimport the data then run Fix Bitmap warnings or 2 Export your data to disk create a new data file import all data The first option is a little more work but means you only dump the one table and start over on that table The second option is less work on your side you dump everything and reload everything but may take much longer to do in real time 174 Table was forcibly dropped You must
5. Being acted upon may mean scanning the records or dropping the index depending upon the options you have chosen for the scan e gt Constants Incidents a ID Humber Summary Description E Client F latform Operating System Product The green dot button will allow you to turn all green buttons on or turn all green buttons off The logic is as this if you press the button and all green dots are on then they will all turn off But if you press the button and ANY of the green dots are off then they will all turn on When you press the green dot for a table all fields and subtables will be affected This is for your convenience Please see Multiple Indices per Field item 48 on page 38 for additional information about using this feature 26 Configuring DataCheck Understanding the Structure Area This area of the screen shows you the structure of your data file gt Constants amp Incidents ID Number Summary Description Client Platform Operating System Product Product Version Status E Open date Closed date 40 Version 40 Server Version 40 Compiler Version gt Calls gt Clients gt Seqho gt Error_Codes gt Unused The items in bold are indices the items in brackets are tables By pressing the green dots you can select the given table or index to be acted upon during the scan These selections are saved in the run file For example
6. before it tries to read the table This item is generated if the veri fication failed You should recover by TAGs 114 Bitmap Error Table Information Table There was a problem processing the bitmap for the table informa tion table Most likely this means that the table information table overlaps another object Check previous items to see the actual situation Follow directions for the previ ous items Most likely you ll be doing a 4D Tools Compact 115 Bitmap Error Primary Address Table for Table lt 1 gt There was a problem processing the bitmap for the primary address table for the given table Most likely this means that this object overlaps another object Check previous items to see the actual situation Follow directions for the previ ous items Most likely you ll be doing a 4D Tools Compact 116 Bitmap Error Bitmap blocks There was a problem processing the bitmap for the bitmap blocks Most likely this means that this object overlaps another object Check previous items to see the actual situation Follow directions for the previ ous items Most likely you ll be doing a 4D Tools Compact 117 Cannot read Bitmap for file lt 1 gt The bitmap table for the data segment file could not be read into memory Verify that this is the right data segment Verify that 4D cannot open the file If both fail then you should do a 4D Tools Com pact
7. one to run each night of the week where each file scans different parts of a data file Getting a Quick Start You might also create a run file to send to a client of yours If they have DataCheck or DataCheck Runtime they can also open the RUN file and your configuration will be set for them to easily run ParseAudit run Structure Parse Audit TRIC lt Automatic gt 4 Data File Parse Audit data Ignore Below Info Indices Records IM Scan Indexes rane Lj Modify Indexes wi Verify Record Number C Drop Selected Indexes L Detailed Statistics E Scan Indexes _ Force Drop All Indexes must be unchecked Drop Damaged Indexes C Interactive Default All Pages gt Constants gt sample Refer to Configuring DataCheck on page 16 for more information about setting up a DataCheck scan Configuring DataCheck Configuring DataCheck This chapter shows you how to configure DataCheck Registering DataCheck DataCheck will run in Demo mode unless a valid registration num ber is entered A registration number is provided at the time you purchase DataCheck To enter a registration number 1 Launch DataCheck 2 Choose Register as Runtime or Register as Developer from the File menu 3 Enter the registration number you received when purchasing DataCheck 4 Click the OK button Using the Configuration Dialog DataCh
8. tables are read in one shot by DataCheck If it can t read all of them then it bails assuming that there is severe damage This item is then generated Recover by TAGs 102 Too many records table lt 1 gt claim lt 2 gt A table can only have 16777215 records If the number of records is greater than this then there is some damage in your table infor mation table for the given table You should recover by TAGs 69 Log Item Definitions Error Number Description Detail Action 103 Too many SAT entries table lt 1 gt claim lt 2 gt max 4096 There can only be 4096 second ary address table entries in the primary address table There is most likely some damage in the table information table You should recover by TAGs 104 Bad bitmap block num ber got lt 1 gt max lt 2 gt There is a constant number of bitmaps blocks in the database In version 3 5 that number is 4096 If DataCheck tries to access a bitmap block that is outside of this range then this item is generated Most likely there is damage in the bitmap which should be fixed via 4D Tools Compact 105 Can t load bitmap block file position lt 1 gt The bitmap block could not be loaded from disk The block con tains ones and zeros that describe what parts of the file are free for usage If the bitmap block can t be found then you need to fix this problem
9. the Incidents table has the ID Number and Open date fields selected However the Client field and the entire Calls table is not selected and so they will not be acted upon during the scan The Special Menu DataCheck v2 introduces three new views of your data a Disk Map a record and index Browser and a Table Editor Disk Map This view shows a layout of the disk page by page You can view some of the data in this map by selecting it and pressing the View 27 Configuring DataCheck button This can be helpful for looking at the fragmentation of your data If you notice serious fragmentation of your data you might get better performance by performing Compact using 4D Tools The three Speed settings 1 Ludicrous no idx rec bmap 2 Fast guess index rec size 3 Exact slow Disk Map Conta cts data S ginent speed Page 11 Selected Record Detail Record 1 Table 2 People Offset 151168 Ox24E80 Size 158 These settings allow you to view the map in varying degrees of 28 Configuring DataCheck granularity depending upon how long you re prepared to wait for the map to be generated The fastest setting skips the indices records and bitmap to provide an approximation of the disk map while the second setting makes an approximation of the index and record sizes Details on any selected part of the map will be displayed in the Selected region and if it is a record
10. then one of two things will happen a if the bitmap claims that space is used but it isn t then you will have a larger data file than necessary but it won t cause any problems with regard to the running of your data file This is a common occurance in data files and should not concern you Only if the size of the unused space becomes large should you consider actions to remove these items b if the bitmap doesn t claim some space that is being used then you will have future problems as you use this data file As 4D allocates space it will use space that is already in use and you will have data corruption This type of scenario should never happen and if it does you should attend to it as if your data base had just crashed it is very serious Zero all empty This feature allows you to wipe out all unused space in your data file space This protects against old data creeping into your data file when using Recover by TAGS and could also be used if a deleted record contained sensitive data This feature deletes all unused space it doesn t matter what the space used to be used for it gets zeroed out if it s not currently in use Fix bitmap warn This feature will change the bitmap to reflect what exists in the data file ings Configuring DataCheck s Cj Scan for Deleted Records pt Oe tee te _ Interactive C Undelete g IE port Allow Errors Allow Errors undeleted You can always ex
11. 1 file 1 alpha field 2 Index the field 3 Add random ASCII data build strings of random length with ran dom characters 4 Run DataCheck If you add enough random data you ll eventu ally see a failure 5 Search by index for data that DataCheck is describing as not found 39 Advanced Topics Note that 4D cannot find the data either Drop index in 4D Rebuild index Search for data and note it is still not found Note The index will never be correctly built COON Configuring DataCheck Memory DataCheck should run most data files in it s default fifteen mega bytes of memory DataCheck does not check to see how much memory is available and allocate all of it this is a bad practice as in future OSes virtual memory will do away with partitions and this type of code would not behave well So DataCheck allocates buff ers for address tables and index blocks and record blocks using a greedy algorithm based on the number of index nodes and records Using 4D to run DataCheck Using the new Automate options within DataCheck you can now use 4D to trigger a run of DataCheck DataCheck still requires that the structure data files are closed by 4D ie that 4D is not running However you can ask DataCheck to launch from within 4D and DataCheck will do it s scan and re launch 4D Using Macintosh it s best to use an AppleScript to bring down 4D and Launch DataCheck If you have configured the RUN f
12. 55 Invalid address in address table The address in the address table was not read from disk due to the fact that it was bad Look at previous items to dis cover the block that could not be read Look at following items to find out what module was attempting to use this address table and deal accordingly For example if it is an index drop the index 56 Bad TAG tag lt 1 gt DataCheck recognizes three types of TAGs If any other TAG is read in when the record is pulled off of disk then DataCheck will complain If you have a new version of 4D check with Technical Sup port to verify that a new TAG has not been added to 4D that this version of DataCheck doesn t recognize Otherwise you ve got a damaged record You should delete the record and re enter it You know the record from the record number which is generated in a later item 57 Bad record number got lt 1 gt expected lt 2 gt There is a list of all records in your database This list is the address table The first entry in that list is the first record record number 0 the next record in that list is record number 1 and so on The record number is also stored in the header of the record on disk If the two num bers mismatch then this item is generated You most likely have a dam aged record and you should recover by TAGs 61 Log Item Definitions Error
13. This enables you to send preconfigured run files to your clients with out worrying that they will click the wrong option and drop all indices on their enormous data file If you want them to drop a particular index create a run file that does this and email it to them They just open select the right structure and run files and press scan The log file looks exactly the same as the full version of DataCheck Licensing the Runtime Version The DataCheck Runtime is licensed per machine If you wish to dis tribute DataCheck with a commercial product contact Committed Software for special pricing information 37 Advanced Topics Advanced Topics This chapter discusses advanced topics related to DataCheck Terms used in this chapter are defined in the Glossary on page 48 Multiple Indices per Field item 48 Sometimes 4D creates more than one index for any given field Worse than that is that 4D Tools reads and validates the first such index and 4D uses the last index for any given field This means that in a multiple index situation 4D Tools cannot diagnose the index and 4D itself has problems dropping it When these situa tions arise your best bet is to select the index and only that index by pressing the green dot button the one above the Structure area until all indices are turned off Then press the dash next to the index you wish to delete which selects that index Press Drop selected indices and run the
14. all subtables text and picture data Various integrity checks are done along the way to verify that the record is not damaged Verify Index slow When this option is selected each field that is indexed in each record is searched for in the index It guarantees that all data can be found in your indices and stresses the index to the max If any piece of data cannot be found it is reported This test can take a long time depending upon the size of your indices But there are some situations that can only be found using this option and it is suggested that if you can you always use it and if it takes too long that you find a way to use it periodically Find NANs NAN Not A Number This occurs in real data types and is due to a divide by zero or sqrt 1 etc Find Alpha Gem Finds Gremlin characters as definied in the Alpha Gremlin Map dialog The default settings are for English language users of DataCheck and for normal use The difference between Alpha and Text is that it is nor mal for Carriage Return and Line Feeds to appear in text but not in Alpha There may be other differences you d like to add Find Text Gem lins Finds Gremlin characters as definied in the Text Gremlin Map dialog The default settings are for English language users of DataCheck and for normal use The difference between Alpha and Text is that it is nor mal for Carriage Return and Line Feeds
15. as soon as possible otherwise 4D may start overwriting places on disk The bitmap is damged and you should try 4D Tools Compact 106 Couldn t extend bitmap table The bitmap table is being extended grown and it cannot be done Most likely this is caused by insufficientdisk space to grow into In version 1 0 of DataCheck the only time the bitmap table is extended is when DataCheck is extending it s own version of the bitmap table in the temporary file So you should take a look at where the tmp file is being saved on disk It should be saved in the same directory as the run file You should free up more space on this disk 70 Log Item Definitions Error Number Description Detail Action 107 Internal bitmap table cannot handle objects this large size lt 1 gt max lt 2 gt DataCheck has some internal limits on how big of a block of information that it can manipu late The bitmap code cannot save an object that is greater than 4096 blocksize or 500 Kilobytes Since DataCheck only needs to manipulate index nodes and other small items this should never be a problem However in future versions of DataCheck if a record is greater than 500 KB then DataCheck might generate this item This item should be removed before that occurs and is only here as a safety mechanism from within DataCheck Call Technical Support and report this item 108 Ca
16. count invalid expected lt 1 gt got lt 2 gt This item is generated when the number of nodes counted does not match the number of nodes in the index header Try dropping and rebuilding the index 65 Log Item Definitions Error Number Description Detail Action 81 Index unusable This item is generated when the maximum number of items for an object is reached Since DataCheck could report problems occur once per record for 50 000 records it was deemed prudent to stop report ing problems after a reasonable number Resolve other items that are being generated by DataCheck 82 Record unusable This item is generated when the maximum number of items for an object is reached Resolve other items that are being generated by DataCheck 83 Record count not equal to index entry count nRecs lt 1 gt nEntries lt 2 gt idx lt 3 gt The number of records should exactly match the number of entries in all nodes in the index If they don t match then you may have a problem However when 4D cannot find data in an index it will often just re add the data into the index At this point your nEntries will exceed the nRecs Try deleting and rebuilding the index 84 Data file version num ber invalid Different modules of DataCheck verify versioning so that as each module is upgraded to match an upgrade in 4D code complains gently ins
17. does not make sense Most likely the file position is beyond the end of the file Examine other items to deter mine what object is causing this particular item Cannot determine file position Generated when the current file position queried by DataCheck is invalid This item should never occur Report to Technical Support 52 Log Item Definitions Error Number Description Detail Action 7 File Read Error tried lt 1 gt got lt 2 gt Could not read data from disk DataCheck tried to read so many bytes of data but the operating system only read the given amount Usually this occurs when there is a problem with the file itself at the file system level Verify the integrity of the file by using a disk utility such as Norton Utilities If this still reports problems try moving to another disk If problems still exist try deleting the object in question and reproducing it Your last resort is a recover by TAGS A backup would be nice too Unexpected End of file tried lt 1 gt got lt 2 gt DataCheck ran off the end of the file while trying to read an object from disk Your file has probably been truncated or is damaged at the file system level Run a disk utility such as Norton Utilities to verify the integrity of the file itself Check to see how long the file is com pared to a recent backup If it s comparable then try deleting the
18. explains the use and licensing of DataCheck Runtime Installing the Serial Number into the Runtime Version You were provided with a registration number for DataCheck Runt ime at the time of purchase This registration number must be entered into DataCheck to achieve the Runtime capability of the pro gram If you don t enter a valid registration number then DataCheck will run in Demo mode To Register DataCheck as a Runtime Version 1 Select Register Product from the File menu The DataCheck Registration dialog is displayed DataCheck Registration Name iY 2 Enter your name and company into the appropriate fields This information is saved with the registration number 3 Enter the registration or serial number provided to you This regiatration number is unique to you and contains encoded information that lets us match your copy with you Note Please don t provide your registration number to others That would be illegal and it is also not fair to the author of DataCheck who has spent several thousand hours developing the product 4 Click the OK button The information you entered is saved as part of the DataCheck 36 BELCA A a application on your hard disk Using the Runtime Version The runtime version uses the same run file that the full version uses However only three user interface options exist Here is the runtime screen HelpDesk run Struct HelpDesk F Data HelpDeskdata J se
19. field headers Each record is broken into sev If the nFields looks wrong you extend beyond EOF eral parts One part is the field know a bogus looking big num record lt 1 gt nFields headers which point to the data ber then try deleting this lt 2 gt itself The field headers are of record Otherwise you ve prob constant size so if this item is ably got a truncated file and generated either the number of you need to recover by TAGS fields stored in the record header is damaged or the file is truncated 63 Field data starts The data for the fields begin This record is most likely dam beyond EOR record beyond the end of this record aged Delete the record and re lt 1 gt field lt 2 gt enter it 64 Invalid field type DataCheck recognizes all field If you ve got a recent version of record lt 1 gt type types in version 3 5 of 4D The 4D then verify with Technical lt 2 gt types are Alpha 0 Real 1 Support that there are no Text 2 Picture 3 Date 4 issues with this item If there Boolean 6 Subtable 7 Inte are no issues with DataCheck ger 8 Longint 9 Time 11 then you ve probably got a damaged record which you can fix by deleting and re entering 62 Log Item Definitions Error Number Description Detail Action 65 Field data overlaps record lt 1 gt field lt 2 gt While parsing each field DataCheck tracks the bounds If two
20. fields overlap DataCheck detects it and warns you You should delete this record and re enter it 66 Field data extends beyond EOR record lt 1 gt field lt 2 gt The data for a particular field extends beyond the end of the record Most likely this occured due to damage in this field In many cases it s a text field that has a bad length for the number of characters A date field for example is always the same length so it s hard for that to get damaged Try deleting and re entering the record 67 Record claims no text but field has text record lt 1 gt field lt 2 gt The record has a flag at the beginning that descrbes whether text is present in this particular record If the flag is cleared not set but text exists this item is generated Delete the record and re enter it 68 Record claims no pic ture but field has pic ture record lt 1 gt field lt 2 gt The record has a flag at the beginning that descrbes whether a picture is present in this partic ular record If the flag is cleared not set but a picture exists this item is generated Delete the record and re enter it 69 Field data extends beyond EOR record lt 1 gt nFields lt 2 gt A quick compare is done between the number of fields and the field data offset and the end of the record If these do not line up then DataCheck gener ates this error Delete the recor
21. fix thebitmap freemap now Either run 4D Tools or use DataCheck to fix the bitmap As you requested DataCheck forcibly dropped the whole table This is a very quick operation because the bitmap is not cleaned up by 4D It simply wipes out all the internal pointers to the data for the table This is purely informational 175 Bitmap fixed by allocat ing space in bitmap at lt 1 gt size lt 2 gt DataCheck fixed the bitmap by allocating space in the bitmap that was previousy incorrectly unallocated This change will save you from potential future problems with your data file This is purely informational 83 Log Item Definitions Error Number Description Detail Action 176 Bitmap fixed by deallo cating space in bitmap at lt 1 gt size lt 2 gt DataCheck fixed the bitmap by deallocating space in the bitmap that was previously incorrectly allocated This change reclaims space that had been lost due to misallocations in the bitmap This is purely informational 177 Cannot undelete records in table lt 1 gt until all indices have been dropped from the table All indexes must be dropped before DataCheck can undelete records This is because as part of undeletion a new record is created which would modify the index DataCheck does not currently modify the index b trees Drop the index re run this scan re index 178 Cannot un
22. further details may be seen by selecting the View button Please read the section Browser on page 29 for more information Disk Map Color Key u Light Brown Data segment header u Black Reserved u Grey Bitmap address table u Yellow Bitmap page u Dark Green Data segment info u Light Green File information table u Orange Record primary address table u Pink Record secondary address table u Red Record u Dark Blue Index primary address table u Purple Index secondary address table u Light Blue Node Browser The Browser allows you to browse your raw records and indices You can hop from an index directly to record data or from index node to index node A historical list of your record surfing is kept for ease of backtracking For indices the hierarchy for each index node 29 Configuring DataCheck is easily accessible easy to go to parent nodes Browse Table Grades ee e ae e Primary 30680 30700 Browser ath Data vr Record 1852 lt TAG gt lt CheckSum gt lt Table gt lt Record gt 5555 Win 29272 1 Grades 1852 3 10 1998 lt TimeStamp gt 365668 eg a 30200 Student Nagata Shinobu 2F086 Class Cross Country 2F986 MidTermGrade 2F500 Teacher Kohler J 2F000 Narrative 2E6890 Advisor Eberhart Dave 2E766 TermGrade Pass 2E3380 CourseDesc 20F aa RecordiD 20B36 nCopies 3 20738 Section 1 2033
23. gt and lt 2 gt are placeholders that would be replaced with spe cific information for the particular item in question Error Number Description Detail Action 1 Out of memory size lt 1 gt DataCheck could not allocate the object of the given size If the size is reasonable then DataCheck is probably just out of memory If the size is really large then there may be dam age in the data file If the size is reasonable then try increasing DataCheck s memory Otherwise look at the object that was being manipu lated and see if you can delete that object and try again Error Freeing Memory DataCheck recieved an invalid memory block to free Most likely this is an internal error Report this occurance to Tech nical Support Cannot open file lt 1 gt The given file could not be opened by DataCheck Verify that the file exists Verify that the file is not open by another application Note that DataCheck can run a scan on a file opened by 4D unless you try to delete indices In this case DataCheck will not be able to open the file Cannot close file The file cannot be closed This is an internal error and should be reported to Technical support File Position Error lt 1 gt lt 2 gt Whenever data is to be read from disk the file position must be set to the particular place on disk where the reading is to commence In this case the file position
24. home page 8 DataCheck Runtime 16 36 detail statistics 19 drop selected indices 19 38 F fields 26 force drop all indices 39 Index Header Table 76 index node 48 index tree 48 installing DataCheck 9 L launching DataCheck 14 log file 34 auto number 18 log item definitions 52 memory 40 multiple indices per field 38 N Networked User Group 8 node 48 node address table 49 P password 17 Pause button 35 PDF 9 14 picture 21 Q quit after scan 18 R RAM 9 40 requirements 9 READ ME FIRST file 9 14 record address table 49 recover by TAGS 38 recovery 38 registering DataCheck 8 repair 13 results of scan 34 Resume button 35 root 48 Runtime DataCheck 16 S scan allocation bitmap 23 scan configuration 14 16 scan indices 19 scan on launch 17 scan options 19 21 23 24 scan record data 21 scan results 34 sequence number 30 serious index damage 19 39 Start button 35 l 86 Index subtables 21 26 support fsti com 8 System 7 0 9 system requirements 9 T table 26 TAGS 38 technical support 8 text 21 TRIC resource 16 48 U URL for DataCheck 8 V verify index 21 verify record number 19 W Web URL for DataCheck 8 l 87
25. lets everyone benefit from the discus sion To subscribe to the list follow the directions provided at this URL lt http Awww pdm inc com iNUG fag htm gt Introducing DataCheck Meeting System Requirements Macintosh Your Macintosh needs the following software and hardware u System 8 6 or above DataCheck 3 is built on top of Carbon which is only available for 8 6 or later u 20 Megabytes of RAM We recommend allocating at least 20 Megabytes of RAM to DataCheck Depending on your datafile size DataCheck may require more memory DataCheck will inform you if it runs low on memory Windows Your Windows machine needs the following software and hardware u Windows 98 2000 XP NT DataCheck uses MFC DLL s not staticlly linked libraries in order to reduce its file size This is the reason DataCheck for Windows is so much smaller than DataCheck for Macintosh u 128 Megabytes of RAM Your machine should have at least 128 Meg of memory but for speed you should get a very fast disk or disk subsystem Those 7200 RPMs should be standard equipment for your data crunching needs Installing DataCheck To install DataCheck simply download the sit or zip file from our servers then unzip or unstuff the file That s it You can now run DataCheck immediately Here are some important files you ll find u READ ME FIRST file important information that didn t make it into the manual u DataCheck application u Da
26. need to recover for Table lt 1 gt is invalid the given table is damaged by TAGs PAT lt 2 gt 144 Primary Address Table The primary address table for Actions Drop the index and for Index lt 1 gt is invalid the given index is damaged recreate it PAT lt 2 gt 145 Index lt 1 gt is named This item is generated when the Follow instructions for the other lt 2 gt name for an index could not be item that was generated This generated at the time the original item is purely informational item was generated DataCheck will then find the name and report it at a later date so that you can track down the index from within 4D 146 Record lt 1 gt field lt 2 gt This item is generated when You have several choices for contains a NAN DataCheck finds a NAN Not A actions 1 Use DataCheck to Number in your data This set all NANs to zero This will occurs in real data types and is set all the NAN values found to due to a divide by zero or sqrt zero 2 Find the record your 1 etc Note that although self and remove the NAN man DataCheck gives you a way to ually by setting it to zero or set all NANs to zero mathemati another number cally a NAN is not the same thing as zero NANs are used to represent infinity or imaginary numbers or other non real num bers that occur when you do mathematics on numbers from the real number line Note also that NAN 3 NAN etc So NANSs tend to spread in data that is manipul
27. node entires The entry number is shown rather useless to any body but the author of DataCheck Drop this index and rebuild it 45 Index Damaged too many levels nodelD lt 1 gt Only five levels are allows in any index A level is a level of the tree of nodes Since five levels is the maximum you can only have five disk reads to find any given data item The number is enforced by the maximum num ber of nodes to represent the maximum number of elements or records If this is a new version of 4D contact Technical Support to verify that this is still a limit of 4D Otherwise you ve got some damage in your index and should delete and rebuild it 46 Index Damage Entries are not sorted nodelD lt 1 gt While DataCheck is scanning the nodes it verifies that each entry is greater than or equal to the entry before it If this becomes not true then DataCheck complains This problem has been seen with the Indexing Problem described above Drop the index and rebuild it If you still exhibit the problem then select Verify Index slow and see if that fails If it does fail then search from within 4D for the data If the data is found then report this to technical support Otherwise you ve got a poorly built index that contin ues to be poorly built If it is an ASCII field then you should try to identify what out of range characters you have an remove them fro
28. object in question and re creating it If it s much shorter then you ve probalby lost most of your data You can try rebuilding the file using a disk utility but at this point you re looking at a backup File Write Error tried lt 1 gt wrote lt 2 gt Could not write out the full object to disk This should only happen if you run out of disk space while DataCheck is trying to grow a data file This may occur if your disk space is low and you are trying to scan a large file Be aware that DataCheck creates a temporary file that needs to be grown periodically This mes sage may be generated as a result of the temporary files growth Report to Technical Support This item is not cur rently being used Unknown version of 4D The given version of 4D is unknown to DataCheck DataCheck can only run ver sions greater than 3 1 Check your version and contact us for an upgrade if you have a version of 4D later than 3 1 and receive this warning 53 Log Item Definitions Error Number Description Detail Action 12 Structure File Object Map Damage The object map in your structure file is damaged You should run SanityCheck for more information as DataCheck simply stops pro cessing when an error occurs Most likely though you re going to have to run 4D Tools Compact on the structure file Too many subtables DataCheck and 4D can only h
29. the DataCheck application on your hard disk Introducing DataCheck Using DataCheck with 4th Dimension Files Now that you have installed DataCheck you need to launch DataCheck and select a database to scan To Open a 4th Dimension Data File You can quickly open a 4th Dimension data file You can use the demo DataCheck datafile that has been installed 1 Launch DataCheck by double clicking on the DataCheck appli cation icon 2 Select the datafile you wish to use 3 Click the Open button Alternatively you can simply drag a 4D structure file onto the DataCheck application Author s Notes Many thanks go to Dennis Carnine President of Committed Software Among the tough task of bringing together Committed Software in a very short time he also had probably the toughest task of all bringing me into this world John Steele who helped guide this software through various twists and turns while at Foresight Technology Inc and until it landed back in Committed Software s own lap John also updated and added many parts to this manual Although the content of this manual was written by Committed Software John Steele and Rich Gay created the manual from it Rich Gay who had the vision to create Foresight Technology Inc Rich and worked through some good times and bad times together and will never forget how we were able to maintain a friendship as well as a business relationship through all of it It took patien
30. this item you should get an upgrade of DataCheck 95 Block ratio doesn t match blocksize ratio lt 2 gt blocksize lt 1 gt The block size has a corre sponding ratio which is basically a number that is used to quickly do math The ratio allows a shift operation to be performed instead of a division which is slower The ratio is derived from the blocksize If these two do not correspond then there is some damage in your data file You should recover by TAGS 96 Cannot open data seg ment lt 1 gt The data segment could not be found on disk Verify that 4D can open this data file Verify that you have permission to see the disk drive and folder that this file exists in DataCheck needs to be able to see all segments for a file when running If the file simply doesn t exist any more then you re going to have to go toa backup Otherwise simply opening the file with 4D and finding the subsequent data segments will allow DataCheck to work properly 68 Log Item Definitions Error Number Description Detail Action 97 File system error accessing EOF file lt 1 gt DataCheck determines the size of a file by jumping to the end of the file and then asking the oper ating system what file position it is at If there was a problem in either of these operations then DataCheck reports this error It is most likely a file system pro
31. 86 206668 2CCHG 2C836 History table Grades record 1852 Previous History Next History From here you can manually delete records if they are causing problems Version 3 of DataCheck allows you to enter a record number in the lower left of this screen You can very quickly hop to that record and view the underlying raw data Table Editor This feature allows you to see and change general information for the tables Although most data here should never be changed this area does contain the sequence number which many developers have 30 Configuring DataCheck Table Information Header Table Count Index Offset Index Count Random Sig TRIC Sig Logfile Counter Full Backup Sig requested an ability to change Table Information for HelpDesk data Table Incidents 7 Table Information 133376 Record Count 74 FAT offset 34442 695091592 SAT Count 17476 Last Del Rec 17000000 Last Seg Num TS Pref Seq Mum Save Cancel Index Offset Offset to the raw index data Rarely should you change this unless you are trying to clear all indexes for this table in which case you might set this to 0x0000 and the Index Count to 0 Index Count The number of indexes for this table Rarely would you change this Two instances when you might 1 you are trying to delete the last index in the list of indexes reduce it by one 2 you kn
32. A H DataCheck User Manual AL H DataCheck User Manual 1996 2002 Committed Software All Rights Reserved Published World Wide by Committed Software Committed Software 156 Lakeview Ave Hamden CT 06514 DataCheck Written by Paul Carnine Committed Software Manual Rich Gay Paul Carnine and John Steele DataCheck Software License Agreement IMPORTANT READ THIS BEFORE OPENING By using the software you accept the terms of this Software License Agreement If you do not agree to these terms please return the Software disks along with the rest of the pack age contents immediately to Committed Software The Software and the accompanying Documentation are the property of Committed Soft ware and are protected by United States and international copyright laws LICENSE GRANT For the purposes of this section the following definitions apply Use means loading the Software into RAM as well as installation on a hard disk or other storage device Product means the Software and Documentation This License determines your rights with respect to the Software You may u Use one copy of the enclosed Software on a single computer provided that the Software is in use on only one computer at a time u Make one copy of the Software for archival purposes or copy the Software onto the hard disk of your computer and retain the original for archival purposes u Transfer the Software to another person provided yo
33. Indexes E Interactive Option Description Scan Indices When this option is selected each index is loaded and scanned The scan consists of traversing all index nodes in the index tree Each entry in the index is compared against the preceeding entry They should all be in sorted order See glossary for definition of terms Verify Record Number When this option is selected each record number for each entry in each node in the index is verified to be a valid record number The record is not read from disk but its number is validated and found in the record address table This is a little more robust of a check and doesn t require much more time and is therefore highly recommended Detail Statistics When this option is selected various statistical items are generated for the index It can be useful in understanding where disk space is being used in your data file Drop Selected Indices When this option is selected the selected indices those with a green dot next to them will be dropped during the scan A dialog will prompt you before the file is opened for write priviliges and again before the indices are dropped You should always run a scan after dropping indices to ver ify that no problems occured during the drop Force Drop All Indices This option drops all indices by simply setting two numbers to zero The two numbers are the number of indices in the data file and the offset to the beginn
34. TATION ANY IMPLIED WARRANTIES OR MERCHANT ABILITY OR FITNESS FOR A PARTICULAR PURPOSE NO LIABILITY FOR CONSEQUENTIAL DAMAGES In no event shall Committed Software or its suppliers be liable for any damages whatsoever including without limitation dam ages for loss or profits business interruption loss of information or other pecuniary loss arising out of the use of or inability to use the Product even if Committed Software has been advised of the possibility of such damages arising from any defect or error in this publication Some states or jurisdictions do not allow disclaimer of express or implied warranties in cer tain transactions therefore this statement may not apply to you U S GOVERNMENT RESTRICTED RIGHTS This Product is provided with RESTRICTED RIGHTS Use duplication or disclosure by the U S Government is subject to restriction set forth in subparagraphs a through d of the Commercial Computer Restricted Rights clause of FAR 52 227 19 when applicable or in subparagraph c 1 ii of the Rights in Technical Data and Computer Software clause at DFARS 252 227 7013 and in similar clauses in the NASA FAR Supplement The contractor manufacturer is Committed Software 156 Lakeview Ave Hamden CT 06514 GENERAL This license constitutes the entire agreement between you and Committed Soft ware concerning the Product This License is governed in accordance with laws of the State of Connecticut LELIKE ai alt Table of Cont
35. an up the bitmap Then run DataCheck to see if there s any damage now that the bitmap table is cleaned up If you con tinue to get this item contact Technical Support 111 Cannot extend tempo rary storage file The temporary storage file where DataChecks copy of the bitmap is stored could not be extended Try increasing disk space on this disk by removing other files The bitmap file shouldn t grow to be that large 71 Log Item Definitions Error Number Description Detail Action 112 TRIC resources used to create these indexes are unknown lt 1 gt DataCheck knows about the standard TRIC resources but cannot locate this TRIC It may be that the ID that describes the TRIC is damaged or it could be that DataCheck simply doesn t know about your TRIC resource If you ve run with DataCheck before and no problems were encountered then you ve prob ably got some damage Drop all indices using Force Drop All Indices and rebuild them with AD If you re just encountering this on a new datafile and especially if you know that you re using a different TRIC resource then you re going to have to install a TRIC resource from your copy of 4D 113 Table Information Table address is dam aged addr lt 1 gt The table information table address is not correct DataCheck does a quick check to verify that the table informa tion table address is correct
36. andle up to 5 levels of sub files Anything more than that and 4D will go down in flames DataCheck simply tells you that you ve got an invalid structure definition Verify that you really do have this situation If you do then you re going to have to create a new structure file Also you should look into a mirror and say Why am creating such a bizarre structure definition any way Bad Version lt 1 gt This version is unrecognized by this piece of code Different modules within DataCheck verify that the correct version is being used for that module This mes sage will most likely occur after an upgrade has occured and not all parts of DataCheck were upgraded Although unlikely it is possible Contact Technical Support Bad Table Number lt 1 gt The table number cannot exist as it is not in the range of valid table numbers Determine what object stored the bad table number and try to delete and recreate it Table number mis match structure lt 1 gt data file lt 2 gt The number of tables in the structure does not match the number of tables in the data file Usually this occurs when you try to open the wrong data file Verify that you re opening the correct data file If you are ver ify you ve got the right version of your structure file If that fails try opening the data file with AD If that fails try recover by TAGS or recover via backup Version unsu
37. as you can put temporary files on a different disk than the 4D data files Indices Drop Damaged Indices added When an index is detected as dam aged DataCheck will optionally delete the index 45 Technical Support Committed Software provides support for technical questions via electronic mail Electronic Mail Electronic Mail mailto support committedsoftware com World Wide Web World Wide Web http www committedsoftware com Tied Mans ec Oo ae sheet ftp ftp committedsoftware com FAX 203 281 4199 Telephone 203 281 4199 46 About Committed Software About Committed Software Committed Software specializes in writing tools for developers Our flagship products SanityCheck and DataCheck offer custom ers the best tools for managing their 4th Dimension structure and data files Our extensive consulting experience with 4th Dimension allows us to understand the needs of the developers both individual and corporate and provide solutions that fit those needs Committed Software is headquartered in Connecticut USA with a development office in Hangzhou Zhejiang Province Peoples Republic of China Committed Software has resellers throughout the US and interna tionally in Australia France Germany Japan Norway Spain and Sweden Committed Software staff is available for disaster recovery of your 4th Dimension related files Contact us for our rates Committed Software is privately h
38. asad Number Description Detail Action 58 Bad Table Number got Each table has a list of records Recovering by TAGS might lt 1 gt expected lt 2 gt This record was found in the list confuse 4D if this record really for a certain table but when it is for the file in question and was read it claimed to be from simply has a bad table number another table Not good in it If there s only one of these then you should probably delete the record and re enter it If there is a rash of these then you probably have some gen eral damage that Recover by TAGS would clean up 59 Record begins beyond The record is off the end of the Try deleting the record If that EOF record lt 1 gt off file 4D has been known to crash fails you re only hope of ridding set lt 2 gt trying to read these types of yourself of this record is via records Recover by TAGS 60 Cannot read record The record could not be read You will most likly have to data record lt 1 gt off from disk Check previous item delete this record If deleting set lt 2 gt to discern why doesn t work then you re going to have to recover by TAGS 61 Record extends The record goes beyond the end If the record appears to be beyond EOF record of the file Either the file has damaged then delete it If the lt 1 gt rec end lt 2 gt been truncated or the record is file is truncated go to backup damaged and claims to be too long 62 Record
39. ated mathematically so catch them early and catch them often 147 Unused This item number is not currently N A in use but may be reused ina later version of DataCheck 77 Log Item Definitions Por Description Detail Action Number 148 Record lt 1 gt actual In version 6 of 4D the record Try re writing the record size lt 2 gt does not size is stored for faster retrieval change a value in the record match stored size This stored number does not save it resave the original lt 3 gt match the computed number value If that doesn t work try and is therefore suspect deleting the record and recreat DataCheck is using the com ing it If that doesn t work con puted number Note that in first tact Technical Support for more releases of 4D v6 this is a com information mon problem Itis not clear at the writing of this manual whether there are ramifications of this issue but ACI has been notified of it in great detail It is clear that this is a problem within 4D 149 Node size does not In version 6 of 4D the node size Try dropping the index and let match stored node size is stored for faster retrieval This ting 4D re create it You can actual lt 1 gt stored stored number does not match use DataCheck to drop the lt 2 gt the computed number and is index or use 4D Using therefore suspect DataCheckis DataCheck verifies that it is using the computed number t
40. b lem Use a file system tool such as Norton Utilities to uncover the problem 98 Claimed file size greater than actual file size file lt 1 gt claim lt 2 gt The size of the data file is stored within the data segment informa tion table If this claimed size is greater than the actual file size then DataCheck complains This is indicative of a file truncation You should probably go to a back up of this file You might be able to recover your data using a disk utility but your backup is really your best bet 99 Cannot read Table Information Table Header The table information table header contains information such as the number of tables in the database what the offset to the index header tables are how many indices there are and the like If this cannot be read then there is most likely some severe damage in your data file Recover by TAGS is probably your only bet 100 Too many tables max lt 2 gt Claim lt 1 gt Only 255 tables can be used by AD If the number of tables stored in the table information table header is greater than this then DataCheck complains Most likely this is indicative of damage You should recover by TAGs 101 Cannot read Table Information Table The Table Information Table stores information about each table such as how many records there are where the address tables are stored on disk and the like All table information
41. bitmap while it is processing your data file This bitmap represents all spaces on disk that are used This bitmap is then compared against the bitmap that 4D has kept for your data file If the two do not correspond then either this item or item 126 is gener ated When this item is gener ated it means that DataCheck has found an object that usees a piece of disk that 4D does not have marked as being used This is a problem waiting to hap pen You should run 4D Tools Com pact to clean up the bitmap 74 Log Item Definitions Error Number Description Detail Action 128 Too many bitmap errors for this data seg ment This item is generated while pro cessing the data segment so that thousands of items are not displayed in the log file The first 25 are displayed and then DataCheck stops displaying but continues processing You will get summary information This is informational no action is required 129 Total space incorrectly claimed by bitmap lt 1 gt This item is generated to sum marize the total amount of disk space that the bitmap in the 4D data file claims but aren t really being used This is the sum of all disk space from item 126 N o action required this is informational If this number gets relatively large then you may wish to perform a compact see item 126 for details on this 130 Total space not prop erly claimed by bitmap l
42. ce honesty trust and business savvy So thanks Rich Rich also cre ated the first revision of the DataCheck manual The Automation Group David Beaver and Carrie Johnson sup ported me through much of the writing of DataCheck They provided a comfortable atmosphere wherein could live for a few years The Athenian School has offered me a wonderful environment to do my work in since my departure from The Automation Group Athe nian is a 6 12 college preparatory boarding school nestled in the Mt Diablo foothills in Danville CA While working there taught a light Introducing DataCheck course load ran the data systems and coached cross country running My consulting work still continues and thanks go out to those com panies who give me the flexibility to work on their systems 4D Inc should be thanked for opening their doors to third party tools such as DataCheck and SanityCheck They have answered my questions verified that my data structures exactly match the actual structures used by 4D and given me direct information about specific bytes of the data file that have enabled me to have the con fidence in my work to make modifications to the data file Without their openness DataCheck would only work in read only mode Julia my sweet has fed me calmed me down when the details of the indexing scheme alluded me and brought me hot tea and a cat to warm my lap when rain brought down the ISDN connection for the um
43. d and re enter it 70 Text data extends beyond EOR record lt 1 gt field lt 2 gt The text data extends beyond the end of the record This will happen if the number of charac ters in the text is damaged Delete this record and re enter it 71 Picture data extends beyond EOR record lt 1 gt field lt 2 gt The picture extends beyond the end of the record This will hap pen if the picture header is dam aged Delete this record and re enter it 63 Log Item Definitions Error Number Description Detail Action 72 Picture data is dam aged record lt 1 gt field lt 2 gt This picture is damaged DataCheck will not generate this item in v3 5 due to the fact that pictures may be BLOBs Version 6 supports BLOBs which will enable DataCheck to begin enforcing pictures in picture fields Nothing until verison 6 of 4D 73 Record claims no sub tables but field has subtable info offset lt 1 gt field lt 2 gt The record has a flag at the beginning that descrbes whether a subtable is present in this par ticular record If the flag is cleared not set but a subtable exists this item is generated Delete the record and re enter it 74 Record has too many subfields record lt 1 gt Only 5 subfields are allowed in a database If you have more 4D will not be able to handle the structure file Verify that the st
44. d block from memory DataCheck pre flights allocation of memory for speed and could not get the basic amount necessary to store the address table disk blocks for the indices Increase DataCheck s memory partition 31 Cannot allocate index information table nIndices lt 1 gt There isn t enough memory to allocate space for the index information table If the number of indices looks right then increase DataCheck s memory partition If you see something like 213332342 for the number of indices then you ve got a prob lem You should probably force drop all indices in the latter case 56 Log Item Definitions Error Number Description Detail Action 32 Bad index number Index lt 1 gt nIndices lt 2 gt The given index number is greater than the number of indi ces in the database Verify the numbers generated does the maximum number make sense If so drop all indices Force Drop and rebuild them all 33 Cannot read index header table nIndi ces lt 1 gt The index header table contains information about each index where the root node of the tree on index is what field the index represents etc If this is unread able then the database is unable to use any index You need to drop all indices Most likely you will have to use Force Drop All Indices as noth ing should be able to read the index header table 4D T
45. d one for Text This allows you to have the Text gremlin map allow carriage return and line feed while the Alpha gremlin map flags those characters as gremlins Automated Launching of 4D after scan DataCheck can now optionally launch 4D with a structure file after it has completed a scan This is very useful for those who wish to Automate the process of running DataCheck Skip Index or Table You can skip an index or a table while DataCheck is processing it by pressing the Skip button This is useful when you are manually running DataCheck and decide you don t want to scan a particular table that is very large You don t have to stop DataCheck reconfig ure it to skip the table or index and restart it Just press Skip and continue 44 What s New in DataCheck v3 Run Files are Cross Platform Run files are now crossplatform This means you can create a RUN file under Macintosh and read it using DataCheck under Windows However the paths to your structure data files must be re config ured on the destination platform Example Code to bring down server and run DataCheck DataCheck ships with example code to bring down 4D server and run DataCheck Preferences Warn on Close DataCheck now optionally warns you before closing dirty windows Temporary file locations DataCheck will put temporary files where you want them This should speed up DataCheck under some scenarios very large data files
46. delete records in table lt 1 gt no space in secondary address table to do so Records can only be undeleted if there is space in the secondary address table to do so DataCheck cannot create a new Secondary Address table when it undeletes it looks through the Secondary Address Table for space that is currently unused and uses that space Export the deleted records then use example code for reading exported records to and saving them in an existing data file 179 Undeleted record lt 1 gt into table lt 2 gt offset lt 3 gt size lt 4 gt The given record was undeleted FYI the record number that DataCheck chooses is the last record number deleted This is purely informational 180 Cannot allocate tem porary buffer for exporting or undelet ing records size lt 1 gt DataCheck ran out of memory trying to export undelete records Macintosh Increase memory partition for DataCheck Windows Quit other applica tions 181 Cannot read record to undelete it offset lt 1 gt size lt 2 gt The given record cannot be read from disk Either the offset is bad or the size is bad or you have run out of memory unlikely because you should have gotten an item 180 in this case Try exporting this record to disk If that fails then the record can not be undeleted 182 Computed SAT count does not match exist ing SAT count table lt 1 gt existi
47. ds than 4D Tools finds 2 DataCheck will recover only those tables that are selected in the RUN file the green dot This allows you to only recover records from a particular table if you so choose 3 DataCheck runs a scan over each record it recovers thus ensur ing that the records found are not damaged This ensures that your recovered file is not damaged 42 Recover by Tags Multiple Segments DataCheck scans only one segment at a time during Recover By Tags This is because the data file contains information about multi ple segments If you re performing recover by tags then most likely that file is damaged Simply select each segment one at a time and DataCheck will gen erate several raw files Import each raw file one at a time into 4D 43 What s New in DataCheck v3 There are many new ways to check your datafiles in DataCheck v2 0 The major new features in this version include Recover By Tags DataCheck has it s own implementation of Recover by Tags which is a little bit different than 4D Tools In some instances DataCheck may recover more records than 4D Tools Carbonized DataCheck has been carbonized for use under MacOS X Our MacOS 9 release also uses Carbon for ease of development and convenience of download Components Parsed DataCheck now parses Components in structure files Two gremlin maps one for Alpha one for Text Two gremlin maps are now available one for Alpha an
48. e each record exists This table is simply a set of offsets into the data file Nodes are stored all over the data file To keep track of which nodes belong to which index there is a table that keeps track of where each node exists This table is simply a set of offsets into the data file 4D now has the capability of creating multiple segments for a partic ular data file the data can be spread across disks by creating multiple segments NAN Not A Number This occurs in real data types and is due to a divide by zero or sqrt 1 etc Note Zero is not the same as a NAN NANSs are used to represent infinity or imaginary numbers or other non real numbers that occur when you do mathematics on numbers from the real number line NANs are bad because they represent a non number meaning that they represent a number that isn t a number Math algorithms do not know what to do with a non number It is very easy for a NAN to be propagated throughout a datafile as math algorithms do not know what to do with a non number and so create new instances of NAN s as the result of an operation For example NAN 3 NAN NANS do not print correctly some externals do not deal with them well and exporting them can end up creating garbage numbers which then become actual numbers when they are scanned back in Piles and piles of problems can start from one number being a NAN So it s best to catch them early Gremlins are characters found i
49. eck Manual PDF a PDF formated file This file requires the Adobe Acrobat Reader which is available from Adobe http Awww adobe com u Samples folder this folder contains demo database files you can use to experiment with DataCheck To Launch DataCheck as Open the DataCheck folder 2 Double click the DataCheck icon to launch it 3 Select the Sample file and click the Open button DataCheck displays the run file configuration window For detailed information see Using the Configuration Dialog on page 16 If DataCheck can find your data file then that data file will be loaded into the configuration screen If your structure file is password protected then DataCheck will ask for your password You may enter either an Admin or Designer password At no time does DataCheck unencrypt the password from your structure file It will encrypt the password you type in and compare that encrypted value with the encrypted value on disk prevents hacking into DataCheck memory looking for plaintext passwords 4 Press the Scan button and interpret the results To Configure a Scan Create a Run File When you configure DataCheck you are creating a run file that can be saved and run at a later date You might save a run file that drops all your indices You might configure a quick scan to be run daily or a longer scan to be run just after each backup Those of you with very large data files might configure seven run files
50. eck has only a few dialogs The Configuration Dialog is used to control all parameters for a particular run that is performed on a data file Once a configuration has been created you can save it as a run file for future use or to provide to a client for use with DataCheck Runtime see DataCheck Runtime on page 36 for more information To set the structure data file and TRIC resource Structure Helpbesk TRIC lt Automatics Set Data File HelpDesk data Paul Ignore Items Below Structure is a popup menu that shows you the path to your structure file If you d like to change the structure file stored for this configura tion click the Set button Data File is a popup menu that shows you the path to your data file If you d like to change the data file for this configuration press the Set button Configuring DataCheck TRIC is a popup that shows the path to the file that the TRIC resource was lifted from When you set a TRIC resource that TRIC is pulled from the specified file and stored into the run file That way if you send this run file to a client the TRIC resource will work prop erly See TRIC resource on page 48 for more information on this subject DataCheck computes a checksum of the names of all tables and fields in your strucure This information is stored in the run file When the run file is sent to your client they can change the Struc ture and Data File options so l
51. eeeeeeeeeeeeeeeeees 37 Licensing the Runtime Version ccceeeeeeeeeeeeeeeeeees 37 Advanced TOPICS eesiitisistacneccdscceisaierremanioucsditiasinanadsodeades 38 Multiple Indices per Field item 48 eee eeseceeeeesseceeceeeecesaeceaeecsseeeneceeees 38 Not all tables and fields scanned Cannot process Bitmap eee 38 Temporary Tes ti 3 cy scs is os seas Steps Reels te ee a EA 38 LELIKE ai alt Recover aatan a Hiv heb hia ae E on Pitas edits ease ete 38 Force Drop All Indices ee eeren e oree Soke oeae ee sieo ANPE EERENS EE adsense akn aes 39 SOLLME REN AE E E E E SS 39 Configuring DataCheck Memory esesseessseerseseesssreresrssesresreresrererresesrrereersrent 40 Using 4D to run DataChecki isse sisisi irere serete pei ireo tierse itere i setis 40 Ws a CRON UY s ererek aerae a a a a E TERIOS RE ART IUES 40 Recover by Tags sassssssssccccccecscadsdeisecisendectssrssssteccdenctastecwtaan 42 Whatis Recover by Tags ir ereenn ie t eN ENEE ERAN cents 42 Howdo luse Heeren a a a e E Saree ie E R AE 42 Why is it different than 4D Tools 0 ee eececcecseceececeeeceeceeecesseceseeeeeeeaeeseeecsees 42 Multiple Sepments ei nents Moke ota GA aaa ee eats 43 What s New in DataCheck V2 ccsssssesteesssensseeeeees 44 ReCOver By Fags st essed Ere ue teces savin canen as chin NEE A ae dives stuns thc hov wea teates 44 Carboni zed ose s ccsscsciccccsccbanendes daust cesses ceebeuses dus eb cosspevectentetenicbosten
52. efore closing the log file Ask before closing modified Run file If checked DataCheck asks you before closing a run file that has been modified Temporary files location You can define where DataCheck puts it s tempory files they can be large If Use Data File Directory is selected then DataCheck puts the temporary files in the same directory as the data file 33 DELEGITO T d mole Mm aii DataCheck Log File This chapter explains the log file generated by DataCheck when processing a 4D data file Understanding the Log File DataCheck generates a log file as a result of the scan Here is an example F invoices Data lg Fress Start Button gt y invoices Data 10727796 2 35 PM Indices Taxes Code 7 Error Index 17 represents the same field as this index Bitmap Hot all tables and fields scanned Cannot process Bitmap Summary Statistics Elapsed time Hode count Hode disk use Hodes Deleted Record count Rec disk use Recs Deleted dateebokekch Detail Descriptions kkk Below are detailed descriptions of the The numbers at the end of each BECHARA EE EE EE EE EE EE EE EE EE EE EE EE EE EEE EE EE 00 00 01 3 Ok O com gt 3 Ok O Com items noted above item above map to a description be pow 45 The index appears more than once im the data file index from within OataCheck and re open 40 to rebuild it index damage under this situation
53. egments that makes up your data The offset is stored in the header of the first segment the main data file If this offset is incorrect then there is no way to obtain information about the segments such as how big a block is for the segment etc This is crucial information Most likely you will have to recover by TAGS 67 Log Item Definitions Error Number Description Detail Action 93 Error reading Data Segment Information Table DSIT count lt 1 gt DataCheck could not read the whole Data segment informa tion table from disk Most likely there is a file position error or the DSIT runs off the end of the file Most likely you will have to recover by TAGS 94 Block size lt 1 gt invalid DataCheck only tested with blockize of lt 2 gt DataCheck is designed to work with any size blocks However it has only been tested with block sizes of 64 and 128 bytes Other block sizes should work but DataCheck is warning that if there are severe issues with the data file and this is a new ver sion that creates a new block size that DataCheck should be suspect If you ve run DataCheck on this data file before and haven t upgraded to a new version of 4D and DataCheck has never reported this then you ve prob ably got some damage that will require you to recover by TAGS However if you ve just upgraded to a new version of 4D and all of a sudden you start to get
54. eld For more information please visit our web site at http www committedsoftware com 47 Glossary TRIC resource CRON utility Allocation bitmap Index Node Index Node Entry This chapter defines important terms used within this manual A TRIC resource is a resource that contains the information about how sorting should be performed in your data file For example a different TRIC resource is used in Germany due to the fact that cer tain sorting is different Each TRIC has a unique identifying 4 character code That code is stored in your data file so 4D and DataCheck can use that code to find the right TRIC resource to use when sorting an index For 99 of the users of DataCheck the TRIC resource will automatically be found by DataCheck However for those of you who are using a non standard i e home grown TRIC resource you will need to install the TRIC resource into the run file A CRON utility is a Macintosh or Windows program that will launch an application at a specific time and or date This is useful for run ning automatic backups or a program like DataCheck 4D needs to keep track of where free space on disk exists It does this by deciding that disk space will be allocated in blocks For example version 3 5 of 4D allocates disk space in 128 byte blocks Therefore if 4D allocates only 1 byte of data it must allocate 128 bytes on the disk Now all 4D has to keep track of is each block in the file Th
55. em occurs when the num ber of bytes reported for all entries is less than or equal to the entry count In other words you must have at least 1 byte per entry If this is not the case then the entries don t really exist The node is very damaged You should drop the index and rebuild it 186 Index built with decending IDs When 4D encounters two records whose fields have the same data it still sorts them in the index It sorts them by increasing record ID This item is generated when DataCheck detects that the records are sorted in decreasing order Although this is not a problem initially when an index looks this way it will eventually become damaged You should drop the index and rebuild it 187 Record lt 1 gt Modify date is invalid lt 2 gt 4D stores a modification date with each record in your data base This item is generated when that date appears to be invalid The day should be in the range of 1 31 Month 1 12 Try re writing the record If you have many records write a small routine that loads each record and does something like add 0 zero to an integer in the record then save the record This should fix the problem 85 Log Item Definitions Error Number Description Detail Action 188 Deleted record chain does not exist yet records have been deleted When records are deleted 4D modifies the secondary address table and bu
56. ents DataCheck Software License Agreement 00 iii Table of COnteniS iececcccicvs cess cette nrensdsetenscetiintietiinvkes v Introducing DataCheck ssannnnnnnnnnnnnennnnnnnnnnnnnnnnnnnnnnnnnnnnn 7 Previewing the Mandliiics series treet ie a enact 7 Understanding Terms Used in this Manual 0s 8 Registering DataCheck ccccceeceeeeeeeeeeeeeeeeeeeeeeeeeeeeeeaaees 8 Meeting System Requirement c cceeeeeeesteeeeeeeeeeeeees 9 Mae OS a e N 9 WTC OWS E LE AEREAS E AER AE EE AE EL ET 9 Installing DataCheck nc cacti icchieeeraehceeticiceteusd eeceeeieaesueciets 9 Installing the DataCheck Registration Number 10 To Register DataCheck as a Developer Version eeceesesecseceeeseeneeeeees 10 Using DataCheck with 4th Dimension Files c0 11 To Open a 4th Dimension Data File eee ceeeeeeeeeceeeeeceeaecaeeneenseeneees 11 AUINOKS NOS wna cunAtatdolsminnwen a a 11 DataCheck OVerVieW cccccccccccsssssesseeeeeeeeeesneceeeeseeeeeees 13 Understanding DataCheck Operation cceeeeerreeee 13 Using DataCheck to Repair Problems eeeeeeeeeees 13 Getting a QUICK Start cccccseesseeeeeeeeseeeeeeeeeeeeneeeeeeeeees 14 Launching DataCneck 2 59 dressesecleandveteieccenivee uses erteewdvereion 14 To Launch DataCheck ronnie ri r a i a ir 14 To Configure a Scan Create a Run File essseessseesesessesresrerrsrere
57. evendsutsbeonsbovbdesstes 44 Components Parsed onura eni E tis E E E ushers teetesinn eet 44 Two gremlin maps one for Alpha one for Text 00 cee ceeeeseeceseeeeeeeeeeeeeeenees 44 Automated Launching of 4D after SCan oe ee eeeecereeeneceseeceeeeneceececeseeeneeeseees 44 Run Files are Cross Platform oo eee cseceecsececeseceeceeeeeeseeeeeeseaecaassaecneensenseees 44 Example Code to bring down server and run DataCheck 00 eee eee eeee 44 Preferences isi sescaccscecescsceotsseses voies oiher ee see choos sh jules soba cuts echeb cubes ESES ekaro iein 45 MICOS REEE cess edits sacs ssessatuses ETE 45 Technical SUPPOM sciscciiscnicstesccsdvesaistincsccartnaradvirneuantucnseens 46 About Committed Softwar e cccceeesssssssseeeseeseensees 47 Glossary scscwtcnslaacectacnsytaatenseudernnianuvetnlsnnneuenerteannamentorivey 48 Log Item Definitions cccccceseseeeeeeeeseeeeseeeeeeeeeeneenees 52 vi Introducing DataCheck Introducing DataCheck DataCheck is the most comprehensive database diagnostic tool available for the 4th Dimension environment It is designed to quickly find and report any situation out of the ordinary in your data files If any problems are found DataCheck will offer a set of steps that you may wish to take to attempt to fix the problems In addition DataCheck reports a myriad of statistical information regarding your data file and allows you to perform some modifications to repair the data
58. exist record number lt 1 gt If Verify Record Number is selected the record offset is pulled from the record address tables If the record number is out of the range of record num bers or if the record address tables are damaged this will occur Turn off index checking and see if the file scan is clean If it is then you probably have index damage Otherwise you should fix the other problem and then revisit this one 42 Next node damaged ID lt 1 gt Each entry in each node has a Previous node and a Next node This is how the index tree is built A quick check is done on the next node ID and if it appears damaged this item will be generated You will most likely have to drop the index and rebuild it 43 Bad field type type lt 1 gt entry lt 2 gt Each entry in each node has a Previous node and a Next node This is how the tree is built A quick check is done on the node ID and if it appears damaged it will be reported You will most likely have to drop the index and rebuild it 58 Log Item Definitions Error Number Description Detail Action 44 Node entries extend beyond end of node entry lt 1 gt While scanning the node DataCheck constantly verifies that it hasn t fallen off the end of memory allocated for this node This item is generated if DataCheck runs off the end of the node while reading
59. ey are simply provided as examples of the type of utilities that you might use with DataCheck to launch DataCheck 41 Recover by Tags Recover by Tags This chapter discusses the Recover by Tags feature of DataCheck Terms used in this chapter are defined in the Glossary on page 48 What is Recover by Tags Each record on disk contains special characters tags at the header of the record which one can use to detect a record on disk Recover by Tags searches the data file for any data that has these tags and exports the found records How do use it Open up DataCheck as usual point to your data file and select Recover By Tags from the Special menu DataCheck will scan the file and push all records found into a file The file will be the name of your file with an extension of raw If your file is MyShell then the file will be MyShell raw The con tents of this file are raw or Packed records These records can be read using the RECEIVE RECORD function within 4D You then create a new empty data file and import the records in the raw file An example database called ImportRaw ships with DataCheck which shows an example of how to import raw records back into a new data file Why is it different than 4D Tools There are several reasons why DataCheck is different 1 DataCheck uses a slightly different method for searching for the records in a file This method often finds more recor
60. file More information is available in the specific chapters Previewing the Manual This manual preview gives you a peak into the capabilities of DataCheck You ll need to read the first few chapters thoroughly though while you explore DataCheck in order to understand all the features that it offers DataCheck Overview provides a summary of DataCheck safety features You should read this short chapter prior to using DataCheck Getting a Quick Start covers basic use of DataCheck Configuring DataCheck shows you how to customize a DataCheck session and save run files for future use DataCheck Log File explains the different sections of the log files that DataCheck generates DataCheck Runtime shows you how to use the DataCheck Runt ime which is available as a separate application for you to provide to your clients or end users Advanced Topics discusses technical details about 4th Dimension data files and the operation of DataCheck Glossary contains a list of terms used throughout this manual Log Item Definitions is a complete list of each item reported by DataCheck along with detailed descriptions and actions You should refer to this chapter whenever a DataCheck log reports a problem Introducing DataCheck Understanding Terms Used in this Manual The terminology used in this manual is intended to be consistant with version 6 of 4th Dimension This means that 4D F
61. g the field will change the open your data file with 4D and sort order of the index the index will be rebuilt by 4D DataCheck requires that you drop the index before modifying the value of this field This is due to the fact that DataCheck cannot rebuild indexes for you this task is best left for 4D to do If we make data changes in your data file we would then have to update the index which would require manipulating the index Again we leave major internal index manipulations to 4D for compatibility issues 155 Loaded TRIC ID lt 1 gt Each TRIC resource has an ID Verify that you do want this to does not match stored The manually loaded TRIC happen if you are manually TRIC ID lt 2 gt resource s ID does not match loading TRIC resources you the TRIC ID stored in this data should know what you are file Make sure you want to do doing If you think you loaded this it is not standard the right TRIC resource and got this item then verify that you are truely opening the correct version of 4D you want the one that you use when opening this data file 150 Unused This item number is not currently N A in use but may be reused in a later version of DataCheck 151 Unused This item number is not currently N A in use but may be reused in a later version of DataCheck 152 Cannot write record While fixing records DataCheck 1 verify the data file is not on a lt 1 gt to disk could not write this record to locked vol
62. il Action 135 Node lt 1 gt cannot be deleted The given index could not be deleted Run a DataCheck scan and see what the results are Most likely extra space will just exist the node couldn t be dropped If this prevented the entire index from being dropped then the way to fix it is with Force Drop All Indices 136 Cannot flush buffers The buffers that hold changes with regard to disk modifications could not be flushed Run DataCheck on this file again doing a full scan not dropping indices You may have damage in the indices that can be fixed via Force Drop All Indices 137 Node lt 1 gt cannot be found to be deleted The node could not be found to be deleted Most likely this indi cates severe damage in the index and is probably why you were deleting it anyway Run DataCheck again on this data file to determine it s state Most likely you will have to run Force Drop All Indices 138 Index Address Tables severely damaged Damage was detected while attempting to drop an index Run DataCheck again to deter mine the shape of the file extent of damage You may have to run Force Drop All Indi ces at this point 139 Bitmap node in differ ent file segment off set lt 1 gt expected seg lt 2 gt DataCheck assumes in several places that the bitmap blocks are going to be stored in the same segment that they represent If this is
63. ilds a chain of deleted records If no records have been deleted then the chain does not exist This item occurs when DataCheck detects that records have been deleted but no chain exists to track those deletions You should use 4D Tools Com pact or export all records and import them into a new data file 189 Skipped scanning some tables or indexes cannot per form bitmap checking This item occurs bitmap check ing is not performed because some of the data file was not scanned Bitmap checking requires that the complete file is scanned by DataCheck Perform a full scan of all tables and indices to do a bitmap scan 190 The skip button was pressed and the object was not fully pro cessed This item occurs when the user pressed the Skip button while processing an object table index etc This is logged in the log file so that you know what a remote user may have done No action required This is infor mational only 86 Index Numerics 4D NUG 8 4D Tools 38 Compact 19 39 A Acrobat Reader 9 14 Adobe Acrobat Reader 9 14 allocation bitmap 23 48 ASCII 39 auto number 18 B bitmap 19 39 C checksum 17 children 48 compact 19 39 Configuration Dialog 16 configuring a scan 14 16 cron 17 40 48 D data file 16 data file segment 49 DataCheck Installing 9 launching 14 memory 40 registering 8 repair 13 system requirements 9 DataCheck
64. ile to do so then DataCheck will relaunch 4D when it is finished scanning the file Using Windows you can use the ACI Pack to launch DataCheck with a run file and then quit the server If you have configured the RUN file to do so then DataCheck will relaunch 4D when it is fin ished scanning the file Please see the example code called LaunchDataCheck provided with DataCheck for an example of how to perform this Using a CRON utility A CRON utility is a utility that will perform specific actions on your computer at a specific time The name comes from a Unix application called CRON You would use a CRON utility if you wanted to launch DataCheck at 40 Advanced Topics a specific time of day and run a scan of DataCheck say every night at midnight you scan the data file You might find that its more convenient to write 4D code to perform the same task assuming your 4D application is always running See the section above Using 4D To run DataCheck for more information Information about CRON utilities for Macintosh computers is avail able at this URL http www macsos com au macat index html On Windows you can use the scheduler that comes with the NT Resource Kit although if you need a 3rd party utility here s one that is an implemenation of the original UNIX cron there is no GUI http kalab com freeware cron cron htm Committed Software does guarantee anything regarding these utili ties Th
65. iles are now called Tables Layouts are Forms and Procedures are Meth ods Please bear with us as we all transition to the more standard vernacular of database systems There is another set of words that may be new to you Words such as bitmap or freemap address tables etc The words chosen for these objects are gleaned from ACI and from what literature could be found on the subjects We believe that if ACI were to ever dis cuss these parts of the data file publicly they would use similar terminology Please see Glossary on page 48 Registering DataCheck You should register your copy of DataCheck to stay informed about new releases and about other important information and be eligible for upgrades Registered users are entitled to free technical support You can contact Committed Software in any of these ways Phone 203 281 4199 Fak a ee er 203 281 4199 Email support committedsoftware com You can also contact us at and should send the registration card to the address below Committed Software 156 Lakeview Ave Hamden CT 06514 The DataCheck web page always has the latest information about updates beta versions and late breaking news The URL is lt http www committedsoftware com gt We also monitor the 4D iNUG Technical iNUG email list This list is the preferred method for asking and answering questions as the community nature of the list
66. in this data file Make sure you want to do this it is not standard Verify that you do want this to happen if you are manually loading TRIC resources you should know what you are doing If you think you loaded the right TRIC resource and got this item then verify that you are truely opening the correct version of 4D you want the one that you use when opening this data file 156 Drop index lt 2 gt before fixing gremlins The data cannot be modified while an index exists for this table The reason is that DataCheck cannot resort the index based on the change in the data that will be made by fix ing the gremlins Rescan with gremlin detection 157 Record lt 1 gt field lt 2 gt contains a gremlin lt 3 gt The given field from the given record contains a gremlin Gremlins can cause problems with sorting your data but more than that some characteres are invisible to the eye and may cause problems when search ing for this record again See gremlin section of manual for more details Edit the record remove the gremlin Alternatively tell DataCheck to accept this char acter by toggling it s state in the Gremlin window See Record Scan Options on page 21 80 Log Item Definitions Error Number Description Detail Action 158 Record lt 1 gt field lt 2 gt contains a bad date lt 3 gt The given field from the given reco
67. ing of the index information table When these two numbers are cleared however the bitmap still has those blocks as allocated DataCheck does not try to deallocate them There fore you should immediately run 4D Tool Compact on the data file and then open the data file with 4D to re index Force Drop All Indices should be used when you have serious index damage that can t be fixed any other way Configuring DataCheck Option Description Drop Damaged Indices This option will drop indices that DataCheck notices are damaged This enables a one step process for detecting and deleting troublesome indi ces Interactive Drop Damaged Indices When selected the dropping of indices is interactive you are asked before deleting each index 20 IM Find NANs O Export Records IM Scan Records nmin M verify Index slow C Find Alpha Gremlins Find Text Gremlins interactive _ T Type Mismatch warnings _ Detailed Statistics Configuring DataCheck Record Scan Options i Modify Record Data E Fix Alpha Gremlins O Fix Text Gremlins L Fix NANs set to zero O Delete Bad recs E Force Delete Selected Tables Alpha Gremlin Map Text Gremlin Map Interactive Allow Errors Scan Records When this option is selected each record is completely loaded from disk and verified The verification entails completely parsing the record from top to bottom including
68. is is accomplished by one large bitmap A bitmap is a set of 1 s and 0 s where 1 means that the block is allocated and 0 means the block is not allocated This bitmap is spread throughout your data file When DataCheck scans your data file it builds its own internal bitmap of which blocks are allocated and which are not When DataCheck has completed scanning the whole file it can then compare its bitmap against the existing 4D bitmap and report any differences An index is represented on disk as a tree of nodes If you imagine a geneology tree there is a root That root would be called the root node That root then points to several children They would each have a level of 1 and would be called nodes in the index tree Each node in an index tree has several entries The number of entries varies and depends upon the history of the particular tree 4D decides to split and create more nodes as well as merge nodes together as you create and delete records An entry in the node represents one pieces of data from a record If the index was on an alpha field for first names then an index entry might have the data Julia and a record number for the particular record that this entry in 48 Record Address Table Node Address Table Data File Segment NANs Gemlins this index represents Records are stored all over the data file To keep track of which records belong to which tables there is a table that keeps track of wher
69. k must check that index DataCheck must also perform the same conversions This message is generated when DataCheck cannot do the proper conversion Contact Technical Support 77 Bad disk address invalid file segment segment lt 1 gt max lt 2 gt Detailed Descriptions disk addresses contain the data file segment number if your data has multiple files This number must be less than or equal to the number of segments in your data Check to see if the segment number exists The first seg ment is segment 0 the second is segment 1 and so on If it does exist then contact Techni cal Support If it doesn t exist then the address is incorrect and you should track down what module in DataCheck tried to use this disk address by examining items generated after this item 78 Disk position beyond end of file datafile lt 1 gt position lt 2 gt file len lt 3 gt The disk position requested is beyond the end of the file This is a generic item generated by low level code that handles verifying information about a disk request to be made Deduce what DataCheck mod ule has caused this to occur by examining items that occur after this item 79 Internal error travers ing index idxMid lt 1 gt nodelD lt 2 gt DataCheck experienced a prob lem walking the node tree This is an internal error and should never happen Contact Technical Support 80 Index node
70. le lt 1 gt record lt 2 gt moved from lt 3 gt to lt 4 gt This feature is not fully imple mented This notes when a record is moved as part of the compaction feature This is purely informational 164 Index lt 1 gt node lt 2 gt moved from lt 3 gt to lt 4 gt This feature is not fully imple mented This notes when a node is moved as part of the compaction feature This is purely informational 81 Log Item Definitions Error Number Description Detail Action 165 Record lt 1 gt field lt 2 gt type differs from struc ture struct lt 3 gt rec lt 4 gt The given field from the given record has a type difference between what is in the record and what is in the structure This is not a problem and is not data corruption This is a normal situ ation within DataCheck that is an exhibition of a very powerful fea ture of 4D 4D allows you to change the type of a field from say long to ascii When this occurs the data in the record stays unaffected It still stays as type long This is a great feature of 4D because when you change the data type in the structure 4D does not have to munge through all the records and modify the data This helps you in the rapid development phase of your projects How ever for us very paranoid devel opers we like to know that when we are in production the data in the record is the exact type that i
71. le with write privileges when it is attempting to make a modification It will only make a modification after you have specifically instructed it to do so and have gone through several dialogs describing the actions about to take place For example the first action you must confirm is the opening of the data file in write mode DataCheck cannot open the data file in write mode without your approval You should always make a backup of your data file before running any part of DataCheck that will modify your file We have tested DataCheck in a myriad of situations and believe it to be rock solid However there is always the chance that your datafile will present a scenario that will cause DataCheck to fail It is your responsibility to make sure that this potential does not cause you problems Since DataCheck will verify your data file it is highly recommended after any modification that DataCheck makes on your data file you perform a full scan This self checking mechanism is an excellent way to boost your confidence in the integrity of DataCheck and your data file Getting a Quick Start This chapter shows you how to get a quick start with DataCheck once you have installed it Launching DataCheck After you unzip the files you download there will be a folder called DataCheck Folder containing these items u READ ME FIRST file important information that didn t make it into the manual u DataCheck application u DataCh
72. m your data 47 Index Damaged not enough entries exist nodelD lt 1 gt The entry in the node could not be found This node is severely damaged and therefore the whole index is damaged Delete the index 59 Log Item Definitions Error Number Description Detail Action 48 Index lt 1 gt represents the same field as this index This item occurs when more than one index claims to repre sent a given field Apparently 4D will sometimes create multiple indices which can cause prob lems with management of your data file Please refer to Multiple Indices per Field item 48 on page 38 for more information Drop all indices for this field then rebuild them 49 Index does not exist in structure file approx disk space lt 1 gt The index is in the data file but is not in the structure file Most likely you turned off the index using a different data file and are now using DataCheck on this data file which has an index and the structure no longer does This will not cause you any problems running 4D You don t need to do anything However you may wish to drop this index to save disk space 50 Deleted Index approx disk space lt 1 gt The index has been deleted but 4D only tags the index as deleted and doesn t actually remove it This shouldn t cause you any problems Creating a new index should use this index
73. n t open the datafile then you must recover by TAGS Future versions of DataCheck will probably include options for recovering a data file by TAGS Force Drop All Indices This option drops all indices by simply setting two numbers to zero The two numbers are the number of indices in the data file and the offset to the beginning of the index information table When these two numbers are cleared however the bitmap still records those blocks as allocated DataCheck does not try to deallo cate them Therefore you should immediately run 4D Tool Compact on the data file and then open the data file with 4D to re index Force Drop All Indices should be used when you have serious index damage that can t be fixed any other way Sorting issues There are reproducable indexing problems with ASCII fields using the universal TRIC resource used for all U S versions of 4D The problem has to do with using characters that are outside of the range of normal characters used by the english language Specifi cally the OxBB OxBC 0xC7 0xC8 and OxF5 characters all have been shown to exhibit this problem It has to do with how the TRIC resource is put together You should avoid using these characters at any time in your ASCII fields when you intend to index the field Committed Software has not investigated other TRIC resources to see if they exhibit the issue However here is a way to test your database 1 Create database with
74. n strings or text that are outside of the normal range of characters for your particular language They are considered bad because they are frequently invisible charac ters and unless they are handled carefully they can cause unexpected behavior within an application For example if a user entered Car nine in a last name field where the is an invisible gremlin character they wouldn t be able to see the character screen listings would show the name to be Carnine 49 Whenever the user searched for Carnine they wouldn t get a hit however if they searched for Car they would This weird behavior is why gremlin characters need to be handled carefully and why DataCheck gives you a way to catch and identify them Note that the definition of a gremlin character changes from human language to language and from data file to data file as some peo ple may use strings with odd characters to do something non ascil such as control strings for serial devices Gremlin Editor Peep Ce E Beano asuet sae pee Hilighted characters are considered Gremlins by DataCheck 50 51 Log Item Definitions Log Item Definitions This chapter contains detailed definitions of all log items reported by DataCheck This information supplements the item descriptions included in the logs generated by DataCheck The actions are suggestions They are listed in the preferred order The lt 1
75. ng lt 2 gt computed lt 3 gt DataCheck computes the Sec ondary Address Table SAT count for each table and then compares it against what 4D has stored as the proper SAT count If they are different then there is a serious problem with this table You can try setting the SAT in the Table Information window to the computed number but it is not guaranteed to fix this prob lem Your best bet would be to export all data create a new data file and reimport 84 Log Item Definitions Error Number Description Detail Action 183 Record lt 1 gt field lt 2 gt contains a bad bool ean lt 3 gt The given field in the given record contains a boolean whose value is neither 1 nor 0 This can cause problems as 4D handles this case in an unde fined manner Some user inter face elements ie boolean radio buttons will show the field as true when an if statement will compute it as false and visa versa It is highly reccommended that you fix these problems by settng the boolean to the proper value 184 Cannot find entry in node node dam aged entry lt 1 gt node lt 2 gt root lt 3 gt The given node s list of entries is damaged The given entry can not be found in the node You should drop the index and rebuild it 185 Node damaged reports number of entry bytes as lt 1 gt but MUST be greater than lt 2 gt entry count This it
76. nnot find space in file to allocate object size lt 1 gt The object is being allocated in the bitmap table and not enough space can be found DataCheck should try to extend the bitmap table when this occurs and therefore you probably have other items being generated Follow the instructions for those items 109 File is too small to be a 4D data file file lt 1 gt size lt 2 gt For a proper 4D Data File you need to have at least 32 kilo bytes of data on disk Anything less than this in size cannot be a data file DataCheck does this brief check to protect itself against attempting to reada severely truncated data file Most likely you ve just selected a file that is not a datafile and tried to run DataCheck on it If this really is your data file then your file is severely truncated and you will need to recover it or obtain a backup Recovering it means using a disk utiltity such as Norton Utilities to per form the recovery 110 Space occupied off set lt 1 gt size lt 2 gt When DataCheck is building its own internal bitmap that describes how space is used on disk it first checks to see if a bit is already set before it sets the bit If the bit is already set then that means this block on disk is already allocated to another part of your data file This is not a good thing As usual backup your data file Then you should perform a 4D Tools Compact which should cle
77. not the case then DataCheck needs to be modified to handle this case If this is a recent release of 4D that you are running DataCheck on then perhaps you need an upgrade of DataCheck Other wise you might have damage in your bitmap that would be solved with 4D Tools Compact 140 Cannot modify Index Header Table The index header table needs to be modified to completely remove the index in question However while trying to modify this table an error occured Run DataCheck to determine the state of the indices You may need to run a Force Drop All Indices to solve this situa tion 141 Cannot find index in Index Header Table index offset lt 1 gt While attempting to remove the index from the index header table the index itself could not be found This is indicative of severe damage in the index header table Perform a Force Drop All Indi ces 76 Log Item Definitions Error Description Detail Action Number 142 Field count mismatch The number of fields in a record Try deleting and re entering the Record Num lt 1 gt is compared against the number data If you still experience this Num Fields Rec lt 2 gt of fields in the table from the call Technical Support Table lt 3 gt structure file If these two differ then DataCheck generates this item 143 Primary Address Table The primary address table for You most likely
78. ong as the checksum of the names of the fields and tables in their structure match with the checksum in the run file To set the Startup Options Most of these options are useful when integrating DataCheck with a CRON utility See CRON utility on page 48 for more information on this subject These options affect what happens when you launch a run file or drag and drop a run file onto DataCheck Deleted Automate MM Open without password mm iM Launch 4D after scan M Initiate scan on launch Choose 4D to Launch LL Pause before sean patie los9 Applications Mac OS 9 4D 4D 6 7 1 4th Mf Auto number amp save log Dimension 6 7 1 M Quit after scan Structure to Launch These features can be used to automate your usage of DataCheck See example databases EPEE for suggestions for using these features ORS Option Description Open without password When this option is active the run file is saved so that when DataCheck is run no password is required The password is not stored on disk If any configuration change is attempted then the password is requested This option is useful when used in parallel with a CRON utilty as no dialog will ask for a password when the scan begins Initiate scan on launch When this option is active DataCheck will immediately begin scan ning after opening the document Configuring DataCheck Option Description Pause before
79. ools 4D DataCheck etc 34 Bad node ID NodelD lt 1 gt Max lt 2 gt The index keeps track of a list of nodes that represent the index Each node has a unique number just it s position in the list The maximum number of nodes is stored in the index header Therefore if this error appears either the index header is incor rect or the node ID is incorrectly generated Try dropping the index If that doesn t fix it then the problem is most likely in the index header and you should use Force Drop All Indices 35 Cannot find the field for index lt 1 gt Each index keeps track of the field that it represents DataCheck verifies that this field exists in the structure file If it doesn t then you get this error You should verify you ve got the right structure file for this data file If they match then you should drop all indices and rebuild Use Force Drop All Indices 36 Node begins beyond EOF offset lt 1 gt file size lt 2 gt When attempting to read a node the file position was out of file bounds Either the file has been truncated or the index address tables are damaged See what other errors pop up Try turning of index checking and see if just the data is intact If the data is OK try dropping the index If this fails try drop ping all indices via Force Drop All Indices 37 Cannot read node blocks offset lt 1 gt size l
80. ord is zeroed If you check Export as well as Zero deleted records the export is done first and then the records are zeroed This can be very useful if you want to keep historical data of deleted records and also wipe out all deleted records This option is useful if you have a snapshot of your data and you want to zero out any old data that may be floating around Why A recover by tags may recover old deleted records So doing this guarantees that old records cannot be recovered This option is useful before compressing your data file for electronic delivery It guarantees that all old record space is zero which com presses very well This option is very useful for those who really want to delete their data so that prying eyes cannot easily look at old deleted records in your data file We at committed software are not data security experts but we do know that zeroing this data is an excellent first line defence geek talk of course there is always residual information even if you zero the data data experts always speak of writing several patterns over the data area to remove any residual magnetic data if you want this level of security please contact us and we ll put it in 25 Configuring DataCheck Setting the Target for a Scan The little green dots indicate that the object is selected to be acted upon during the scan If the green dot is present and you press the scan button that object will be acted upon
81. owthe number is wrong and so you try to set it to the cor rect number usually decreasing Random Sig Reserved and unused space by 4D TRIC Sig The signature for the TRIC resource used to sort this table This 31 Configuring DataCheck may be ignored in current implementations of 4D Logfile Counter Tracks the 4D Backup logfile checkpoints Bumped when logfile is changed Rarely modified by developers Full Backup Sig Signature of 4D Backup used to do last backup Rarely modified by developers PAT offset Offset to the Primary Address Table for the records Rarely changed by developers However if you wanted to quickly delete all records and not clean up the bitmap you could set this to zero and set the SAT count to zero SAT Count Number of Secondary Address Tables in the Primary Address Table Rarely used by developers Last Del Rec The address of last Deleted Record Rarely used by developers Last Seq Num This is the Last Sequence Number that 4D used for this table Pref Seg Num Ignored by 4D Is the prefered segment number for data for this table 32 Configuring DataCheck Preferences This feature allows you to modify preferences for DataCheck Preferences E Ask before closing modified Log file E 42k before closing modified Run file Temporary files location MM T Use Data File Directory Ask before closing modified Log file If checked DataCheck asks you b
82. port f Zero Deleted Records Deleted Scan Options Undeleting records will only occur if there is space in the secondary address table to undelete You are warned if the record cannot be When Interactive each record is presented before export undelete Scan for Deleted Records Records are undeleted and put back into the list This operation only works if the deleted records still exist i e hasn t been zeroed This operation also only works if there is space in the secondary address table to undelete the records If sufficient space isn t avaialable DataCheck will warn you of this You can always export the delete records Interactive When this is checked all undeleting or exporting is interactive Undelete Deleted records are undeleted This will only work if there is space in the secondary address table to do the undeletion This will always be the case if you accidently delete records and immediately run DataCheck to un delete Note that because 4D re uses space in your 4D file the more you use your data file after deleting a record the less chance you have to recover the deleted records Export Deleted records are exported They are exported in SEND RECORD format See the example database that ships with DataCheck for exam ples on importing these records into a 4D database 24 Configuring DataCheck Zero Deleted Records When a deleted record is found the rec
83. pported by DataCheck requires v3 1 1 or greater DataCheck requires version 3 1 1 or greater and this data file appears to be less than version 3 1 1 Verify that the data file is greater than 3 1 1 If it is then contact Technical Support This item is not cur rently being used This item is not cur rently being used 54 Log Item Definitions Error Number Description Detail Action 20 Table cannot be found in structure file Table lt 1 gt The given table number could not be found in the structure file Either the structure file or the data file is damaged or they do not match Verify that you ve got the right data file and structure file Ver ify that the data file can be opened with the structure file from within 4D If it can contact Technical Support If it cannot then you should recover by TAGS 21 Internal Error No free blocks DataCheck internally has lists of blocks that it keeps in memory If it runs out of blocks it tries to dump blocks that are not cur rently used by some part of DataCheck If that fails it then tries to write out blocks that are dirty and reuse those blocks If that fails it tries to allocate more blocks If that fails you see this message Increase DataCheck s memory partition 22 Cannot read block off set lt 1 gt length lt 2 gt The given block could not be read Most likely thi
84. previ ous items Most likely you ll be doing a 4D Tools Compact 122 Bitmap Error Primary Address Table for Index lt 1 gt There was a problem processing the bitmap for the primary address table for the given index Most likely this means that the object overlaps another object Check previous items to see the actual situation Follow directions for the previ ous items Most likely you ll be doing a 4D Tools Compact 123 Bitmap Error Second ary Address Table lt 2 gt for Index lt 1 gt There was a problem processing the bitmap for the secondary address table for the given index Most likely this means that the object overlaps another object Check previous items to see the actual situation Follow directions for the previ ous items Most likely you ll be doing a 4D Tools Compact 73 Log Item Definitions Error Number Description Detail Action 124 Cannot read Primary Address Table for Index lt 1 gt The index has a list of nodes that make up the index This list is comprised of one primary address table and several sec ondary address tables This item is generated when the primary address table cannot be read from disk You most likely have severe damage in this index and shoud drop and rebuild it You may encounter problems trying to drop it so do make a backup If you encounter problems drop ping then use Force Drop All Indices
85. pteenth time and couldn t talk to you And you None of this would be possible without you There are those of you who spent countless hours beta testing DataCheck taking the time and energy to try to figure out why DataCheck didn t like their perfectly fine data files Beyond that it takes trust to ship me your data files and for that am ever grateful it is the only way can diagnose and solve problems Their work and trust has bene fited us all And lastly want to thank all of you for your patience As have lived in China for the past 4 years there are periods of time when can t get mail for 2 or 3 days There are hassles with FedEx ing it takes 5 days and ask you to do more work on your end to reduce data file sizes when they are sent my way have been living some what of a dream of mine to live afar and still work on the products love So you can see just happen to write the code Paul Carnine DataCheck Overview DataCheck Overview This chapter discusses how DataCheck works and the fundamental issues involved with 4th Dimension datafiles Understanding DataCheck Operation DataCheck opens your structure file by default in read only mode The data file is always opened in read only mode when scanning for problems You can have complete confidence that the data file won t be modified in any way when doing a scan Using DataCheck to Repair Problems DataCheck will only open your fi
86. rd contains a bad date A bad date is a date outside of the normal range of dates This date may be computable by 4D but as it is stored on disk it is not normal Example 35 390 1903 Re write the date field with a valid date 159 Remove unique flag on index lt 2 gt before fixing gremlins This item is currently not reported Why You must always undo an index before fix ing gremlins so it is redundant information You should never get this mes sage 160 This index is marked deleted This is purely information for you stating that the given index is marked as deleted but still is taking up some space in your file No actions are necessary 161 DataCheck will attempt to continue reading this file DataCheck has encountered a problem and is not sure if it can continue forward but will con tinue anyway This is an informational mes sage to warn you that DataCheck is forging ahead even though all may not be in order 162 DataCheck has begun writing an audit log in file lt 1 gt DataCheck has begun writing an audit log file The audit log file gives you very detailed informa tion about certain aspects of your data file as well as details of any modifications that DataCheck has made This file is very easiliy parsable and an example program is provided to help you parse this audit log for further processing This is purely informational 163 Tab
87. remlin characters as definied in the Configure Gremlins dialog to spaces ASCII 32 Fix NANs This will set every occurance of a NAN to zero Note Zero is not the same as a NAN NANSs are used to represent infinity or imaginary numbers or other non real numbers that occur when you do mathematics on numbers from the real number line Delete Bad Records which have damage will be deleted This can be made interac Records tive so that you see each record before it is deleted and can choose whether to delete it or not Interactive Delete Bad Records When selected the record deletion will be interactive Force Delete Selected Tables This feature will completely wipe out the selected table s data This isa drastic move that should only be used when there is serious damage in a table that cannot be fixed in any other way Note This feature does not clean up the bitmap so you will need to run 4D Tools Compact or check Fix Bitmap Warnings in the Bitmap features after running this option 22 Configuring DataCheck Bitmap Scan Options M Scan Allocation Bitmap LJ Modify Bitmap C Zero all empty space Fix bitmap warnings Scan Allocation When this option is selected the bitmap or freemap is tested against a Bitmap bitmap built by DataCheck during its scan Briefly the allocation bitmap stores information about what parts of the file are free to be used If the bitmap is wrong
88. ructure has less than 5 subta bles Verify that the structure is valid If the structure really does have more than 5 subtables then you have to solve that problem If the structure has less or equal to 5 subtables then your record is probably damaged and you should delete and re enter it 75 Cannot find field data in lt 2 gt index record lt 1 gt data lt 3 gt The given data could not be found in the index This may mean index damage and it may mean a problem within DataCheck Verify that you can find the data within 4D by doing a search Verify that when you search in User Mode that you search using the index and verify that you do get the record in case you get multple return results sift through for the right record If you can search with 4D and get the right record then DataCheck is having problems and you should contact Techni cal Support 64 Log Item Definitions Error Number Description Detail Action 76 Cannot convert data for index comparison record lt 1 gt field lt 2 gt DataCheck needs to convert data from one format to another This occurs when you have a field that is an integer field and you have 5000 records and you decide to change it to an ASCII field 4D does not convert each record in your data file to have an integer for that field 4D will convert the field on the fly to build the index Since DataChec
89. ruely dropped whereas some Note that in first releases of 4D times 4D does not completely v6 this is a common problem It delete the index is not clear at the writing of this manual whether there are ramifi cations of this issue but ACI has been notified of it in great detail It is clear that this is a problem within 4D 150 Unused This item number is not currently N A in use but may be reused in a later version of DataCheck 151 Unused This item number is not currently N A in use but may be reused in a later version of DataCheck 152 Cannot write record While fixing records DataCheck 1 verify the data file is not on a lt 1 gt to disk could not write this record to locked volume like a CD ROM disk or a write protected volume 2 try deleting the record and recreating it If this item per sists contact Technical Sup port 153 Bad checksum on Each record has a checksum to Try deleting the record and rec record lt 1 gt protect against damage in the reating it Note that future ver file This records checksum sions of DataCheck will be able does not match the record so the to fix this problem record may be damaged 78 Log Item Definitions Error Description Detail Action Number 154 Drop index lt 2 gt before Cannot set NANs to zero without Use DataCheck to drop the forcing NANS to zero dropping index first Since modi index then fix the NAN then fyin
90. s either a version problem or a problem with a bad table num ber Look at accompanying items as they should tell you more about this If there are none then you are most likely going to have to recover by TAGS 27 Bad record number Num lt 1 gt Max lt 2 gt The given record number is out side the valid range of record numbers for the table Find the source of the problem most likely an index and delete and recreate the respon sible object i e drop and rebuild the index 28 Bad table number Table lt 1 gt NTables lt 2 gt The given table number is out side the acceptable range of tables for the database Deduce what object is causing the problem and delete and rec reate that object Simple to do if it is an index more difficult if it is the table header If it is the latter then you re probably going to have to recover by TAGS 29 Structure has an index on lt 1 gt that doesn t exist in data file The structure has an index that does not exist in the data file This can occur if the index has been dropped but the data file has not been opened by 4D to rebuild it This can also happen if the table has no data in it Then AD has no index to make so it doesn t bother to make it Either re index by opening with 4D or ignore if there is no data in the table 30 Cannot allocate disk block memory There is not enough memory to allocate the desire
91. s in the structure This is for no other reason There is no prob lem with your data being in this state None are required This is a feature of 4D However if you choose you can re write this record by modifying the field set it to itself and the type will be written correctly 166 DataCheck has begun to export records to lt 1 gt DataCheck is informing you that records have begun to be exported to the named file This is purely informational 167 DataCheck raw export failed on record lt 1 gt offset lt 2 gt The record could not be exported This could be due to a problem attempting to read the record ie the offset is invalid or due to a full disk Make sure the disk is not full Delete the record it is unread able 168 Set data block to zeros offset lt 1 gt size lt 2 gt DataCheck is informing you that it set the given block on disk to all zeros It does this when you have asked it to zero unused space on disk This is purely informational 169 Record Exported table lt 1 gt record lt 2 gt offset lt 3 gt size lt 4 gt This informational item lets you know that the record was exported to disk This is an informational item only 82 Log Item Definitions Error Number Description Detail Action 170 Deleted record chain is damaged Record lt 1 gt is in deletion chain and should not be Previ
92. s is due toa file system error Check any other items that might occur with this one to deduce what may have caused this to happen If nothing is obvious then perhaps there is a file system problem so use a disk utility such as Norton Utili ties to diagnose this disk file If the file appears to be OK then try Recover By TAGS 23 Internal Error Block not found to lock lt 1 gt DataCheck attempted to lock a block for manipulation but could no longer find the block in mem ory to lock This should never happen Report situation to Tech Sup port To immeidately solve the symptom increase DataCheck s memory partition 24 Internal Error Block not found to unlock lt 1 gt DataCheck attempted to unlock a block and could not find the block in memory to unlock it This should never happen and is indicative of a bug in DataCheck Report situation to Technical Support 25 Cannot allocate disk block memory There is not enough memory to allocate the desired block from memory DataCheck pre flights allocation of memory for speed and could not get the basic amount necessary to store the address table disk blocks Increase DataCheck memory partition 55 Log Item Definitions Error Number Description Detail Action 26 Table header offset is unreadable Table lt 1 gt Could not find the offset to the given table Most likely this i
93. scan When this option is active DataCheck will wait for the given number of seconds before beginning to process the file This is to allow DataCheck to work better with some CRON utilities that work better when there is time between asking 4D to quit and having DataCheck actually run open the files Auto number amp save log When this option is active DataCheck will automatically number the log file and automatically save it to disk This option is only available if the Initiate scan on launch option is active Quit after scan When this option is active DataCheck will quit itself after the scan is completed This option is only available if the Auto number amp save log option is active Launch after 4D Scan DataCheck can relaunch 4D with a given structure file after it is done running its scan When this option is active you should select a version of 4D to execute and a structure file to launch 4D with Configuring DataCheck Setting Scan options The scan options offer you control over what occurs during a scan You might ask DataCheck to drop indices or scan the allocation bit map There are five different types of scan options you can set Index Scan Options M Scan Indexes Ti e e Modify Indexes ooe an n DA verify Record Number _ Drop Selected Indexes Scan Indexes m Detailed Statistics C Force Drop All Indexes Must be unchecked K Drop Damaged
94. scan After the index is dropped runa normal scan verifying records indices etc to make sure the drop went smoothly This will rid you of multiple indices Not all tables and fields scanned Cannot process Bit map The bitmap can only be scanned if all nodes of all indices and all records in all tables were scanned If there was a problem scanning these areas or if the areas weren t fully scanned then the bitmap option cannot run It would produce incorrect information if it were to attempt to compare the DataCheck bitmap against the 4D bitmap Temporary files DataCheck currently creates a temporary file named tmpXXXX It guarantees that the file it s trying to create temporarily doesn t already exist It then creates the file stores information in it then deletes the file upon conclusion This file is DataCheck s represen tation of the bitmap Since this bitmap could be quite large DataCheck cannot keep it all in memory Recovery Oftentimes DataCheck suggests to recover by TAGS Some peo ple have noted that Recover by TAGS can be less efficient than exporting all data and re importing it If you can export all data and re import it then sometimes this can be faster 38 Advanced Topics When DataCheck asks you to recover by TAGS in general you should think rebuild data file from scratch Most people find it easi est to just recover by TAGS Others will find it easiest to export import Of course if you ca
95. slot You could drop this index with DataCheck which will clean it up 51 This empty index does not exist in structure file The index is empty and doesn t exist in the structure file This is just a special case of item 49 above and occurs when the index has no nodes This shouldn t cause any prob lems in your database How ever if you d like to remove this item then drop the index with DataCheck 52 Cannot allocate address table buffers The address table buffer could not be allocated You can check to see which address buffer this is by look at other items gener ated after this one Most likely you ll simply need to increase memory for DataCheck 53 Cannot load address table block The address table entry could not be read from disk If the address table is associ ated with an index then drop the index and rebuild it If the address table is associated with a table then you ll most likely have to recover by TAGS 60 Log Item Definitions Error Number Description Detail Action 54 Tried to read beyond address table A DataCheck module requested an address block that was out of range Determine what caused this problem by looking at items generated after this item For example if it is an index just drop the index and rebuild it If it s a table you ll probably have to rebuild the whole file using recover by TAGS
96. srrsrsrrerrersrees 14 Configuring DataCheck csssseeecceeeseeeeeeeeeeeeeeeneeeeeeees 16 Registering DataCheck ccccceesssccceeeeeeeeeeeeeeeeeeeeneeees 16 To enter a registration number srie ees entes sopen ceeceseeeeeeeeeeeseseesaecaecnaesseesaees 16 Using the Configuration Dialog eeeeeeeeeeeeteeeeeeeeeee 16 To set the structure data file and TRIC resource 0 ccccccecesscccecensececeeenseeees 16 To set the Startup Options 20 ceceseessececeaecneceseeseseeeeseseaecaeeeaecaeenaees 17 Setting Scan Options sierp eera pa areen ia e aTr aE E EEEE EE EAEE 19 Understanding the Structure Area csssssssssseeeeeees 27 The Special Menu ices tess reaiee tren eater iede etre casas 27 Disk Map sic cence nie winch E E E Rie eek ee a eae eae 27 ITRON a AE EAEE E AE EEEE EEA E EAEE TNE EEE EEE 29 Table Editor sic pan a AIS ee heal 30 Preferente Sieira a ea RE EE cate E E e aE Ea ae a iR 33 DataCheck Log Fil sssseeccceeseseeeeeeeeseeseseeeeeeeeeeseneees 34 Understanding the Log File cccceeeeeeeeeeeseeeeeeeeeeeees 34 Using the Start Pause Resume Button seeeeeeees 35 DataCheck Runtime ccccccceceesesesseesseseseeeesnscssesseeeees 36 Installing the Serial Number into the Runtime Version 36 To Register DataCheck as a Runtime Version 00 cece eeeeeesseseeeeeceeeneeceennees 36 Using the Runtime Version ccccceeeeee
97. t 1 gt This item is generated to sum marize the total amount of disk space that the bitmap in the 4D data should be claiming but isn t This is the sum of all disk space from item 127 See action items for item 127 131 Cannot reliably run bit map scan due to fatal error If the scan was not successfully completed then the bitmap can not reliably be run For example there was a fatal error and DataCheck could not read all nodes in an index then DataCheck cannot know whether those nodes are allo cated or not in the bitmap So there is no way to compare the bitmaps reliably Solve the other items that have been generated and re run DataCheck 132 DATA FILE MODI FIED All indices have been dropped but the bitmap was not updated This item will be generated after a Force Drop All Indices has been run It is warning you that although the indices have been dropped the space in the files that that they were using have not been cleaned up Run 4D Tools Compact to clean up the bitmap 133 DATA FILE NOT MOD IFIED Could not drop the indicies This item is generated when another error caused DataCheck to not modify the file Check previous items to deduce why this item was gen erated 134 Index was dropped The given index was dropped This is informational no action is required 75 Log Item Definitions Error Number Description Deta
98. t 2 gt The data for the node cannot be read from the file Most likely your index is damaged Check for other damage run a scan without Verify Index being checked If no other seri ous problems then drop this index 57 Log Item Definitions Error Number Description Detail Action 38 Node extends beyond EOF node end lt 1 gt filesize lt 2 gt The data for the node canot be read from the file This is indica tive of damage to your index but could also be one symptom of a greater problem Look for other problems in your data file If this is the only prob lem then drop the index If you see this in a group of problems you probably have general file damage that will probably only be fixed via Recover by TAGS If your problems are on in indi ces then you should Force Drop All Indices 39 Previous node dam aged ID lt 1 gt Each entry in each node has a Previous node and a Next node This is how the index tree is built A quick check is done on the previous node ID and if it appears damaged this item will be generated You will most likely have to drop the index and rebuild it 40 Too many node entries num lt 1 gt max lt 2 gt There can only be 64 node entries in version 3 5 of 4D If there are more than this in the node the node is assumed to be damaged You should drop the index 41 Record does not
99. taCheck Manual PDF a PDF formated file This file requires the Adobe Acrobat Reader which is available from Adobe http www adobe com u Samples folder this folder contains demo database files you can use to experiment with DataCheck Congratulations You ve installed DataCheck and are now ready to proceed to the next section Introducing DataCheck Installing the DataCheck Registration Number You were provided with a registration number for DataCheck at the time of purchase This registration number must be entered into DataCheck to achieve the full capability of the program If you don t enter a valid registration number then DataCheck will run in Demo mode To Register DataCheck as a Developer Version 1 Select Register as Developer from the File menu The Register as Developer dialog is displayed DataCheck Registration Serial 2 Enter your name and company into the appropriate fields This information is saved with the serial number 3 Enter the registration number provided to you This registration number or serial number is unique to you and contains encoded information that lets Committed Software match your copy with you Note Please don t provide your registration number to others That would be illegal and it is also not fair to the author of DataCheck who has spent several thousand hours developing the product 4 Click the OK button The information you entered is saved as part of
100. tead of crashing Verify that your version is greater than or equal to v3 1 1 If it is then contact Technical Support 85 4D interrupted while saving bitmap 4D sets a bit in the header of the file before it saves the bitmap When it s done saving the bit map it clears this bit Therefore if something happens between starting the bitmap write and ending the bitmap write then this bit will be set indicating that perhaps the bitmap table was not completely updated on disk Perform a 4D Tools Compact to rebuild the bitmap tables 86 4D interrupted while saving index lt 1 gt 4D sets a bit in the header of the file before it saves the index When it s done saving the index it clears this bit Therefore if something happens between starting the index write and end ing the index write then this bit will be set indicating that per haps the index was not com pletely updated on disk You should Force Drop All Indi ces and rebuild them 66 Log Item Definitions Error Number Description Detail Action 87 4D interrupted while deleting index lt 1 gt 4D sets a bit in the header of the file before it saves the index When it s done saving the index it clears this bit Therefore if something happens between starting the index write and end ing the index write then this bit will be set indicating that per haps the index was not com pletely upda
101. ted on disk You should Force Drop All Indi ces and rebuild them 88 Address tables dam aged for table lt 1 gt The address table is damaged The address table contains the address offsets for each record in the table Recover by TAGS 89 4D interrupted while flushing cache 4D sets a bit in the header of the file before it flushes the cache When it s done flushing the cache it clears this bit There fore if something happens between starting to flush the cache and completing flushing the cache then this bit will be set indicating that perhaps the data was not completely updated on disk You should run recover by TAGS 90 Bad Data Segment Information Table count range 1 lt 2 gt val lt 1 gt The number of data segments is not correct Either you have exceeded the allowed amount or there is some damage in the segment information table If there is damage your only recourse is recover by TAGS 91 Bad Table Information Table offset offset lt 1 gt The table information table con tains information about each table where the address table for the table is etc So without this offset DataCheck cannot find any of the records for this file Most likely you re going to need to run Recover by TAGS 92 Bad Data Segment Information Table off set offset lt 1 gt The data segment information table contains information about the s
102. to appear in text but not in Alpha There may be other differences you d like to add Export If selected then all scanned records are also exported to disk The records are exported in Raw format PACKED You can use the exam ple ImportRaw database provided with DataCheck to import records that have been exported using this option Interactive If interactive then each record is presented to you before export occurs Export Allow Errors If Allow Errors is selected then the record is exported even if errors were Export detected in the record By default damaged records are skipped during export 21 Configuring DataCheck Type Mismatch Warnings A type mismatch occurs when you change the data type of a field in the structure Any existing records have the old field type and are not updated 4D performs conversions between the old type and the new type using the data in the record For the paranoid amongst us this data type conversion is not desirable although it causes no problems This feature allows us to detect this situation Detailed Statistics When this option is selected various statistical items are generated for the table It can be useful in understanding where disk space is being used in your data file Fix Alpha Grem lins Converts all Gremlin characters as definied in the Configure Gremlins dialog to spaces ASCII 32 Fix Text Gremlins Converts all G
103. u inform Committed Software in writing of the transfer you retain no copies of the Software or Documentation and the other person agrees to this Software License Agreement LIMITED WARRANTY Committed Software represents and warrants that for a period of 30 days from the receipt of the Product 1 the disk on which the Software is distributed will be free from defects in materials and workmanship 2 the Software will perform substantially in accordance with the Documentation If the Product fails to comply with the warranty set forth above Committed Software s entire liability and your exclusive remedy will be replacement of the disk or at Committed Soft ware s option Committed Software s reasonable effort to make the Product meet the warranty set forth above This limited warranty applies only if you return all copies of the Product along with a copy of your paid invoice to an authorized Committed Software dealer within 90 days of the date you received the Product If Committed Software is unable to make the Product conform to the above warranty Committed Software at its option will refund all or a fair portion of the price you paid for the Product Any replacement Product will be warranted for the remainder of the 90 day warranty period or for 30 days from the date you received the replacement whichever is longer COMMITTED SOFTWARE DISCLAIMS ANY AND ALL OTHER WARRANTIES iii WHETHER EXPRESS OR IMPLIED INCLUDING WITHOUT LIMI
104. ume like a CD ROM disk or a write protected volume 2 try deleting the record and recreating it If this item per sists contact Technical Sup port 153 Bad checksum on Each record has a checksum to Try deleting the record and rec record lt 1 gt protect against damage in the reating it Note that future ver file This record s checksum sions of DataCheck will be able does not match the record so the to fix this problem record may be damaged 79 Log Item Definitions Error Number Description Detail Action 154 Drop index lt 2 gt before forcing NANS to zero Cannot set NANs to zero without dropping index first Since modi fying the field will change the sort order of the index DataCheck requires that you drop the index before modifying the value of this field This is due to the fact that DataCheck cannot rebuild indexes for you this task is best left for 4D to do If we make data changes in your data file we would then have to update the index which would require manipulating the index Again we leave major internal index manipulations to 4D for compatibility issues Use DataCheck to drop the index then fix the NAN then open your data file with 4D and the index will be rebuilt by 4D 155 Loaded TRIC ID lt 1 gt does not match stored TRIC ID lt 2 gt Each TRIC resource has an ID The manually loaded TRIC resource s ID does not match the TRIC ID stored

DataCheck

Contents

Download Pdf Manuals

Related Search

Related Contents