User Manual
Contents
1. A Revision B Austin Orchard Brian Smith Tygue Ferrier MASON NOVEC UNIVERSITY Investing in Our Communities Table of Contents 1 Software Requirements 2 2 Installation Instruction 3 3s USING NEXIS 1 a2e45nacacasvese eee onss 4 i Modifying Records 5 li Example Log 7 ii Creating Reports 8 iv Example Report 1 4 Input Formats eee 12 5 Using NEXIS Source Code 13 6 Using NEXIS Database 16 7 Known ISsues cece cece ees 17 Software Requirements Operating System NEXIS is assumed to be run on a Windows machine The python scripts should be portable to other operating systems but there has been no testing done for other operating systems Database NEXIS requires access to a MySQL database MySQL can be obtained from http dev mysql com downloads windows for windows machines Python 2 7 NEXIS is built using Python 2 7 Python 2 7 can be downloaded at https www python org download releases 2 7 Python 2 7 can be installed as part of Anaconda from Continuum Analytics a c ompletely free enterprise ready Python distribution for large scale data processing predictive analytics and scientific computing https store continuum io cshop anaconda Anaconda includes the design environment Spyder NEXIS requires the following packages datetime MySQLdb os2. area findRecordsInAndNearServiceArea determines which records are in the service area It determines for the remaining records which records are near the service area writeReport writes to a csv the records that were sent to it validateAppChoice or Date checks to make sure the user inputted valid data descParser py descParser checks an applications description to attempt to determine its sector or the number of housing units findSectorT ype checks if any of the following words are in the description residential commercial industrial mixed If more than one is found it is considered mixed 14 findHousing Units attempts to determine from the description the number of housing units for an application If a specific keyword is found it checks if there is a number before that keyword or a number in parenthesis or brackets The keywords are listed below sfh single family home single Single Family Homes AE A ise mfh multi family home multifamily Multifamily Homes home multifamily house multi family house th townhome townhouse town Townhomes home town house o condo condos condominium Condominiums condominiums Apartments apt apartment 15 Using NEXIS Database Querying records To query records from the database identify the information required For tables that are connected identify the id field that is in common between the two tables Static Data m icati i sector_t
3. fiona shapely pyproj csv To install the packages with Anaconda open an Anaconda Command Prompt and type conda install lt package name gt or pip install lt package name gt To install using python go to python27 folder and type pip install lt package name gt Sometimes firewalls can prevent installation of packages you can download the packages directly from http www lfd uci edu gohlke pythonlibs as whl files Then type pip install lt whl file name gt from the command prompt in the directory where the whl file is located Installation Instructions Database To create the NEXIS schema connect to the database Run createNexisSchema sql The name of the database server must be up to date in nexisDButils py in the init section NEXIS Create a folder for NEXIS Place the following source files in this folder logger py lolaUpdate py loudounReports py nexisDButils py nexisInterface py records py Place the csv record with updates in the same folder NEXIS will create nexislogs and nexisreports folders in that directory to store logs and reports Service Area The folder containing the shape file showing NOVEC s service area must be updated in loudounReports py in the findRecordsInService Area section of loudounReports py Currently it is assumed the shape file 1s using EPSG 2283 coordinates If a different coordinate system is used this must also be updated in the findRecordsInServiceArea sectio
4. 0008 added with NEXIS record number 150 Application description REQUEST APPROL OF A SUBDIVISION PRELIMINARY RECOR D PLAT CSBRD gt TO ESTABLISH THREE 3 gt LOTS IH A RESIDENTIAL ZONING DISTRICT SME Application zoning TRILER Ex Command Prompt python nexisinterface py Please enter the File name of ni new LOLA records NEXIS sampleData2 csy reading File sampleDataZ csy updating description From REQUEST APPROL OF A SUBDIVISION PRELIMINARY RECORD PLA T SBRD gt TO ESTABLISH THREE 3 gt LOTS IN A RESIDENTIAL ZOWING DISTRICT SME to RE QUEST APPROVAL OF A SUBDIVISION PRELIMINARY RECORD PLAT CSBRD gt TO ESTABLISH THRE E 3 gt LOTS IN A RESIDENTIAL ZOWMING DISTRICT SME for Application SBPR 2614 0606 UPDATE Zoning_Applications SET description REQUEST APPROVAL OF A SUBDIVISION PR ELIMNINARY RECORD PLAT S BRD TO ESTABLISH THREE 3 gt LOTS IH A RESIDENTIAL ZONING DISTRICT SME project_status 803 2615 83 27 RECEIVED 3RD SUBMISSION REFERRAL COMMENTS FROM COUNTY file_date 2614 64 38 acceptance_date 2614 65 87 WHE RE rFecord_number 158 HEU RECORD SBRD 2015 0003 added with NEAIS record number 151 Application description REQUEST APPROVAL OF A SUBDIVISION RECORD PLAT lt SB RD FOR ONE PARCEL INTO FOURTEEN 14 gt RESIDENTIAL LOTS AND ONE lt i gt OPEN SPACE PA IRCEL WITH RIGHT OF WAY DEDICATION IH A RESIDENTIAL ZONING DISTRICT SME Application zoning TRiUBF 4 The information that is recorded on the scr
5. types are known and static this can be used to validate incoming data If a type is not in the existing set an error can be thrown to signal invalid data 13 findGeoUpdates or StatusUpdates or AppInfoUpdates or AppNameUpdates checks whether the information is the same for a record in the csv compared to its record in the database runDescriptionParser runs the description parser on new records adjustDateFormat If valid date is received converts date from mm dd yyyy format to yyyy mm dd If no date is received returns an empty string If an invalid date is received an exception is raised rowstripper If a string is received it trims spaces from the beginning and ending of the string Otherwise an empty string is returned descriptionCleaner Trims extra spaces from descriptions loudounReports py loudounReports creates reports by checking whether records are in NOVEC s service area in Loudoun or near NOVEC s service area Functions included inServiceAreaReportGenerator controls flow to create reports of records in NOVEC s service area inAndNearServiceAreaReportGenerator controls flow to create reports of records in and near NOVEC s service area getRecordsByAppAndDate asks the user 1f they would like a subset of records by application type starting file date and ending file date It returns all applications according to the user s request findRecordsInServiceArea determines which records are in the service
6. 14 0602 in service area SBPR 26015 0064 in service area SBPL 2014 60012 is near service area distanc Creating report named nexisReport_5 3 2015 9 31 38 csv stored in nexisReports Ha Hau fain foie fain p u LA A A yA A A A A pA a fle LA 8 The report file will be written in to the nexisReports folder in the NEXIS directory The report will be written to a file named nexisReports followed by the date and time and csv z e nexisReport 4 19 2015 15 57_19 Microsoft Excel non commercial use 4 Home Insert Page Layout Formulas Data Review View Developer de Calibri re Paste General FA Conditional Formatting g Insert 7 9 E Format as Table 3 Delete ae e l lt 0 o0 2 ttt 2 so sort amp Find amp Fj Alignment Tua Number s Styles Cells Editing Clipboard M Fo i Application ID l SS _ eee A B C al a at Ml D E F G H l Status Zoning Pin_Number Longitude Latitude x_in_ft y_in_ft A zoning modification to 5 200 to permit decks that exceed 30 3 ZMOD 2014 0002 inches in height to encroach into the required yard 4 Active POH4 L6611E 11 77 51682 38 90042 11759730 2 7010683 A zoning modification to 5 200 to permit decks that exceed 30 5 ZM0D 2014 0002 inches in height to encroach into the required yard 6 Active POH4 L6611E 11 77 51699 38 90042 117596816 7010685 21 REQUEST APPROVAL OF A PRELIMINARY SUBDIVISION RECORD P
7. 615 8604 is in service area App SHPR 2614 6608 is in service are Fea Creating report named nexisReport_4_19 28615_15 57 19 csu stored in nexisRKeports MAIN MENU Type 1 to update records with a csv file Type 2 to create a report Type anything else to exit HEIS gt 6 For determining which records are in the service area and near the service area specify the desired proximity in feet to the service area border Ges Anaconda python nexisinterface py e r YO What is the starting file date Leave blank to use the earliest available otherwise use format YYYY MM DD NEXIS gt USER HAS CHOSEN NO START DATE What is the ending file date Leave blank to use the latest available otherwise use format YYYY MM DD USER HAS CHOSEN NO END DATE Find records within how many feet of service area NEXIS gt 7 NEXIS will first determine which records are within the service area For the remaining records it will determine whether the records are within the specified proximity threshold It will write all identified records to a report Ges Anaconda python nexisinterface py Find records within how many feet of servic NEXIS gt 15000 App SBPR 2014 9008 SEPL 2014 0067 SEPL 2014 60607 SEPL 2014 6013 SBPL 2014 0066 SEPL 2014 0066 SBPL 2614 6606 ZMOD 2014 0002 in service area in service area in service area in service area in service area in service area in service area in service area ZMOD 20
8. LAT FOR THREE 3 CLUSTER ONE 1 RURAL ECONOMY AND 7 SBPR 2015 0004 ONE 1 OPEN SPACE LOTS IN A RESIDENTIAL ZONING DISTRICT Active AR1 B S462E411 77 62035 39 13207 11729467 3 7094728 06 REQUEST APPROVAL OF A SUBDIVISION PRELIMINARY RECORD PLAT SBRD TO ESTABLISH THREE 3 LOTS IN A RESIDENTIAL 9 5BPR 2014 0008 ZONING DISTRICT SMK 10 HAH nexisReport 4 19 2015 15 57 19 2 Active TRSLBR 1 3225E 11 9 When an action is complete the user will return to the main menu and can exit by typing anything other than 1 or 2 NEXIS will close the log and remind the user the name of the log file T l Tail Pe named 11 Input Formats Loudoun Zoning and Subdivision records The Loudoun Zoning and Subdivision records must be in csv format The information must be in the following order Application ID Status Application Name Description Project Status Applicant Name 1 Applicant Name 2 File Data DD MM Y YYY Acceptance Date DD MM YYYY Completion Date DD MM YYYY Existing Zoning Pin Number Tax Map Latitude Longitude This file should not include a header row Service Area The folder containing the shape file showing NOVEC s service area must be included to determine reports To update the service area please refer to section 2 Installation Instructions 12 Using NEXIS Source Code nexisInterface py nexisInterface controls the flow of actions for NEXIS If new options to update records are add
9. T DATE What is the ending file date Leave blank to use the latest available otherwise use format YYyYY MM DD NEXIS gt USER HAS CHOSEN NO END DATE 4 To specify application types input in the form application type application type application type To specify a date input in the form YY YY MM DD for example 2015 05 08 for May 8 2015 a ae Ems Anaconda python nexisinterface py a ie a a a l USER HAS CHOSEN TO GENERATE REPORT FOR IN SERVICE AREA Application Types Available SBRD ZMOD SBPL SBPR What type of applications are you looking for Leave blank for all otherwise use format app Type app Type etc NEAIS gt SBPR SBPL USER HAS CHOSEN THE FOLLOWING APPLICATION TYPES SBPR SBPL What is the starting file date Leave blank to use the earliest available otherwise use format YyyYyY MM DD NEAIS gt 2014 01 01 USER HAS CHOSEN TO START RECORDS FROM 2014 01 01 What is the ending tile date Leave blank to use the latest available otherwise use format YyyYY MM DD NEAIS gt 2615 63 16 USER HAS CHOSEN TO END RECORDS AT 2615 63 16 5 For determining which records are in the service area NEXIS will report to the screen any records that it found and write those records into a report Ex Command Prompt python nexisinterface py USER HAS CHOSEN H END DATE App ZNOD 2614 8602 is in service area App Z2MNOD 2614 06H2 is in service area App SHBPR 2
10. ed or new reports are generated the user would need to update these menus to reflect the additional functions logger py logger is the controls for creating reading and writing to the log file If the user wanted to change those functions this is where they would do it records py records contains the records as objects If new record types are added the user can create them here For fields that may contain multiple records the user may want to make extra functions For example a zoning application may have multiple applicant names so a list of applicant names is created The zoning record may have multiple pins with associated tax map latitude and longitude so a dictionary is created to store these pins nexisDButils py nexisDButils contains all interactions with the NEXIS database This shows examples of selecting various records updating records and inserting records lolaUpdate py lolaUpdate updates the Loudoun Zoning and Subdivision records It checks the new records against the existing records and then inserts new records Functions included updateLolaRecords controls the main flow through the update sorts records from csv into existing and new records readNewDataFile reads the csv file and returns lola records checkForNewApplicationTypes or StatusTypes or Zoning Types checks the new records type verses the existing types in the database Currently new types are added to the database In the future if the
11. een is also recorded in the log file nevis 19 2015 15 24 52 Notep A cee File Edit Format View Help created log file named nexis4_19_2015_15_24_52 log USER NAME IS bsmith USER HAS CHOSEN TO UPDATE RECORDS USING A CSW USER HAS CHOSEN TO UPDATE ZONING AND SUBDIVISION RECORDS reading file sampleDatal csv INSERTING NEW RECORDS wees ee NEW RECORD ZMOD 2014 0002 added with NEXIS record number 148 Application description A zoning modification to 5 200 to permit decks that exceed 30 inches in height to encroach into the required yard Application zoning PDH4 eee ew RECORD SBPR 2015 0004 added with NEXIS record number 149 pplication description REQUEST APPROVAL OF A PRELIMINARY SUBDIVISION RECORD PLAT FOR THREE res CLUSTER ONE 1 RURAL ECONOMY AND ONE 1 OPEN SPACE LOTS IN A RESIDENTIAL ZONING DISTRICT SMK Application zoning ARL eee 2NEW RECORD SBPR 2014 0008 added with NEXIS record number 150 Application description REQUEST APPROL OF A SUBDIVISION PRELIMINARY RECORD PLAT SBRD TO ESTABLISH THREE 3 LOTS IN A RESIDENTIAL ZONING DISTRICT SMK Application zoning TR3LBR USER HAS CHOSEN TO EXIT THE SYSTEM gt gt gt THANK YOU FOR USING NEXIS lt lt Closing log named nexis4_19_2015_15_24_ 52 log 5 After the system completes modifying existing records and inserting new records the user is given the option to run the description parser on new records The description parser will attempt to identify the sector f
12. n of loudounReports py Using NEXIS To start NEXIS open a command prompt and move to the NEXIS folder 1 At the command line type python nexisInterface py Ex Command Prompt Co Users S mithBAnaconda NERITS python nexisInterface py_ 2 The first option is whether to specify the log file name or whether the log file will automatically be generated recommended The only acceptable responses are y or n Other responses will exit NEXIS If the log file is automatically generated the log file name will be nexis followed by the date and time and log E Command Prompt python nexisinterface py Co NUsers SmithB Anaconda NERITSspython nexisInterface py ALRK WELCOME TO NEXIS 33333 gt gt gt Mould you like to specify a log file name and directory y n gt HERISS m 3 The user will then need to input their database user name and password Ex Command Prompt python nexisinterface py Co wUsers SmithBAnaconda NERTSspython nexis Interface py ALLALAR WELCOME TO MERIS 3333 33 gt gt Mould you like to specify a log file name and directory Cy n gt HEIS n created log file named nexis4d _19_ 27615 15 15 37 log hsmith Please enter your password HEXIS gt 4 The user will then be able to choose between modifying the records and creating a report Modifying Records 1 To modify the records choose 1 You will then proceed to the update menu Currently only the L
13. or each record and identify any housing units For details on description parser rules see descParser py in Section 5 GA Anaconda python nexisinterfacepy a elele Tey atte Creating Reports 1 To create a report choose 2 from the main menu Ges Anaconda python nexisinterface py MAIN MENU Type o modify records with a csv file 1 Type 2 to create a report anything else to exit Type NEXIS gt 2 USER HAS CHOSEN TO CREATE A REPORT REPORT GENERATOR MENU Currently only generating reports for Loudoun County Type 1 to find records in service area Type 2 to find ords in or near service area Type anything else to return to main menu NEXIS gt im 2 The user can choose to determine whether the records are in NOVEC s service area 1 or whether the records are in or near the service area 2 3 Both reports are customizable as to application type and starting file date and ending file date To search for all leave that field blank Ei Anaconda python nexisinterface py USER HAS CHOSEN TO GENERATE REPORT FOR IN SERVICE AREA Application Types Available SBRD ZMOD SBPL SBPR What type of applications are you looking for Leave blank for all otherwise use format app Type app Type etc NEXIS gt USER HAS CHOSEN ALL APPLICTION TYPES What is the starting file date Leave blank to use the earliest available otherwise use format YYYY MM DD NEXIS gt USER HAS CHOSEN NO STAR
14. oudoun Zoning and Subdivision records can be modified UPDATE MENU 2 Input the file name or file name and path if the file is not in the same directory as nexisInterface py of the csv with modified records ee Eas Anaconda python nexisInterface py UPDATE MENU NEXIS gt USER HAS CHOSEN TO MODIFY ZONING AND SUBDIVISION RECORDS gictha she a ee oe ease enter tne tile name o i YYTE ame N a E a4 aeee WEXTIS gt sampleDatal csv 3 The system will search for existing records first and insert new records second For existing records it will report where the records are altered For new records it will report the Application ID the NEXIS record number the application description and the application Zoning Ex Command ae python nexisinterface py Please enter the file name of new LOLA records HEIS sampleDatal csy reading File sampleDatali csv EN EL RECORD ZMNOD 2614 H82 added with WEIS record number 148 Application description A zoning modification to 5 268 to permit decks th lat exceed 34H inches in height to encroach into the required yard Application zoning PDH4 3M EL RECORD SBPR 2615 Q664 added with MEKIS record number 149 Application description REQUEST APPROVAL OF A PRELIMINARY SUBDIVISTON REC ORD PLAT FOR THREE 3 gt CLUSTER ONE 1 gt RURAL ECONOMY AND ONE lt i gt OPEN SPACE LOT S IH A RESIDENTIAL ZONING DISTRICT SME Application zoning ARI DNE RECORD SEPR 2014
15. r_id INT lt _ lt lt lt _ applicant_name VARCHAR 45 p 7 company_name VARCHAR 45 phone_num ber VARCHAR 45 Pany_ 45 townhomes INT condos INT applicant_name_id INT apartm ents INT gt Deleting records To delete records from the database delete records from tables in the following order applicant_names_has_application_names applicant_names application_names housing_units zoning applications loudoun_geographic_info master_records a al ae oe ae a 16 Known Issues 1 If anew application zoning or status type is found the updater inserts that type and highlights that in the log 2 For lolaUpdate if the csv has a different applicant name or pin number it adds the new applicant name or pin number with tax map latitude and longitude It does not remove any existing applicant names or pins 17
16. ype_id INT Fanit zoning id INT status id INT application_type_id INT _type_i application_type VARCHAR 45 sector_type VARCHAR 45 county_nam e VARCHAR 45 zoning_type VARCHAR 45 status_type VARCHAR 45 pplication_typ 45 b j record_number INT oe H application_id VARCHAR 45 date_entered DATE a a ana a E a oe status_id INT ea er ae esis ee ly county_id INT Available Land Zoning and Subdivision Records zoning_application_id INT description VARCHAR 1000 project_status VARCHAR 45 9 file_date DATE acceptance_date DATE completion_date DATE land lication id INT Q e ft DECIMAL 15 3 loudoun_geographic_id INT application_name_id INT available_s ial avai ee DECIMAL 15 3 TANSAN gt application_name VARCHAR 45 pin_number VARCHAR 45 Dii d number INT timeframe VARCHAR 45 m record_number INT Ati map VARCHAR I5 gt record_number INT a latitude DECIMAL 9 6 longitude DECIMAL 9 6 application_type_id INT sector_type_id INT corridor_type_id INT record_number INT f applicant_name_id INT application_name_id INT email_address_id INT idhousing_units INT O email_address VARCHAR 45 zoning_application_id INT applicant_name_id INT applicant name_id INT gt single_family_homes INT multifam ily_homes INT phone_num be
Download Pdf Manuals
Related Search