Home
EFCS2240 User Manual v 1.1
Contents
1. ISCSI amp Fibre Channel to SCSI Page 60 If the user has an iSNS server then the address can be added in the iSNS servers list by clicking Add Server A window should appear Add iSNS Server x Enter the IP address or DNS name of server Enter the address of the iSNS Server then click OK The Microsoft iSCSI Initiator will now query the iSNS Server and discover any iSCSI Targets that are registered Step 3 Targets Click on the Targets tab The devices discovered should now be listed and shown as below iSCSI Initiator Properties Targets Discovery Favorite Targets volumes and Devices RADIUS Configuration Quick Connect To discover and log on to a target using a basic connection type the IP address or DNS name of the target and then click Quick Connect Target Quick Gonnect Discovered targets Refresh ign 2002 12 c0m 4bridgeworks 000000 6d7a85844c2f1fa8 Reconnecting ign 2002 12 com 4bridgeworks 001c03 naa S0060b000057 Reconnecting ID To connect using advanced options select a target and then arca click Connect To completely disconnect a target select the target and n then click Disconnect For target properties including configuration of sessions Properties select the target and click Properties For configuration of devices associated with a target select fesse the target and then click Devices More about basic iSCSI connections and target
2. Bridgeworks Millau EFCS2240 iSCSI amp Fibre Channel to SCSI Bridge User Manual V1 1 Bridgeworks 135 Somerford Road Christchurch Dorset BH23 3PY Tel 44 0 1202 588 588 Fax 44 0 1202 588 589 Email support 4bridgeworks com Manual Revision History Revision Date Firmware 1 0 May 2012 V3 _ 02 AP 1 1 May 2012 V3_03 AP ISCSI amp Fibre Channel to SCSI Page 2 Warning The Bridgeworks Potomac EFCS2240 iSCSI FC to SCSI Bridge contains no user serviceable components Only an Authorized Service Centre should carry out any servicing or repairs Unauthorized repairs or modifications will immediately void your warranty Before You Start There are a number of additional pieces of equipment you will require for the successful installation of your Bridge Ethernet Cable You will require a good quality cable of suitable length to go between your network access point and the Bridge This should be marked as certified to Cat 5e and have a RJ45 style connector at the Bridge end Fibre Channel Interface The Fibre Channel Bridge supports the use of SFP modules to connect to the Fibre Channel You will require the correct type to connect to your existing infrastructure If you are in doubt about the correct type please consult you reseller SCSI Cable The greatest source of SCSI related faults is poor quality SCSI cabling This is especially true when running at the higher speeds possi
3. ISCSI uses to two main network ports 3260 and 860 Within the Multipath configuration the user can specify which ports will be made available to the initiator 860 3260 or both By default the Bridge will allow up to 10 iSCSI connections per iSCSI Session However some initiators will only allow 1 iSCSI Connection per iSCSI Session and will reject any login to an iSCSI Target that tries to negotiate more iSCSI Connections Note See Appendix B for how to set up multipath on a Microsoft based Server iSCSI amp Fibre Channel to SCSI Page 26 3 7 iSCSI Sessions Each initiator will open a session with each target device to review these connections select the iSCSI secessions page from the SCSI group ICi Sessions SCS Sasslons ind i aak mi Ata a H arget t iga 1991 05 com microdoftshirk 23 Pdi barie ITI Dopin iniii i This page lists the current connections i e logged on from iSCSI hosts It displays which initiator is connected to which Target device Note Itis possible that more than one host to be connected to any target device or one host to multiple target devices Should it be required it is possible to send a logout request to a host by highlighting the host connection and pressing the logout button Note Many initiators are configured to automatically reconnect after completing the logout request If this is the case then the connections window ma
4. To change the settings of a specific connection click on the connection You will be presented with the screen as shown below where you can make changes to the connection ISCSI amp Fibre Channel to SCSI Page 16 Network Port Network 1 Port Settings MTU Sira Use DHCP to assign an IP address mulomatically O Use the following IP address IP Addiness 10 10 10 10 Helios 255 255 255 0 Gateway Pp o Use woe eb address assignment Use the following IPvi address piel ins SSE save cis O O Link Status Link Sinim Up Link Speed LOODNibA RX Hyles 161570 TX Bytes 596400 RX Errors fh TX Errore Med Address 10 10 10 120 Lit Address 3 2 3 Setting the MTU Enabling larger frames on a jumbo frame capable network can improve the performance of your backup operations Jumbo frames are Ethernet frames that contain more than 1500 bytes of payload MTU Before enabling jumbo frames ensure that all the devices hosts located on the network support the jumbo frame size that you intend to use to connect to the Bridge If you experience network related problems while using jumbo frames use a smaller jumbo frame size Consult your networking equipment documentation for additional instructions Some networking switches require you to specify the size of the jumbo frame MTU when enabling as opposed to a simple enable command On these switches it might be required to add the necessary bytes needed for the frame
5. The FC Bridge can be used on the following network configurations e 1GbFC e 2GbFC e 4GbFC It is not necessary to specify which network type you are connected to as the FC Bridge will automatically select the correct network speed when first powered up The connection to the FC network is via an industry Small Form factor Pluggable SFP interface Module that is inserted into the SFP receptacle on the front of the unit Front Panel of the Bridge Showing FC Cable Connections Note Only use an SFP that meets or exceeds the following standards EU IEC EN 60825 1 North America FCC CDRH Millau EFCS2240 Page 9 2 2 Ethernet Connection The Bridge can be used on the following network configurations e 10BaseT e 100BaseT e 1000BaseT Gigabit It is not necessary to specify which network type you are connected to as when powered up the Bridge will automatically select the correct network speed The connection to the Ethernet network is via an industry standard twisted pair RJ45 copper interface on the front of the unit To connect the Bridge to the Ethernet network insert one or two Cat 5E cables into the connector on the unit as shown below When the plug is in the correct position a click should be heard Note If you only intend to use a single network connection use the left hand network socket as this is set to 10 10 10 10 for the initial configuration of the Bridge Front Panel of the Bridge Show
6. To change the default settings of the discovery of the target portal click the Advanced button IP address or DINS name Port Default is 3260 4 I 8260 Advanced Cancel Enter an IP address for the iSCSI Target In this example we shall use the IP address of 10 10 10 99 Leave the port 3260 unless you have configured your iSCSI Bridge only to respond on port 860 in which case change it to 860 Click on the advanced button to see the advanced options Advanced Settings a Ea General IPsec Connect using Local adapter Initiator IP Defaut amp f Target portal IP CRC Checksum I Data digest IT Header digest TT Enable CHAP log on CHAP Log on information GHAP helps ensure connection security by providing authentication between a target and an initiator To use specify the same name and CHAP secret that was configured on the target for this initiator The name will default to the Initiator Name of the system unless another name is specified Mame ign 1991 05 com microsoft win d3081sidkbe Target secret F Perform mutual authentication To use mutual GH amp P either specify an initiator secret on the Gonfiguration page or use RADIUS Use RADIUS to generate user authentication credentials Use RADIUS to authenticate target credentials The Connect using box allows the user to specify which iSCSI Adaptor to use and the Source IP
7. To use mutual CHAP authentication for verifying i targets setup a CHAP secret Secret To setup IPsec tunnel mode addresses Setup dick Set up setup up What is iSCSI In this window the user is able to configure the initiator name specify the initiator secret and set up the IPsec connections For the purpose of this document we shall leave the initiator name as the default The iSCSI Bridge not support this Millau EFCS2240 Page 45 If you intend to use Mutual CHAP authentication you must enter the Initiator secret on this page Click on the secret button and a window should be displayed iSCSI Initiator Type a CHAP secret to be used to authenticate verify targets The most secure CHAP secrets are not words and phrases but a random sequence of characters Enter this same CHAP secret on the target so that the initator can connect CHAP secret Enter in the Initiator Secret and click OK The secret should be between 12 and 16 characters Make a note of this secret as you will need to enter this as part of configuring CHAP on the iSCSI Bridge Step 2 Discovery of Devices Before the user can connect to an iSCSI Target the iSCSI targets must be discovered Click on the Discovery tab and you should see the window below Favorite Targets Volumes and Devices RADIUS Discovery Target portals Address IP address ISNS servers Remove Refresh ISCSI amp Fibre Chan
8. Be Received at Bytes 8 714 66 367 O 676 681 643 Fas ess o x n n Local Area Connection Properties na Networking Connect using Select the Internet Protocol Version 4 TCP IP Realtek RTL8168D 8111D Family PCI E Gigabit Ethemet entry and then Properties This connection uses the following items DM Client for Microsoft Networks aos Packet Scheduler B File and Printer Sharing for Microsoft Networks i Intemet Protocol Version 6 TCP IPv6 es Intemet Protocol Version 4 TCP IPv4 i Link Layer Topology Discovery Mapper 1 0 Driver i Link Layer Topology Discovery Responder Install Uninstal Properties Description Transmission Control Protocol Intemet Protocol The default wide area network protocol that provides communication across diverse interconnected networks K KI RK RK RK RK K OK Cancel Millau EFCS2240 Page 43 Internet Protocol Version 4 TCP IPy4 Properties 2 eal General You can get iP settings assigned automatically if your network supporti this capabilty Otherwisa you moed to ask your network admins trator the appropriate IP settings B Cham an IP address sutomabosly i Use Bhe folowing IP address EP address 1m 10 10 11 Subewat mask 205 255 265 0 Default gateways 0 10 0 1 ft Obtain ONS server address automatically Use the foking ONS server addresses Make a Note of your current set
9. Select which Fibre Channel Port you wish the LUN to appear on Select the LUN number you wish the device to have on the Selected Fibre Channel Port Click the Add Assignment button at the bottom of the panel ISCSI amp Fibre Channel to SCSI Page 24 In the example above the Port Assignment shows you 3 devices assigned to Port 0 with the LUN numbers 0 1 and 2 Millau EFCS2240 Page 25 3 6 iSCSI Target Interface This configuration page will allow the administrator to configure the password and username for the CHAP authorisation on the Bridge From within the main menu select the iSCSI Target icon from the SCSI System group The GUI will now display the following window SCSI Target Bridge Control Authorisation Chap enabled CHAP To enable CHAP click the tick box and enter the following details e Username this is the same name as specified in the iSCSI host e Initiator Secret this is the password defined in the iSCSI host e Target Secret this is the password that the Bridge will send to the iSCSI host Multipath Settings Multipath is a method of sending data to an iSCSI target over multiple network connections These network connections can be on the same physical network cable or separate network cables By using Multipath it is possible to increase the network bandwidth to send data over A user may have a single iSCSI Session for an iSCSI Target but within that session may have multiple connections
10. 6 ib amp ol Target inieroee ana 26 3 7 ISG SI SOSSIONS aasan eO a a an 27 3 8 solita 28 3 9 Device MaANagger sas aaa 29 4 0 INIORMAatorR lle lola a 30 4 1 SVysleminiormal0tssilibb lille a 30 4 2 SV lOM LOO PERE Se ener nee 31 5 0 NQIMIENANCE lr LL LL A aN 32 5 1 Firmware UpoalesS ssa noia as 32 5 2 Saving the Configuration to DISk 33 5 3 Restoring a Saved Configuration 34 5 4 FeSIOMMG Factory DerauliS ssane ra a det dawn tiaisiesSias 34 60 TMOupesnNooiNgsss ille 35 6 1 OSE aS SWOlO aa EAEE 35 6 2 Network ISSUES ina 36 6 3 Device Related ISSSUES i 37 6 4 POOFPONONMaNC Oaia a a a iaia 38 6 5 EOSHIPZAGGFOSS ae er Ghee nent ei tee ace me ere 39 Appendix A Setting up your Computer for Initial Setup 40 AT Windows 95 980FNIgillliel a 40 A2 WindOWS 2000 22003 X Penase A 41 A3 Windows Vista Server 2008 or Vista OF 7 43 Appendix B Microsoft iSCSI Initiator iii 45 B1 Connecting to an iSCSI Device using the Microsoft iSCSI Initiator in Windows ISCSI amp Fibre Channel to SCSI Page 4 Vista server 2008 Ril OF Server 2003 ina 45 B2 Connecting to an iSCSI Device using the Microsoft iSCSI Initiator in Windows Server 2008 Zi a ia 57 Appendix G VISUAL IINOIGAIONS aaa ale 69 Appendix D Technical Specifications 70 Millau EFCS2240 Page 5 1 0 Introduction Thank you for purchasing th
11. E Important If you choose to use a browser that is not on the list of supported browsers Bridgeworks cannot guarantee the behaviour of the Nodes functionality 3 1 2 Connecting to the Web Interface From within your web browser connect to the Bridge using the address http 10 10 10 10 or if you have changed this previously the address of the left hand network port Depending on your current network parameters it may be necessary to change your network settings on your computer for the initial set up See Appendix A for further help Once you have connected to the web interface on the Bridge you will see the entry page shown below Millau EFCS2240 Page 13 To access the web interface a user name and password must be used the defaults of which are Username admin Password admin Note We suggest that you change your password at the next possible opportunity The GUI will now display the Console Home menu screen as shown below Bridge Control Console Home Reboot System Logout Support Online Help Contact Support Note For security reasons only one person can access this GUI at any one time Therefore to avoid the situation where one person forgets to logout effectively locking up the GUI incorporates a five minute idle timer which will automatically logout Millau EFCS2240 iSCSI F iSCSI FC SCSI Bridge Management Console Choose an option Network a Connections Passwords amp Serv
12. Now click on the Advanced button to see the Advanced Settings Advanced Settings 25x General IPsec Connect using Local adapter Microsoft iSCSI Initiator Initiator IP Target portal IP loft f CRC Checksum r Data digest IT Header digest TT Enable CHAP log on CHAP Log on information aaa a a a a a a a a ZZZZZZ7777 GHAF helps ensure connection security by providing authentication between a target and an initiator To use specify the same name and CHAP secret that was configured on the target for this initiator The name will default to the Initiator Name of the system unless another name is specified Name ign 1991 05 com microsoft win d3081sidkbe Target secret F Perform mutual authentication To use mutual GH amp P either specify an initiator secret on the Configuration page or use RADIUS Use RADIUS to generate user authentication credentials Use RADIUS to authenticate target credentials Cancel Apply Select the Initiator IP address and the Target Portal that you wish to connect too via the pull down menus in the Connect by using section When setting up multiple connections you ideally want to connect to different ports and different network interfaces Set up CHAP then click OK The user will now be brought back to the window below Click OK and now the user should see the Session Connections page with two connections ISCSI amp Fib
13. The Local adaptor will only differ from Microsoft iSCSI Initiator setting if an iSCSI Offload card has been installed For the purpose of this guide we shall only use the Microsoft iSCSI Initiator Leaving this setting as default will also use the Microsoft iSCSI Initiator The Initiator IP is used to specify upon which network adaptor the discovery will be done In most cases the user will want to leave this as default If multiple network interfaces are installed in the server and the user wishes to select a particular interface select the IP address of that network interface from the pull down list CRC Checksum settings allow the user to specify whether the discovery is done using Data and or Header Digests Unless the iSCSI device is on a poor quality network where data Millau EFCS2240 Page 59 corruption is likely it is recommended that Header and Data Digests are left disabled as performance will be affected If the ISCSI Bridge has had CHAP enabled or the user wishes to authenticate the ISCSI Bridge click on the checkbox Enable CHAP log on to enable CHAP Now enter the username and target secret that was configured on the ISCSI Bridge If the user wishes to authenticate the ISCSI Bridge select Perform mutual authentication Note For mutual CHAP to be performed the Initiator Secret must be set on the general tab and be the same as the one configured on the iSCSI Bridge The use of RADUS is beyond the scope of th
14. as LUNs underneath this By clicking on the blue triangle in the Device info box you can display further information about each FC device The expanded information also gives you two options Persistent LUN if you select this option the device will always be presented to the SCSI interface in exactly the same way i e the same LUN number If the device is disabled or has been removed from the FC port its LUN number will be reserved and not assigned to any other FC device Enable Disable Device This pull down menu option allows you to disable a FC device from appearing on the SCSI interface ISCSI amp Fibre Channel to SCSI Page 30 4 2 System Log This System Log page allows the administrator to view the logged status of the Bridge From within the main menu select the View Log file icon from the Bridge Maintenance section The GUI will now display the following window By stem Log system Log System Informacion 157962 Firmware Version shepherdm vI 02 Ape 23 2010 16 16 57 iam 2002 12 001 br idpevorka 030402 dan 1 18 14 20 notice kernel klogd exiting Jan 1 16 14 20 info ayalogi started BusyBow vl 11 1 Jan 1 16 14 20 norice kernel klogd started BusyBox wi i1 1 2010 04 31 14 11 51 BST Below the log display pane are two options Clear SystemLog this will delete the current and saved logs within the Bridge Download this will download the log file to your local disk You may be asked
15. by our support team to email this log file to them to aid them in any problem resolution Millau EFCS2240 Page 31 5 0 Maintenance 5 1 Firmware Updates The Firmware Updates page will allow the administrator to load new firmware into the Bridge From within the main menu select the Firmware Updates icon from the Bridge Maintenance section The GUI will now display the following window Update Finnrrare i Finnwarkt Upload From time to time it may be necessary to upgrade the firmware within the Bridge New versions contain resolutions to known issues as well as new features and improvements to the functionality of the Bridge It is advisable to check for the latest release on a regular basis New versions of the firmware can be downloaded from the Bridgeworks web site at http www 4bridgeworks com software_downloads phtml Once you have downloaded the new firmware to a local disk drive e Click on the browse button to locate the file you have downloaded from the website e Click on the update button Updating the firmware will take a few minutes after which it will be necessary to reboot the system to bring the new code into memory ISCSI amp Fibre Channel to SCSI Page 32 5 2 Saving the Configuration to Disk The Load Save Configuration page will allow the administrator to save and load the configuration parameters to a file on a local disk From within the main menu select the Load Save Configuration icon from the
16. can get wet Protect equipment from liquid intrusion If your equipment gets wet disconnect power to the equipment and to any attached devices If the Bridge is connected to an electrical outlet turn off the AC power at the circuit breaker before attempting to remove the power cables from the electrical outlet Disconnect any attached devices Use only the power supply cord set provided with the system for this unit should this not be correct for your geographical area please contact your supplier The mains plug to the rear of the unit is used as the power disconnect device please ensure that this is kept clear from any obstruction and is visible at all times Before installing or removing signal cables ensure that the power cables for the system unit and all attached devices are unplugged To prevent electrical shock hazard disconnect the power cable from the electrical outlet before relocating the system Class 1 Laser Product Certain models will use a Small Form Factor Pluggable GBIC module for connection to an optical network These devices may use a Class 1 Laser device it is important that you do not stare into the Laser beam ISCSI amp Fibre Channel to SCSI Page 8 2 0 Installing the EFCS2240 Bridge There are 5 basic steps to installing the EFCS2240 Bridge Connecting the Fibre Channel cables Connecting the iSCSI Ethernet cables Connecting the SCSI cables Connecting the Power Supply 2 1 Fibre Channel Connection
17. header i e header information MTU Typical header size is 28 bytes so a 9000 byte MTU would translate to 9028 byte setting Refer to your switch documentation to understand what the maximum frame size settings are for your switch 3 2 4 Setting the IP Address There are two possibilities when configuring the IP address for the Bridge DHCP the Bridge will seek out the DHCP server on your network and obtain an IP address from the server each time it powers up Static IP the IP address set in this page will be the IP address the unit will use each time it powers up Depending on your configuration either click the DHCP button or set your Static IP address Note If you select the DHCP mode ensure your DHCP server is set to automatically update the DNS server 3 2 5 Setting the Subnet Mask If the Bridge is configured to use DHCP the net mask will be issued from the DHCP server If you are using static IP address enter the IP mask in this box 3 2 6 Setting the Gateway Address Enter in this box the address of your gateway controller for your network Millau EFCS2240 Page 17 3 2 7 Setting an IPv6 IP Address If IPv6 is enabled on the network connections page here you can choose to use DHCP to automatically assign an IPv6 address or you can set a static IPv6 address If you choose to assign a static IPv6 address you will also need to assign an IPv6 subnet mask 3 2 8 Committing the changes Note Befo
18. that the cables between the Bridge and the devices are connected Connect to the Bridge via the GUI and check that devices are present in the Device management window and are enabled you will need to drill down each device entry to see this option If you can ping the Bridge but the GUI fails to appear check the setting within the Web Browser you are using If you are directly connected to the Bridge then any proxy setting will require adjustment and may require you to contact your administrator Ensure that the CHAP settings for the initiator and the Bridge are the same A common mistake is when enabling CHAP only for a device after the initial discovery by the initiator It will be necessary to remove the address from the discoveries tab and recreate it with the appropriate CHAP settings otherwise any rediscoveries will be attempted without CHAP and no devices will be returned Force a rediscovery from the initiator Reboot the devices and Bridge If none of the above resolves your problem please contact support Millau EFCS2240 Page 37 6 4 Poor Performance Poor performance can be caused by many differing reasons The following checklist is provided as a guide to where you may find ways to improve performance Ensure your initiator and Bridge are communicating at the fastest possible network speed Within the GUI is the Network Connections window select this and check the Link Speed entry in each of the Link Stat
19. up then Click Use the following IP Address Enter 10 10 10 11 into the IP Address field Enter 255 255 255 0 into the Subnet Mask field Finally click the OK button Note Once you have completed the initial set up of the Bridge return your computer to the original settings and reconnect to the Bridge iSCSI amp Fibre Channel to SCSI Page 44 Appendix B Microsoft iSCSI Initiator B1 Connecting to an iSCSI Device using the Microsoft iSCSI Initiator in Windows Vista Server 2008 R1 or Server 2003 There are many iSCSI Initiators available However for the purpose of this user guide we shall concentrate only on the Microsoft iSCSI Initiator In this example we have used the Microsoft iSCSI that is available with Microsoft Vista However the following procedure should be identical for all versions of Microsoft iSCSI Initiator Step 1 General Set up Open the iSCSI initiator and then click on the General Tab You should see a window as shown below iSCSI Initiator Properties Favorite Targets mol Volumes and Devices RADIUS General m Discovery Targets a iSCSI devices are disk tapes CDs and other storage devices on another computer on your network that you can connect to Your computer is called an initiator because it initiates the connection to the iSCSI device which is called a target Initiator Name ign 1991 05 com microsoft tarquin vista To rename the initiator dick Change Change
20. 000000 _ IBM ULTS560 HH4 Rev 8192 Sequential Accar Device apo a Rermeoveble Media 4 eui SO00f142220592005 1 0 0000000000000006 o 0 0 0 IT Enabled Clear Configuration Update Configuration In the first Box at the top of the screen are a number of options for configuring how the Bridge will present the devices on the SCSI interface e Single Target with Multiple LUNs Choose this option if you require all the devices on the ports to appear as a single WWN with devices as LUN underneath this By clicking on the blue triangle in the Device info box you can display further information about each device The expanded information also gives you a device control option Enable Disable Device This pull down menu option allows you to disable a device from appearing on the SCSI interface Millau EFCS2240 Page 29 4 0 Information 4 1 System Information This configuration page will allow the administrator to configure a number of parameters that control the behaviour of the FC bus From within the main menu select the Device Management section The GUI will now display the following window e Device Info In the first Box at the top of the screen are a number of options for configuring how the Bridge will present the FC devices on the SCSI interface e Single Target with Multiple LUNs Choose this option if you require all the devices on the FC ports to appear as a single WWN with devices
21. 1 NTP The Network Time Protocol NTP is a protocol for synchronising the clocks of computer systems over the IP network This is used by the Bridge to synchronise its internal clock with the rest of the network This configuration page will allow the administrator to configure the IP addresses for the Network Time Domain server From within the main menu select the Service Control icon under the Network section The GUI will now display the following window Node Control Console Home E Network Time Protocol SNTP Service Control Reboot System Use NTP ni Logout Support Event Notification Email Enable Email Alerts ni Online Help Contact Support n Recipient Email Address ESE Sender Email Address e e Ela ae A arning Events Y SMTP Server SMTP Password To enable NTP on the Bridge click the tick box and enter the IP address for the NTP Server and then click the save button 3 4 2 Email Alerts The Bridge can notify a systems administrator when certain level log events are observed in the Bridges logs To enable email alerts on the Bridge click the tick box next to Enable Alerts this will allow you to alter the contents of the currently greyed out fields The following fields need to be completed Recipient Email Address This is the email address to which the emails will be sent Senders Email Address This is the email address that emails will be sent from This can be any addre
22. 3C9 3 Dial Up Adapter Y TCP IP gt 3Com Fast EtherLink XL 10 100Mb TX Etherne TCP IP gt Dial Up Adapter Select the TCP IP entry Then the Properties Button i Remove Properties Primary Network Logon Client for Microsoft Networks v File and Print Sharing Description TCP IP is the protocol you use to connect to the Internet and wide area networks Click on the IP Address tab Bindings Advanced MetBlos DNS Configuration Gateway WINS Configuration P Address Make a Note of your current set up then AnlP address can be automatically assigned to this computer IF your network does not automatically assign IP addresses ask pour network administrator for an address and then type it in the space below Click on the Specify an IP address button i Obtain an P address automatically e Specify an P address Enter 10 10 10 11 into the IP Address field Enter 255 255 255 0 into the Subnet Mask field Finally click the OK button and reboot your computer Note Once you have completed the initial set up of the Bridge return your computer to the original settings and reconnect to the Bridge iSCSI amp Fibre Channel to SCSI Page 40 A2 Windows 2000 2003 XP If your computer is running Windows 2000 2003 or XP follow the instructions below For users with Windows 95 98 or NT instructions are detailed in Appendix A1 and for Windows Server 2008 7 or Vista
23. 5 0 into the Subnet Mask field _ Advanced Finally click the OK button OK Cancel Note Once you have completed the initial set up of the Bridge return your computer to the original settings and reconnect to the Bridge ISCSI amp Fibre Channel to SCSI Page 42 A3 Windows Vista Server 2008 or Vista or 7 If your computer is running Windows Vista or 7 follow the instructions below For users with Windows 95 98 or NT instructions are detailed in Appendix A1 and for Windows 2000 2003 or XP instructions are detailed in Appendix A2 From the Start menu select Control Panel e Keme yout baci neo inisemazion andsetupeanneetens From the control panel select the CE ani sl re Ta Do e Network and Internet link followed ee duro nit Pigi bisi by the Network and Sharing PARE iero uses Centre link db Matita Atimatipe istered CB pig rare hang sario sfila Lal up d Paha Pina je T airi art que AL ceed dei i Peter oe A E HE up eee ae aro peed Now you can see the Local Area La Pin ened H ag to Od eta fleet er connection dialogue box Double click Local Area Connections a Po Palate res al e ed gel es Bim ani peer bee oe tee career eee ee Pn iP ees ty ETTI ardea poles i Capa ai Hj Perth ge e aE Local Area Connection Status A general status page will be displayed From within Internet this page select Properties ho Intermat Bee Eraikia Li days 09 37 18 LO Ghee Sent
24. Bridge Maintenance section The GUI will now display the following window Bridge Control Load Save Configuration Console Home Import Configuration ei tro Note after uploading a new configuration you will need to reboot the bridge Support Online Help Contact Support Export Configuration r Restore Defaults o H CH Once you have finished configuring your Bridge we recommend that you save your configuration data to a local disk By doing so you could save valuable time if the unit requires replacement or if you require restoring an old firmware version as the configuration may change due to upgrades It is possible to create a Boiler Plate configuration and load this into each new Bridge as it is initialised This can ease the rollout of multiple Bridges within an enterprise To save the configuration data click on the Click here to Download link from within the Export Configuration window located in the centre of the page Depending on the browser you are using select the option to save file to disk The Bridge will now download an encoded file that contains all the configuration settings for the Bridge Millau EFCS2240 Page 33 5 3 Restoring a Saved Configuration To reload the configuration click on the Browse button and locate the required configuration to upload into the Bridge Once located click the upload button and the new configuration data will be uploaded On
25. Ethernet Status EE General A general status page will be displayed From within this Connection page select Properties hi Speed 1 0 Gbps m Activity Sent cp Received L th Packets 50 720 86 280 Close Millau EFCS2240 Page 41 Gigabit Ethernet Properties 2 xi General Sharing Connect using BY NETGEAR GA311 Gigabit Adapter Configure Components checked are used by this connection o starei Select the Internet Protocol TCP IP entry and then O amp Network Load Balancing P ro pe rt i es v 8 File and Printer Sharing for Microsoft Networks M 7 Internet Protocol TCP IP Install Uninstall Properties Description Allows your computer to access resources on a Microsoft network MV Show icon in taskbar when connected Internet Protocol TCP IP Properties 2 x General You can get IP settings assigned automatically if your network supports this capability Otherwise vou need to ask your network administrator for the appropriate P settings Obtain an IP address automaticaly Make a Note of your current set up then Use the following IP address IP address 10 10 10 11 es ELEME Click Use the following IP Address Default gateway fs s g PIPAON avea conica Enter 10 10 10 11 into the IP Address field Use the following DNS server addresses Preferred DNS server are a A m Enter 255 255 25
26. M Configure Multiple Connected Session MCS To add additional connections to a session or configure the MCS policy For a selected session MCS click MCS More Information on iSCSI Sessions Now click on OK to return to the Microsoft iSCSI Initiator main window Millau EFCS2240 Page 67 Step 6 Logging off an iSCSI Session To log off an iSCSI Session follow the following procedure e Open the Microsoft iSCSI Initiator and click on the Targets tab e Click on the iSCSI session that the user wishes to log off e Click the Disconnect button This will log off all connections associated with the ISCSI Session e The iSCSI device should now show as inactive ISCSI amp Fibre Channel to SCSI Page 68 Appendix C Visual Indicators Ethernet On Link Off No Link On 1000Mb s Flashing Data nA P Off 10 100mb s Fibre Channel Flashing No Link Solid Link _ aA FC Link Speed 1 Flash 1Gb 2 Flash 2Gb 3 Flash 4Gb SCSI Channel 2 n 7 Channel Flashing Data transfer Note During heavy data transfers the LEDs may appear off for an extended period Millau EFCS2240 Page 69 Appendix D Technical Specifications Physical 19 1U Rack mount 170mm 10 6 in 44mm 1 7 in 437mm 17 2 in 5 1Kg Form Factor Depth Height Width Weight Recommended minimum clearance for cooling 100mm 4 in on front and rear faces 110 240V 50 60Hz 1 Amp Maximum 60
27. Watts Maximum Input voltage Frequency Input current Maximum Power Consumption Environmental Operating O to 40C 32F to 104F Non Operating 20C to 60C 4F to 140F Operating Humidity 5 to 90 Non condensing Storage Humidity 5 to 90 Non condensing Operating Altitude 3 000m 9 842ft Non Operating Altitude 8 000m 26 250ft Fibre Channel Interface 2 SFP connectors 4Gb 2Gb 1Gb Auto or manual selected FC AL FC PLDA FC PH FC FLA FCP SCSI Physical Interface Speed Protocol FC FS FC TAPE NL Port FL_Port F_Port N_Port Topology Visual Indicators iSCSI Interface Physical Link connection Link Speed RJ 45 10 100 1000 Mb s IPv4 IPv6 CHAP DHCP NTP iSNS ISCSI RFC3270 3721 ERLO ERL1 ERL2 Link Activity Speed Protocol ISCSI Protocol Visual Indicators SCSI Interface Physical VHDLC 68way LVD SE ISCSI amp Fibre Channel to SCSI Page 70 Auto negotiation up to Ultra160 Ultra 320 Width Auto negotiation for narrow and wide Visual Indicators SCSI Bus busy Millau EFCS2240 Page 71
28. all plug is removed or switched off Connect the Power Supply to the rear of the Bridge as shown below Yj Note Before powering up the Bridge ensure all the peripherals are powered up and you have a connection to the network To turn on the Bridge use the switch next to the power connector and push in the button The image above shows the button in the off position Whenever the Bridge is powered on the blue LED on the front panel will be illuminated Now that the Bridge is installed the next stage is to configure it This is described in the next chapter ISCSI amp Fibre Channel to SCSI Page 12 3 0 Configuring the EFCS2240 Bridge Before the EFCS2240 Bridge can be used on the network for the first time it is necessary to configure a number of parameters 3 1 Using the Web Interface Now that the Bridge is fully connected the primary method for configuring any option is through its web interface The following section highlights the requirements needed to access these pages and the consistent layout used throughout a Note The default IP address of the web interface for the Bridge is http 10 10 10 10 3 1 1 Browsers This Bridge supports the following browsers Microsoft Internet Explorer 7 Microsoft Internet Explorer 8 Microsoft Internet Explorer 9 Mozilla Firefox 9 Mozilla Firefox 10 Google Chrome Latest a Note JavaScript must be enabled within the web browser to use the web interfaces functionality
29. ame Status ign 1988 11 com dell b9ad34 spi 6 0 0 Connected ign 1988 11 com dell b9ad34 spi 6 0 1 Inactive Millau EFCS2240 Page 51 Step 4 Viewing iSCSI Session Details Now that the user has connected to an iSCSI Target to check that the device is connected click on the Details button A window should appear Session Properties Target portal group 1 Status Connected Connection count 1 Session Connections To configure how the connections within this session are load balanced dick Connections Connections In this window the user can view the iSCSI Sessions associated to the iSCSI Target how many connections are attached to each iSCSI Session and the Target Portal Group If the user clicks on the Device tab he should see details of the target device Here we can see that the device is an IBM LTO Tape drive Sessions Devices Properties These are the devices exposed by iSCSI sessions to the target Click Advanced to view information about the device and configure the multipath policy Devices Device Name MPIO Capable IBM ULTRIUM HH3 SCSI Sequential Device LTO Tape drive ISCSI amp Fibre Channel to SCSI Page 52 Step 5 Creating multiple connections Optional If the user wishes to create multiple connections to an iSCSI Session return to the Session tab in the Target Properties window Click on the Connections button and a window should appear This is shown below Session Conne
30. ame of the target and then click Quick Connect Target Quick Gonneck Discovered targets Refresh ign 2002 12 com 4bridgeworks 000000 9774098e36978 Connected ign 2002 12 com 4bridgeworks 000000 977d0a8e36978 Inactive To connect using advanced options select a target and then click Connect To completely disconnect a target select the target and Disconnect then click Disconnect For target properties including configuration of sessions Properties select the target and click Properties For configuration of devices associated with a target select Devices the target and then click Devices More about basic iSCSI connections and targets OK Cancel Apply Millau EFCS2240 Page 63 Step 4 Viewing iSCSI Session Details Now that the user has connected to an iSCSI Target to check that the device is connected click on the Properties button A window should appear Properties Ez Sessions Portal Groups CO fffffasoo1770018 4000013700000008 To add a session click Add session Add session To disconnect one or more sessions select each Disconnect session and then click Disconnect To view devices associated with a session select Devices a session and then click Devices Session Information Target portal group tag 1 Status Connected Connection count 1 Maximum Allowed Connections 10 Authentication None Specified Header Digest None Speci
31. ble with this Bridge We therefore recommend that you purchase a good quality SCSI 3 compatible cable with High Density 68 way D type connecior for your installation If you are in any doubt contact your reseller for extra assistance Millau EFCS2240 Page 3 Table of Contents 1 0 INIFOGUGIO Rae oi 6 1 1 OVE iaia rie 6 1 2 VERE Layout RR ERE RR EE 7 1 9 Delilions ellllllahLi luci ai 7 WA ode NOICE S apa a a a 8 2 0 Installing the EFCS2240 Bridge 9 2 1 Fibre Channel Connection 9 2 2 EMermerConneclon sgnalai iii 10 2 3 SOS BUS COnNnecions lla 11 2 4 Connecting the Power SUpplY i 12 3 0 Configuring the EFCS2240 Bridge 13 3 1 Using the Web Interface ii 13 deli LOWS Sacco 13 3 1 2 Connecting to the Web Interfaca 13 3 2 Configuring the Network Parameters 16 d 2 1 SNN Me Hostnam cllea ela 16 d 2 2 E0aDINOIPVO eiea a e a 16 329 Seng The MEU cilea 17 324 Sellingiihe IP Address Lelli eil 17 d 2 5 OGUN Me SUBNET Mask lecca 17 3 2 6 Setting the Gateway Address 17 3 2 7 Selingran IPV6 IPAGANESS ciiiii ia 18 3 2 8 Committing the changes EAEE EENES ENEE 18 3 2 9 Reconnect to the BAGS 18 3 3 Passwords and Sei ilaele aiiclahai 19 3 4 NetworkSenicesisiplaleiosliede a 20 ll NR cani 20 342 EMANATI 20 43 iaia ian 21 3 5 FC PANO el WLC AGC sio ici i 22 3
32. ce completed use the various configuration pages to make any further adjustments required and then reboot the system 5 4 Restoring Factory Defaults By clicking on this button all the parameters will be set back to the factory defaults This includes IP address hostname and passwords We recommend that if you return the Bridge for maintenance that you reset to defaults to protect passwords and other sensitive information ISCSI amp Fibre Channel to SCSI Page 34 6 0 Trouble shooting 6 1 Lost Password If you have lost the admin password it is possible to reset it with help from Bridgeworks Challenge 240Qo SC DA First ensure that there is nothing entered into the user field and then type PASSWORDRESET into the password field The unit will respond with a challenge key Copy this key into an email along with your name company and contact details you must include your company s personnel email address for security purposes Send this email to support 4bridgeworks com and a key will be returned for you to enter into the key field Press the reset button once you have entered the key this will reset the admin user password back to admin Millau EFCS2240 Page 35 6 2 Network Issues Under normal operation you should be able to ping the network address of the Bridge and receive a response If this fails run through the following checklist to help you identify the problem Ensure that the Bridge is p
33. covery will be done In most cases the user will want to leave this as default If multiple network interfaces are installed in the Server and the user wishes to select a particular interface select the IP address of that network interface from the pull down list Millau EFCS2240 Page 47 CRC Checksum settings allow the user to specify whether the discovery is done using Data and or Header Digests Unless the iSCSI device is on a poor quality network where data corruption is likely it is recommended then Header and Data Digests are left disabled as performance will be affected If the iSCSI Bridge has had CHAP enabled or the user wishes to authenticate the iSCSI Bridge click on the checkbox CHAP login information to enable CHAP Now enter the username and target secret that was configured on the iSCSI Bridge If the user wishes to authenticate the iSCSI Bridge select Perform mutual authentication Note For mutual CHAP to be performed the Initiator Secret must be set on the general tab and be the same as the one configured on the iSCSI Bridge The use of RADUS is beyond the scope of this guide Once the user is satisfied that all advanced options are correct click OK The user should now see a window as below Add Target Portal Type the IP address or DNS name and port number of the portal you want to add To select settings for the discovery session to the portal click Advanced IP address or DNS name Now cl
34. ction Target name n 1988 11 com dell b9ad34 spi 6 0 Advanced etica Cancel Millau EFCS2240 Page 53 Now click on the Advanced button to see the Advanced Settings Connect by using ad Local adapter Microsoft iSCSI Initiator Source IP 10 10 11 56 X Target portal 10 10 11 50 3260 X CRC Checksum Data digest Header digest CHAP logon information CHAF helps ensure data security by providing authentication between a target and an initiator To use it specify the same target CHAP secret that was configured on the target for this initiator User name ign 1991 05 com microsoft tarquin vista Target secret Use RADIUS to generate user authentication credentials _ Perform mutual authentication To use mutual CHAP either specify an initiator secret on the Initiator Settings page or use RADIUS The same secret must be configured on the target Use RADIUS to authenticate target credentials Select the Source IP address and the Target Portal that you wish to connect too via the pull down menus in the Connect by using section When setting up multiple connections you ideally want to connect to different ports and different network interfaces In this example we have connected to 10 10 10 50 3260 as the leading connection and the second connection will be 10 10 11 50 3260 The corresponding network configuration on the iSCSI Bridge for the example above is show
35. ctions Connections Load balance policy Round Robin Description The round robin policy attempts to evenly distribute incoming requests to all processing paths This session has the following connections Source Portal Target Portal Status Type Weight C 10 0 0 237 5 10 10 10 50 4 Conne Active nja 0 The Session Connections window shows how many iSCSI Connections are active and the type of load balance used For all iSCSI Sessions there will be at least one leading connection ISCSI connections can be added and removed at any time all apart from the leading connection which can only be removed when the iSCSI Session is logged off The Load balance policy specifies how the data is distributed over multiple connections The main policies that should be used are Round Robin and Fail Over Only Round Robin will utilize all connections for data and evenly distribute the data Fail Over Only will use the Leading connection for data transfer If a connection should go down then the data transfer shall switch on one of the other connections For most purposes Round Robin will provide the greatest performance increase If you have been experiencing a performance decrease when transferring data to more than one device using multiple connections please refer to the trouble shooting guide To add a new connection to a session click on the Add button and a new window should appear Add Conne
36. e Bridgeworks iSCSI amp Fibre Channel to SCSI Bridge The EFCS2240 Bridge has been designed to ensure that in the majority of installations it will require the minimum of set up before use However we suggest you read the following which will guide you through setting up the iSCSI and Fibre Channel Networks as well as the SCSI aspects of the EFCS2240 Bridge The GUI Management section will guide you through the initial set up required to install the Bridge on to your network 1 1 Overview The EFCS2240 Bridge creates an interface between both iSCSI and Fibre Channel networks and peripherals that utilise the SCSI protocol The internal circuitry of the EFCS2240 Bridge acts as a two way interface converting the data packets that are received on either the iSCSI or Fibre Channel network into data transfers and electrical signals that storage devices such as disks tape drives and optical disks understand on the SCSI bus ISCSI amp Fibre Channel to SCSI Page 6 1 2 Manual Layout Throughout the manual symbols will be used to quickly identify different pieces of information ate This icon represents a note of interest about a step or section of information E This icon represents an important piece of information This icon represents a warning care must be taken and the warning should be read thoroughly 1 3 Definitions In order to understand the process of identifying and configuring devices on the SCSI bus for the Server to c
37. e a connection select the connection above and then REM click Remove To edit the path settings for the MES policy select a Edit connection above and then click Edit Sal e The Multiple Connected Session window shows how many iSCSI Connections are active and the type of load balance used For all iSCSI Sessions there will be at least one leading connection iSCSI connections can be added and removed at any time all apart from the leading connection which can only be removed when the iSCSI Session is logged off The MCS policy specifies how the data is distributed over multiple connections The main policies that should be used are Round Robin and Fail Over Only Round Robin will utilize all connections for data and evenly distribute the data Fail Over Only will use the Leading connection for data transfer If a connection should go down then the data transfer shall switch on one of the other connections For most purposes Round Robin will provide the greatest performance increase If you have been experiencing a performance decrease when transferring data to more than one device using multiple connections please refer to the trouble shooting guide To add a new connection to a session click on the Add button and a new window should appear Millau EFCS2240 Page 65 Add Connection Target name qn 2002 12 c0m 4bridgeworks 000000 977d0a8236978526 000000000 Advanced Cancel
38. e target To clear the secret from the initiator click Clear and then Cancel Initiator CHAF secret Enter in the initiator secret and click OK The secret should be between 12 and 16 characters Make a note of this secret as you will need to enter this as part of configuring CHAP on the iSCSI Bridge Step 2 Discovery of Devices Before the user can connect to an iSCSI Target the targets must be discovered Click on the Discovery tab and you should see the window below iSCSI Initiator Properties Ea Targets Discovery Favorite Targets Yolumes and Devices RADIUS Configuration Target portals The system will look for Targets on Following portals Refresh Address Port Adapter IP address To add a target portal click Discover Portal Discover Portal To remove a target portal select the address above and then click Remove ISNS servers The system is registered on the following iSNS servers Refresh To add an iSNS server click Add Server Add Server To remove an iSNS server select the server above and then click Remove Remove More about Discovery and iSNS OK Cancel Apply ISCSI amp Fibre Channel to SCSI Page 58 To add an iSCSI Target portal click on Discover Portal The user should now be presented with a window Discover Target Portal Enter the IF address or DNS name and port number of the portal you want to add
39. erring large amounts of data then the response from the GUI may seem a little slow as the process that controls the GUI has the lowest priority for Network and CPU resources It is possible to configure the Bridge so that the data from the initiator is balanced across both the Network Connections Ensure that you have connected and configured these in accordance with Appendix C and not by enabling the Multipath connection option in the Windows initiator login screen You should also check the routing tables in your switches routers and initiator to ensure both IP addresses are not routed down one Network link at any stage ISCSI amp Fibre Channel to SCSI Page 38 6 5 LostIP Address Introduction The utility will find any device irrespective of its IP address this can be helpful in determining the IP address of a Bridgeworks device with an unknown IP address and for checking the number of Bridgeworks devices on a network Downloading LAN Scan The utility can be downloaded from hnttp www 4bridgeworks com support software shtml How to use LAN Scan The utility is available under both Windows and Linux and is a CLI based tool The downloaded file is in zip format and contains the files lanscan lanscan exe and lanscan bat For the GNU Linux operating system the lanscan executable is needed For the Windows operating system the lanscan exe and lanscan bat files are required Linux Execute lanscan within a console and the output i
40. fied Data Digest None Specified Configure Multiple Connected Session MCS To add additional connections to a session or configure the MCS policy for a selected session MGS click MCS More Information on iSCSI Sessions OK Cancel In this window the user can view the iSCSI Sessions associated to the iSCSI Target how many connections are attached to each iSCSI Session and the Target Portal Group If the user clicks on the Devices tab he should see details of the target device Fort 2 Bus 0 Target 0 LUN O Volume path names Legacy device name Device interface name 21 Gi Configure Multipath IO MPIC To configure the MPIO policy for a selected device click MPIO MEID Information On iSCSI Device Details ISCSI amp Fibre Channel to SCSI Page 64 Step 5 Creating multiple connections Optional If the user wishes to create multiple connections to an iSCSI Session return to the Session tab in the Target Properties window Click on the MCS button and a window should appear This is shown below Multiple Connected Session MCS Ea MCS policy Description The round robin policy attempts to evenly distribute incoming requests to all processing paths This session has the following connections Source Portal Target Portal Weight 0 0 0 0 61894 10 10 10 107 3 Connected Active nia Oo E To add a connection click Add Add To remov
41. g window Bridgeworks Fibre Channel Target Management Console Bridge Control Global settings PortMap Port List Support Port 0 1234567C90123450 Online Help l Status Configuration Hosts Port 1 1234567E90123450 L Configuration Connected Hosts The left hand most icons display the current state of each Fibre Channel Port The green red arrow display whether the port is up or down whilst the number displays the negotiated Fibre Channel speed Clicking on the icon will take you into a further screen displaying more detailed information Port Configuration Now select the first of the ports configuration icon The Screen will now display the following Fibre Channel Target Port Configuration Bridge Control Port O Change Current Congifuration Port Enable Nd AUTO e Use Hard ALPA I Contact Support Support Restetto Defaults The first parameter is the link enable check box ISCSI amp Fibre Channel to SCSI Page 22 Check this to enable the link on to the FC SAN The link speed pull down menu allows you to select the FC network speed We recommend you select the automatic option from the pull down menu Topology this allows you to force the FC topology when the Bridge logs on to the FC network Note We suggest you leave this unchecked unless you are conversant with the lower levels of the Fibre Channel protocol as certain ALPA addresses are reserved Save This
42. ice Control Security SCSI Systems FIBRE T n ASTA sa dq age Eh I DRD A CHANNEL S FC Target iSCSI Target iSCSI Sessions SCSI Initiator Local Device Management Bridge Maintenance System View Log file Load Save Firmware Information Configuration Updates any user after this period Within the Support section there is a link that will open up your mail service with Bridgeworks iSCSI amp Fibre Channel to SCSI Page 14 the Bridge Email address loaded and an Online Help button The Online help is contextually aware of which GUI page you are currently viewing and will provide you with help relevant to the display and configuration data Millau EFCS2240 Page 15 3 2 Configuring the Network Parameters Click on the Connections icon to enter the network configuration page Network Connecilons filohal Network Configuration Network Intlerlaces Network 1 Connpched Network 2 anbeclud TOGIH is Contec 1000 UO LOS AR OA Lb a 3 2 1 Setting the Hostname In this box enter the name you wish to use to address this Bridge in the future We suggest that you use a name that is relevant to its location and or its purpose Note If you select the DHCP mode ensure your DHCP server is set to automatically update the DNS server 3 2 2 Enabling IPv6 Checking this box will enable the Bridge to use IPv6 IP addresses As with lov4 you can either choose to use DHCP or assign a static IPv6 address
43. ick OK and the Microsoft iSCSI Initiator shall perform the discovery This usually performs quickly but can take up to a minute with multiple network ports Once the discovery is complete the user should see the target listed in the Target Portals list iSCSI Initiator Properties Favorite Targets Volumes and Devices RADIUS General Discovery Targets Target portals Address Port Adapter IP address 10 10 10 50 3260 Default Default __AddPortal J Remove Refresh ISNS servers Mame iSCSI amp Fibre Channel to SCSI Page 48 If the user has an iSNS server then the address can be added in the iSNS servers list by clicking Add A window should appear Add ISNS Server IP address or DNS name of server Enter the address of the iSNS Server then click OK The Microsoft iSCSI Initiator will now query the iSNS Server and discover any iSCSI Targets that are registered Step 3 Targets Click on the Targets tab The devices discovered should now be listed and shown as below ra iSCSI Initiator Properties Favorite Targets Volumes and Devices To access storage devices for a target select the target and then dick Log on To see information about sessions connections and devices for a target dick Details Targets Mame ign 1988 11 com dell b 9ad34 spi 6 0 0 ign 1988 11 com dell b9ad34 spi 6 0 1 In this example two iSCSI targets have been discovered The first device is the
44. ime is the length of time given to allow devices to reset before issuing commands Some older devices may take longer than the default 3 seconds which may cause them to be missed when the Bridge rescans the SCSI bus Increase this parameter in small steps only Advanced Options The following settings should only be changed if instructed by your support channel e Maximum Commands per LUN This is the maximum of commands that the Bridge will allow any one device to accept at any one time Default 64 e Disable Wide Transfers This forces the SCSI bus to work in Narrow Mode 8 bit only Default off e Disable Synchronous Transfers This forces the SCSI bus to transfer in Asynchronous Mode only Default off Selecting either of the last two options will have a detrimental affect on the performance of the Bridge ISCSI amp Fibre Channel to SCSI Page 28 3 9 Device Manager This configuration page will allow the administrator to configure a number of parameters that control the behavior of the bus From within the main menu select the Device Management section The GUI will now display the following window Device Management Global Settings Persistent LUN by Dewvice s SCSIID Mapping Type Multiple Targets with Single LUN re Save Support Online Help Device Info Contact Support Teui s000f13132f22002 1 0x0000000000000000 Teui 5000E12112E32002 0x0000000000000000 Toul S0000122222092002 L 0x0001 000000
45. ing Ethernet Cable Connections ISCSI amp Fibre Channel to SCSI Page 10 2 3 SCSI BUS Connections The SCSI bus on the Bridge is capable of running at speeds of up to 160 Mbytes s However devices that operate at slower speeds can still be connected to this SCSI bus In a manner similar to the Ethernet connection the Bridge will automatically negotiate with these devices to obtain their optimal operating speed upon power up When adding your SCSI Servers to the SCSI bus it is important to remember that every device on the SCSI bus must have a unique SCSI ID and it is normal for SCSI ID 7 to be reserved for the Server The Bridge can support both single ended and LVD Servers However it should be noted that the two bus types have different data transfer speeds and cable length limitations e Single ended termination and or devices 2 metres length 40 MB s maximum e LVD termination and or devices 6 metres length variable speeds up to a maximum of 160 MB s If you are in any doubt please contact your reseller for further assistance Connect the SCSI cable to the front of the Bridge as shown below ensuring that the connector is the correct way up Connecting the SCSI Cable to the Bridge SCSI Port Yi Note The two securing screws on either side of the connector should ONLY BE FINGER TIGHT Millau EFCS2240 Page 11 2 4 Connecting the Power Supply Before connecting the Power Supply to the unit ensure the w
46. instructions are detailed in Appendix A3 From the Desktop or Start menu select My Computer pe tei In the My Computer window select Network Back faq hi GyFolders History MS G2 x mE i PRA Amo l Oa and Dial up Connections positioned in the c bottom left hand corner oq Ja Floppy 4 314 Inch Floppy Disk Local Disk C13 Local Disk 13 9 My Computer amp compact Disc D Compact Disc amp Data on ntserver Network Drive Select an item to view its Control Panel System Folder description Displays the files and folders on your computer See also My Documents My Network Places Network and Dial up Connections Ur 2 IE my Computer 5 objects From within the displayed Network and Fie Edit View Favorites Tools Advanced Help L a ls i e es e EEA Dial up Connections select the interface address emariinwiname 3 amg Pe connection that will be used to connect to the Bridge in this example we have brr sa se selected the Gigabit Ethernet interface Gigabit Ethernet LAN Network and Dial up Connections This folder contains network connections for this computer and a wizard to help you create a new connection To create a new connection click Make New Connection To open a connection click its icon To access settings and componens nf a rannectinn_rinbt eliel iran p a gt 13 object s Z Gigabit
47. is guide Once the user is satisfied that all advanced options are correct click OK The user should now see a window as below Discover Target Portal Ea Enter the IF address or DNS name and port number of the portal you want to add To change the default settings of the discovery of the target portal click the Advanced button IP address or ONS name Port Default is 3260 4 10 10 10 99 8260 Advanced Cancel Now click OK and the Microsoft iSCSI Initiator shall perform the discovery This usually performs quickly but can take up to a minute with multiple network ports Once the discovery is complete the user should see the target listed in the Target Portals list iSCSI Initiator Properties xi Targets Discovery Favorite Targets Volumes and Devices RADIUS Configuration Target portals The system will look for Targets on following portals Refresh Address Port Adapter IP address 10 10 10 99 3260 Microsoft iSCSI Initiator 10 10 10 99 To add a target portal click Discover Portal Discover Portal To remove a target portal select the address above and Remove then click Remove MISNS servers The system is registered on the following iSNS servers Refresh To add an iSNS server click Add Server Add Server To remove an iSNS server select the server above and then click Remove Remove More about Discovery and iSNS OK Cancel amp pply
48. n below F eo j x Live Seorch Pp m 8 ae Page v G Toos seagama piorer TP A htp 10 10 10 50 connections e AV Network Connections Network Connections a 10 10 1050 10 10 10 255 internet Protected Mode Ott ISCSI amp Fibre Channel to SCSI Page 54 Set up CHAP and Digest then click OK The user will now be brought back to the window below Click OK and now the user should see the Session Connections page with two connections Connections Load balance policy Round Robin v Description The round robin policy attempts to evenly distribute incoming requests to all processing paths This session has the following connections Source Portal Target Portal Status Type Weight C 10 0 0 237 6 10 10 10 50 Conne Active nja 0 10 10 1156 10 10 11 50 Conne Active nia g j The user can add up to 8 different connections Once the user has completed setting up the connections click OK to return to the iSCSI session page You should now see the number of connections increased In this example we have 2 connections sessions Devices Properties This target has the following sessions Identifier E AS 74103 ic 40000 13700000008 Session Properties Target portal group 1 Status Connected Connection count 2 Session Connections To configure how the connections within this session are load balanced dick Connections Connections N
49. nel to SCSI Page 46 To add an iSCSI Target portal click on Add Portal The user should now be presented with a window Add Target Portal Type the IP address or DNS name and port number of the portal you want to add To select settings for the discovery session to the portal click Advanced IP address or DNS name Advanced Enter an IP address for the iSCSI Target In this example we shall use the IP address of 10 10 10 50 Leave the port 3260 unless you have configured your iSCSI Bridge only to respond on port 860 in which case change it to 860 Click on the advanced button to see the advanced options Advanced Settings xs General IPsec Connect by using Local adapter Microsoft iSCSI Initiator X Source IP Default Target portal CRC Checksum Data digest Header digest CHAP logon information Use RADIUS to generate user authentication credentials Use RADIUS to authenticate target credentials Cancel The Connect by using box allows the user to specify which iSCSI Adaptor to use and the Source IP The Local adaptor will only differ from Microsoft iSCSI Initiator setting if an iSCSI Offload card has been installed For the purpose of this guide we shall only use the Microsoft ISCSI Initiator Leaving this setting as Default will also use the Microsoft iSCSI Initiator The Source IP is used to specify upon which network adaptor the dis
50. ommunicate with it is necessary to understand some of the terms used by the menus iSCSI Target Device iSCSI target devices are devices such as disk drives tape drives or RAID controllers that are attached to the network Each device is identified by an IQN iSCSI Qualified Name iSCSI Qualified Name IQN Anything connected to a network be it a computer printer or iSCSI device must have a unique identifier such as an IP address to enable other devices to communicate with it With iSCSI devices both targets and initiators an extra level of identification in addition to the IP address is employed This is called the IQN The IGN includes the iSCSI Target s name and an identifier for the shared iSCSI device Example 2002 12 com 4bridgeworks sdt600a014d10 5 CHAP CHAP is an authentication scheme used by Servers to validate the identity of clients and vice versa When CHAP is enabled the initiator must send the correct Username and Target Password to gain access to the iSCSI Bridge The Initiator Secret is provided to allow iSCSI mutual CHAP If mutual CHAP is selected on the Initiator the iSCSI Bridge will authenticate itself with the initiator using the initiator secret SCSI Target Device A SCSI device is a device that is connected to the SCSI bus that can be accessed by the server Each device on the SCSI bus has a Unique ID number in the range 0 15 D Note By convention ID 7 on the SCSI Bus is reserved by the Server s Hos
51. ow click on OK to return to the Microsoft iSCSI Initiator main window Millau EFCS2240 Page 55 Step 6 Logging off an iSCSI Session To log off an iSCSI Session follow the following procedure e Open the Microsoft iSCSI Initiator and click on the Targets tab e Click on the iSCSI session that the user wishes to log off and then click Details e Inthe Target Properties window select the Sessions Tab and select the identifier that is to be logged off e Click the Log off button This will log off all connections associated with the iSCSI session The session identifier should now be removed from the identifier list Click ok to return to the main iSCSI Initiator window The iSCSI device should now show as inactive ISCSI amp Fibre Channel to SCSI Page 56 B2 Connecting to an iSCSI Device using the Microsoft iSCSI Initiator in Windows Server 2008 R2 There are many iSCSI initiators available For the purpose of this user guide we shall concentrate only on the Microsoft iSCSI Initiator In this example we have used the Microsoft iSCSI that is available with Microsoft Server 2008 R2 Step 1 General Set up Open the iSCSI initiator and then click on the Configuration Tab You should see a window as shown below iSCSI Initiator Properties Targets Discovery Favorite Targets Yolumes and Devices RADIUS Configuration Configuration settings here are global and will affect any Future connections made with the ini
52. re Channel to SCSI Page 66 Multiple Connected Session MCS MICS policy Round Robin Description The round robin policy attempts to evenly distribute incoming requests to all processing paths This session has the following connections Source Fortal Target Portal weight 0 0 0 0 60102 10 10 10 107 3 Connected Active nia 0 0 0 0 63942 10 10 10 107 3 Connected Active n a D_ Di To add a connection click Add To remove a connection select the connection above and then Rena click Remove To edit the path settings for the MCS policy select a Edit connection above and then click Edit EIR DK Cancel Apply The user can add up to 10 different connections Once the user has completed setting up the connections click OK to return to the iSCSI session page You should now see the number of connections increased In this example we have 2 connections Sessions Portal Groups Refresh CO FFfffas001770018 4000013700000007 To add a session click Add session Add session To disconnect one or more sessions select each Disconnect session and then click Disconnect To view devices associated with a session select Devices a session and then click Devices Session Information Target portal group tag 1 Status Connected Connection count 2 Maximum Allowed Connections 10 Authentication None Specified Header Digest None Specified Data Digest None Specified
53. re you commit these parameters to memory it is worth checking that all the parameters and spellings are correct and that these have been written down in a safe place for future reference Click the save button to save these parameters and then click the reboot button in the left hand pane 3 2 9 Reconnect to the Bridge If you made changes to your computer return them to their previous setting and reconnect to the Bridge using the IP address or hostname depending on which addressing mode you selected ISCSI amp Fibre Channel to SCSI Page 18 3 3 Passwords and Security This configuration page will allow the administrator to change the access password for the GUI From within the main menu select the Password and Security icon under the Network section The GUI will now display the following window Passwords amp 3 acurity fata Parcvord Change Password Secure Wob Connection Enable HTTPS i To change your password type the existing password and the new password into the appropriate boxes and press save Secure Connection by clicking this box it will force all further transactions with the GUI to be done via a secure encrypted HTTPS connection Once you have clicked this option save the configuration logout and login again Note It is not possible to reset the password without logging into the GUI so ensure you remember your password Millau EFCS2240 Page 19 3 4 Network Services 3 4
54. roperly plugged into the library and that the library is powered on Make sure that the power LED on the Bridge is illuminated Ensure that the Ethernet cable is plugged in at both ends Note the status of the LEDs positioned within the Ethernet connector make sure that the Link present LED is illuminated If it is not check with your Network Administrator lf you are using a Bridge with two Ethernet ports and only one network cable try using the other network address and or the other network port Ensure you are using the correct network address and netmask Scan the network using the LAN Scan utility to find all the Bridges connected to the network in case the network address is different from that expected See Section Lost IP Address If none of the above resolves your problem then after consulting with your Network Administrator please contact support ISCSI amp Fibre Channel to SCSI Page 36 6 3 Device Related Isssues Once the Bridge has booted and the target devices have finished initialising these devices should be available on the host machine After checking that you have correctly configured the initiator run through the following checklist to help you identify the problem Ensure that the devices are powered on and are ready some libraries can take 5 minutes or more before they are ready and appear on the Bridge The power up status of libraries are usually displayed on the front panel Ensure
55. s cercel_ y In this example two iSCSI targets have been discovered The first device is the tape drive and the second is the media changer If no devices are displayed check the settings used to do the discovery especially the CHAP settings then return to Targets tab and click Refresh If still no devices are displayed check network cables and that the iSCSI Bridge is operational Millau EFCS2240 Page 61 To connect to one of the iSCSI Targets click on one of the target names and then click the Log on button A window should appear Connect To Target x Target name gn 2002 12 com 4bridgeworks 000000 977d098e36978373 00000 I Add this connection to the list of Favorite Targets This will make the system automatically attempt to restore the connection every time this computer restarts Enable multi path Advanced Cancel Even if the user wishes to connect to the iSCSI Target using Multipath they should not check Enable Multi path Check box This will be covered in a following section Now click on the advanced button to see the advanced seitings A window should appear as below Advanced Settings 21x General IPsec M Connect using Local adapter Initiator IP bea tt sti i O C Target portal IP loft o CRC Checksum IT Data digest IT Header digest TT Enable CHAP log on CHAP Log on information GHAF helps ens
56. s displayed on screen Windows Double click on lanscan bat This will create a file named lanscan txt Open lanscan txt within a text editor to view the discovered Bridgeworks devices Typical output ca CA WINDOWS system32 cmd exe Product SFC4200 SCSI FC Bridge Port W gt IP Address 16 18 11 18 gt Mac 60 64 1b 909 86 65Bc gt Netmask 255 255 455 0 gt Broadcast 10 10 10 255 4 6 8 8 gt Gateway 1588 gt MTU Port 1 gt IP Address 10 10 10 31 6H 84 1b 08 86 6d 255 255 255 868 16 18 186 255 Response bridgeworks F 1200 FC SCSI Bridge IP Address 109 0 0 241 Mac AA cH 9f 2a bf 5e Hetmask 255 455 455 0 Broadcast 16 6 6 255 Gateway U Sdocuments gt Millau EFCS2240 Page 39 Appendix A Setting up your Computer for Initial Setup A1 Windows 95 98 or NT If your computer is running Windows 95 98 or NT follow the instructions below For users with Windows 2000 2003 or XP instructions are detailed in Appendix A2 and for Windows Server 2008 7 or Vista instructions are detailed in Appendix A3 From the Start menu choose Settings then Control Panel Then click the Network icon Network 2 xi Configuration Identification Access Control The following network components are installed n th e Netwo rk wi ndow s Config u ration tab Client for Microsoft Networks i 3Com Fast EtherLink XL 10 100Mb TX Ethernet NIC
57. ss and does not have to be genuine which is useful for email filtering For example entering logs 4bridgeworks com would allow emails from this address to be filtered to a specified folder in the users email client Trigger Event Log Level This allows the user to specify what severity of event will trigger the log to be emailed with Critical Events being the most severe and Warning Events being the least For each level picked the higher level logs will also be emailed for example selecting Error Events will also send all Critical Events ISCSI amp Fibre Channel to SCSI Page 20 Below are examples of events that will be sent for each log level e Critical The Bridge is running at non recommended temperatures e Error The Bridge rejected a login attempt e Warning An Initiator has logged out of the Bridge 3 4 3 ISNS Internet Storage Name Service allows automated discovery management and configuration of each iSCSI resource from a central point If this option is enabled the Bridge will register its resources with a central iSNS server To enable iSNS on the Bridge click the tick box and enter the IP address for the iSNS Server and click the save button Millau EFCS2240 Page 21 3 5 FC Target Interface This configuration page will allow the administrator to configure the Fibre Channel Interface of the Bridge From within the main menu select the FC Target icon from the SCSI System section The GUI will now display the followin
58. t F CHAP logon information T Use RADIUS to authenticate target credentials This advanced settings page is the same as that of the discovery with one addition On the Connect by using section the user can select the Target Port that he wishes to connect too This is particularly useful if the user is going to create multiple connections In this example we have chosen to connect to the IP address 10 10 10 50 on port 3260 ISCSI amp Fibre Channel to SCSI Page 50 To see how this relates to the iSCSI Bridge configuration note the IP addresses in the window shown below iSCSI Bridge Management Console Windows Internet Explorer six Go FAV htt 1 10 10 10 10fscst Fj trl x five sore P Ele gdt yew Favortes Jook tielp e SY SCI Bridge Management Console TR gt BD gt eh Boe Gre pa ES iSCSI Target Bridge Control E __ fc A Msn G E DEAA ns Set up the Digest and CHAP settings as described in stage 2 during the discovery phase and click OK This will now take you back to the window that was shown in figure 10 Click OK once more The user should now see the iSCSI Target connected TIE avorite Targets Volumes and Devices Gener Discovery Target CE nitiator Pre a Mid tor FI F To access storage devices for a target select the target and then dick Log on To see information about sessions connections and devices for a target dick Details N
59. t Bus Adaptor Logical Unit Numbers LUN Each SCSI device on the SCSI bus can support sub devices These are called LUNs Within the iSCSI Connect Bridge each SCSI ID on the SCSI bus can support 7 LUNs Millau EFCS2240 Page 7 1 4 Safety Notices A This device should only be installed by suitably trained personnel Protection provided by the equipment may be impaired if used in a manner not specified by the manufacturer Do not block the enclosure s vents Air enters from the front and is exhausted out the back of the device This device is connected to the AC power line Before using the device please read the instructions carefully in order to use the device correctly and safely For the installation instructions refer to the installation section of this guide Class Equipment This equipment must be earthed The power plug must be connected to a properly wired earth ground socket outlet An improperly wired socket outlet could place hazardous voltages on accessible metal parts Do not attempt to service the equipment yourself doing so will void the warranty and may damage the system This unit contains hazardous voltages and should only be opened by a trained and qualified technician To prevent electric shock do not remove the cover There are no user serviceable parts inside The power cord is used as a disconnection device To de energize the equipment disconnect the power cord Do not use the equipment where it
60. tape drive and the second is the media changer If no devices are displayed check the settings used to do the discovery especially the CHAP settings then return to Targets tab and click Refresh If still no devices are displayed check network cables and that the iSCSI Bridge is operational Millau EFCS2240 Page 49 To connect to one of the iSCSI Targets click on one of the target names and then click the Log on button In this example we have chosen the first target A window should appear Log On te Target Target name gn 1988 11 com dell b9ad34 spi 6 C Automatically restore this connection when the computer starts Enable multi path A Only select this option if iSCSI multi path software is already installed on your computer If the user wishes to connect to the target automatically when the computer is booted click the check box Automatically restore this connection when the computer starts Even if the user wishes to connect to the iSCSI Target using Multipath they should not check Enable Multi path Check box This will be covered in a following section Now click on the advanced button to see the advanced settings A window should appear as below Advanced Settings ISS General IPsec Connect by using Local adapter Microsoft iSCSI Initiator X Source IP 10 0 0 237 gt Target portal 10 10 10 50 3260 CRC Checksum Data digest Header diges
61. tiator Any existing connections may continue to work but can fail if the system restarts or the initiator otherwise tries to reconnect to a target When connecting to a target advanced connection features allow specific control of a particular connection Initiator Name ign 1991 05 com microsoft win d3081sidkbe To modify the initiator name click Change Change To set the initiator CHAP secret for use with mutual CHAP CHAP click CHAP To set up the IPsec tunnel mode addresses for the initiator IPsec click IPsec To generate a report of all connected targets and devices on Report the system click Report More about Configuration a In this window the user is able to configure the initiator name specify the initiator secret and set up the IPsec connections For the purpose of this document we shall leave the initiator name as the default Millau EFCS2240 Page 57 If you intend to use Mutual CHAP authentication you must enter the initiator secret on this page Click on the secret button and a window should be displayed iSCSI Initiator Mutual CHAP Secret Fa The S51 initiator mutual CHAF secret is used to authenticate the target The secret entered here will have to be configured on each target that you wish to use mutual CHAP Mutual CHAF requires the use of initiator authentication when connecting to the target this can be done by using the advanced options when making connections to th
62. ure connection security by providing authentication between a target and an initiator To use specify the same name and CHAP secret that was configured on the target for this initiator The name will default to the Initiator Name of the system unless another name is specified Hames ign 1991 05 com microsoft win d3081sidkbe Target secret O Perform mutual authentication To Use mutual CHAP either specify an initiator secret on the Configuration page or use RADIUS J Use RADIUS to generate user authentication credentials J Use RADIUS to authenticate target credentials This advanced settings page is the same as that of the discovery with one addition On the Connect using section the user can select the Target Port that he wishes to connect to This is particularly useful if the user is going to create multiple connections In this example we have chosen to connect to the IP address 10 10 10 99 on port 3260 ISCSI amp Fibre Channel to SCSI Page 62 Set up the Digest and CHAP settings as described in stage 2 during the discovery phase and click OK This will now take you back to the Connect to Target window Click OK once more The user should now see the iSCSI Target connected iSCSI Initiator Properties Fa Targets Discovery Favorite Targets volumes and Devices RADIUS Configuration Quick Connect To discover and log on to a target using a basic connection type the IP address or DNS n
63. us Boxes This should be 1000Mb s if this is 10 or 100Mb s this will limit the performance dramatically Packet loss can be a cause of poor performance Within the Link Status Box check the number of TX and RX errors for both network Interfaces that are displayed in the Network Connections window This should be zero or a very small number If these are showing large numbers of errors check the connections between the Bridge and the initiator Also check that the entire network cabling between the Initiator and the Bridge is Cat5e certified By enabling Jumbo packets increasing the MTU size to 9000 from within the GUI Network Connections window section 3 2 2 you can improve the throughput performance of the Bridge This will only work if ALL of the components in the infrastructure between the Initiator and the Bridge are enabled for Jumbo packets That includes the HBA all switches and routers and the Bridge itself If any of the components are not enabled or not capable of handling Jumbo packets then unexplained packet loss or corruption can happen Data Digests are an extra level of checksum error checking on top of the standard TCP IP checksum error checking configured on the initiator However the calculation of these extra checksums can greatly affect overall performance Therefore Header and Data Digests should only be enabled where the integrity of the Network connection is in doubt Poor GUI performance If the Bridge is transf
64. will save the configuration to the local Flash memory for use at the next reboot Repeat this process for the other Network Port as required Connected Hosts To List which hosts are connected to the Bridge from the Fibre Channel main page select the connected hosts icon for the port you require Y7 Bridgeworks Bridge Control Console Home Host initiators connected to Port 0 Fibre Channel Target HOSTO 10000000c96564a3 Reboot System Logout Fibre Channel Target Connected Hosts Support Online Help Port Map Once the Fibre Channel interface has been configured the target devices can now be assigned to the Fibre Channel ports Millau EFCS2240 Page 23 From the Fibre Channel Management page select the port map icon 7 Bridgeworks Bridge Control Fibre Channel Target Portmap Configuration Type Automatic Support Online Help There are two choices from the drop down list Automatic this will assign to both Fibre Channel ports all the target devices so that any host connected to ether of the Fibre Channel ports will see the same devices Manual this will allow the user to manually assign which target device appears on which Fibre Channel Selecting Manual will bring up the following screen SENN _ o eui 0004180004008030 eui 000410000000010 cui 000418 000600R050 To assign a target device to a Fibre Channel Port Select the target device from the list in the Logical Unit drop down menu
65. y not show any change Millau EFCS2240 Page 27 3 8 SCSI Initiator This configuration page will allow the administrator to configure a number of parameters that control the behaviour of the SCSI bus From within the main menu select the SCSI Initiator icon from the SCSI System section The GUI will now display the following window Bridge Control Console Home SCSI Settings SCSI Initiator Reboot System The following configuration options will be applied to every port configured in initiating mode Logout Please note the settings on this page are all advanced settings no modification to any parameters should be needed they are provided for the configuration of legacy devices Support Host ID online Halo E Maximum Commands 64 per LUN Disable Wide Transfers Disable Synchronous gl Transfers The settings in the SCSI Initiator page are advanced settings provided for configuration of legacy devices Typically no modification to any of these parameters should be required Host ID This defines the ID of the Bridge on the SCSI bus and should not require modification unless using the unit with a shared SCSI bus Settle Delay When devices are first turned or when a SCSI bus reset is issued most devices will perform a set of tasks to reinitialise settings and reconfigure certain parameters which can take a little time to perform before the device will resoond to commands on the SCSI bus The settling t
Download Pdf Manuals
Related Search
Related Contents
2100 - Oracle Documentation Juny - 2012 - Centre de Lectura Single User - Auric Systems International Flush 1 relay - User manual Appendix C5 Regulamentos Institucional dos Laboratórios de Citologia Epson SR-600 User's Manual MANUEL D`UTILISATION ET D`ENTRETIEN TRICYCLES TYPE User Guide CIS EXTENDED DATABASE Copyright © All rights reserved.
Failed to retrieve file