Home

openATTIC Documentation Release 1.1.0 it

1. StorageObjJjecrt app volumes filesystemvolume app Mare TEATE unlcodo s tank rt utorral vmol by are SIS bloekvolume s null volumepool null unicode_ tutorral vmod These parameters have the following meaning e 45 The id of the volume pool in which the volume is supposed to be created e tutorial vm01 The name of the volume e 1000 The size of the volume in Mebibytes e filesystem e fswarning warning threshold is ok fscritical 98 Same goes for critical owner app Mauer zfs The filesystem to use for the new volume 95 Volumes that contain VM images don t degrade in performance when filling up so a high 2 The new volume owner s user ID The owner field will have to be explained in a little more detail What you re passing there is a reference to another object in the openATTIC system in this case a user These objects can be acquired by looking up which users exist faith gt auth faith auth User faith auth User gt ids 122 auth ob User Tids 23 unicode mziegler Chapter 7 Integration owner openATTIC Documentation Release 1 1 0 W app W W auth YOO user Ma Se T unicode openattic So the user ID 2 refers to the system user mziegler Exporting the volume Now that we created a subvolume we need to export it on the o
2. nLnogricalVolume id 479 7 3 Integration Tutorial 119 openATTIC Documentation Release 1 1 0 unicode_ btrtest ra volumepool VUES MOO __ 1 __ btrtest Fy unicode btrtest jy TSLtoraoeobqeci volumes filesystemvolume zfs Mob je TS WAC edu uangccode 2 tank Fy blockvolume null volumepool TZS TODT TEAT ___ 1 __ tank by unrcode s tank Fj Obj StorageObject app volumes filesystemvolume null uie ud 1 Ne blockvolume null volumepool Ivm obj VolumeGroup rare Ly un uvararbhdata Lr unicode s yvgrervchdata So our openATTIC system named faith knows three volume pools A LVM volume group named vgfaithdata a Zpool named tank and a btrfs volume named btrtest Which one of these we use is completely up to us The code we re going to write doesn t care one bit Since we have to choose one we ll use the Zpool because it has an SSD cache and the RAID where the VG and the btrfs reside upon does not have a BBU so using the Zpool should give us a lower storage latency Note Which pool to use is completely hardware dependent The zpool being the better choice in this case does not imply that ZFS is the best choice in all cases 1
3. ATTIC openAT TIC Documentation Release 1 1 0 it hovum GmbH September 10 2015 Quick start 1 12 Requirements 2 1 2 2 Performance 2 3 Hardware requirements 2 4 System requirements 2 5 Required knowledge Use Cases 3 1 3 2 Virtualization 3 3 Cloud Storage 3 4 Object Storage 3 5 Storage consolidation 3 6 Installation and Upgrade Guides 4 Preparing the Installation 4 2 4 3 Step by step installation guides 4 4 4 5 Installing an openATTIC cluster 4 6 4 8 Additional openATTIC Modules 4 9 Maintenance Implementing the Use Cases 5 1 Implementing a file server 3 2 5 3 Implementing Cloud Storage User Manual 6 1 6 2 6 3 LUNs SAN 6 4 6 5 inr P ccr L1 8E Steps e s e 20 do RR dm EU ub dE de Rr EES Achieving Scalability and High Availability Fileserver oo oo or Demo VMS z pease pom Erin 3b ES Package based installation on Debian and Ubuntu Joining openATTIC to a Windows domain Configuring Authentication and Single Sign On Implementing a virtualization storage Dib ce s 2 zen EUR bd URS ee So EE ES SOE wu xou de ans ah E LU Shares se d a dede che ok xu ServiCeS uu vo Roo ow ox mo XOU e Eo xoxo x a CONTENTS Oo U NAAU 6 6 System 6 7 Personal Settings 68 Shutdown 69 Menu shortcut bar 6 10 Hiding the menu tree Integration 7 1 Clo
4. The host will be added to the volume s access list and openATTIC will automatically configure the necessary targets in the background Note If unsure about the LUN ID choose 1 6 3 5 Using iSCSI volumes To make use of the volumes you configured you need to configure the initiator on the clients How to do that depends on the operating system Windows On Windows systems the control panel offers an item called SCSI Initiator The first tab allows you to discover and configure iSCSI targets Enter the IP address of the openATTIC host into the box labeled Target and click the 6 3 LUNs SAN 93 openATTIC Documentation Release 1 1 0 Quick connect button Eigenschaften von ISCSI Initiator Ziele Suche Bevorzugte Ziele Volumes und Ger te RADIUS Konfiguration Schnell verbinden Geben Sie zum Ermitteln eines Ziels und zur Anmeldung diesem Ziel ber eine Basisverbindung die IP Adresse oder den DNS Namen des Ziels ein und klicken Sie dann Schnellverbindung Ziel 172 16 13 19 Schnell verbinden schnellverbindung Ziele die F r eine Verbindung an der IP Adresse verf gbar sind oder der angegebene DNS Name sind unten aufgef hrt Sind mehrere Ziele verf gbar muss mit jedem Ziel einzeln eine Verbindung hergestellt werden Hier hergestellte Yerbindungen werden der Liste der bevorzugten Ziele hinzugef gt und bei jedem Neustart des Computers wird
5. We have an admin already not creating default user Found lo Found eth etc openattic cli conf already exists quitting Completed successfully root bob Jj 7 Re attach EI Fullscreen By Stay on top Duplicate e oN es ProFTPD is started in standalone mode currently running 0 Close Figure 4 8 Installing the DRBD module 60 Chapter 4 Installation and Upgrade Guides openATTIC Documentation Release 1 1 0 4 8 8 IPMI Queries hardware sensors for better hardware monitoring and failure detection Installing 1 Install the openattic module ipmi package oaconfig install openattic module ipmi 2 In the GUI there is now a menu entry named Sensors that displays the status of your hardware 4 9 Maintenance 4 9 1 Commandline Tool oaconfig Although openATTICs graphical interface is the most important interface for the user it is necessary to execute actions via the commandline Therefore you can use either the tool oacli which gives you the possibility to access the RPC API via the commandline and offers all options actions which are also supported from the graphical user interface or the script oaconfig for system based operations which takes over some administrative tasks and will be annotated in the following section If you use the command oaconfig you need to pass an argument In case you do not pass any commands or use oaconfig helpa list of all possible commands will be listed
6. Choose the volumepool on the mirror host into which the volume should be mirrored the mirror volume will be created automatically Advanced options you can leave the standard here or choose between the mirror protocols A Asynchronous This protocol is often used in long distance replication cases B Memory Synchronous Semi Synchronous Only synchronizes the network traffic we recommend using protocol C instead C Synchronous The most commonly used protocol Data is fully synchronized on both nodes you can leave the standard here or configure the Syncer Rate 6 2 Storage 81 openATTIC Documentation Release 1 1 0 Additional Settings x config options available X Close Click Choose button and close the window Additional Settings X Mirror Choose mirrorhost bob master dns vg oa2 v volumepool a Advanced Settings Protocol A Asynchronous B Memory Synchronous Semi Synchronous C Synchronous Syncer Pate 300M Choose Cancel Close With an existing volume Select volume which you want to mirror from the list of volumes Click Mirror button choose the mirror host Choose the volumepool on the mirror host into which the volume should be mirrored the mirror volume will be created automatically Advanced options Choose between the mirror protocols A Asynchronous B Memory Synchronous Semi Synchronous C S
7. User Management 7 API Keys 4 gt Online Update Personal Settings 4 9 Shutdown Logout Reboot 9 Shutdown 6 1 5 Sensors tank volume 6849 186a b77 1 45 18 8e95 6987bb048 147 tank subvol01 tank zsubvoltest tank volume be98d391 6d47 447d aldb dea6cc023625 IdevidrbdS tank volume 1f9 1ff26 af77 4a45 8420 c5489f6b7b16 tank volume 37d60ab5 0a17 4f07 b135 5213548e8348 tank volume 28893dc9 a165 4954 8f6d 76f6d6593ca6 dev mapper vgfaithdata btrtest Idevimapper vgfaithdata fump3 zfsdingsbums Figure 6 4 media tank volume 6849 186a b77 1 4518 8e95 6987bb0 zfs Imedia tank subvol01 zfs Imedia tankzsubvoltest zfs Imedia tanklvolume be98d391 6d47 447d aldb dea6ccO zfs media esx dpri ocfs2 Imedia tanklvolume 1191f126 af77 4a45 8420 c5489f6b7 zfs Imedia tanklvolume 37d60ab5 0a17 4107 b135 5213548e zfs media tank volume 28893dc9 a165 4954 8f6d 76f6d659 zfs Imedia btrtest btrfs Imedia fump3 ocfs2 Imedia zfsdingsbums zfs Mount Points panel rw relatime xattr rw relatime xattr rw relatime xattr rw relatime xattr rw relatime heartbeat none nointr data ordered errors r rw relatime xattr rw relatime xattr rw relatime xattr rw relatime space cache rw relatime heartbeat none nointr data ordered errors r rw relatime xattr openATTIC also takes care of the system s hardware the Sensors panel offers a list of important hardware components and their state and current value degrees volts
8. name mirror_debian_squeeze srvopenqrmsto0l 1vm LogicalVolume gt filter name__icontains deb name debpkgtest name mirror_debian_squeeze Shell Section In order to change options of the shell at run time you can use the special section called shell which is not part of the API This section offers among other things the possibility to change the output format as well as list the history of entered commands or to delete the history Available functions This part documents the available functions by modules Note Every module includes all the methods defined in rpcd handlers ModelHandler so this section actually covers most of what you re going to need Note In order to operate on volumes you should always refer to volumes rpcapi StorageObjectHandler and volumes rpcapi StorageObjectProxy classes instead of using the concrete volume modules e g Ivm directly That way your code will just work with whatever storage backend openATTIC is configured to use 118 Chapter 7 Integration openATTIC Documentation Release 1 1 0 Base Handlers 7 3 Integration Tutorial Learning by example is always easier than wolfing through endless pages of documentation so let s have a quick look at the openATTIC API by writing a short program that actually uses it We are going to write a shell script that automatically provisions virtual machines using libvirt and KVM storing VM images in openA
9. won t reload the whole page but the current viewed pannel Theme you can switch between the designs Access Gray and Default e just select the radio button of the theme you would like to configuare as your standard theme openATTIC will reload the page with the selected theme then 6 7 Personal Settings 109 openATTIC Documentation Release 1 1 0 Disk stats for test2 200 mf 180 m 160 m 140 m 120 m 100 m 80 60 40 m 20 m 06 40 07 00 07 20 07 40 Cur Bl tot iops 113 60m Start time May 26 2014 6 24 a m 08 00 Total IOs per second 08 20 08 40 09 00 09 20 09 40 10 00 10 20 Min Avg Max 0 00 13 44m 170 40m Figure 6 21 Graphs with gradient amp 5 m s Linux NFS Volume Pool Management MountPoints Service State Hosts Keys i Dashboard Disk stats for raid2r 105 per Second Normalized Disk stats for raid2r 1X Disk stats for raidOr 105 per Second Normalized demoTest enterprise done3 TestingORMDemo u Personal Settings Command Log ex Current Load load1 Disk stats for raidor Current Load o0 f wv 150 z 100 D 50 v o 08 00 19 00 cur Avg cur Avg B rd 11 41 990 78m load 254 67m 118 52m Bl vr normiops 98 74 54 24 ex Disk stats for BlockTest03 Total 105 per second Disk stats for BlockTesto3 00 nf Avg Avg B tine nan nan B tot iops 47733m 19 46m
10. Add Export X mmm 4 3 SAN l G E un ud et a Network Portals Volume blog_bilder v Gl NAS Share name blog_pictures Gp Web FTP Path Imedia blog bilder Weh Browseable v Linux NFS Be PERE ie Available Windows CIFS M Writeable gt Embedded TFTP d Guest OK 4 W Services Comment Pictures of our team JJ Cron Jobs 4 t System T X ancel 2 f Add Export 3 Cancel Hosts v RN Add Export Delete Export The CIFS panel allows you to share volumes using CIFS To create a share click the Add Export button and provide the following information 1 Choose the volume you would like to share 2 Provide a name which will be visible to clients accessing the share openATTIC suggests the shared volume s name but you are free to change it 6 4 Shares 95 openATTIC Documentation Release 1 1 0 3 If you would like to share only a certain subdirectory of the volume you can enter its path in the path field By default this field is populated with the root directory of the volume 4 To hide the volume from the list that appears in the Windows network browser uncheck the browseable option To disable the share for a while you can uncheck the available option To prevent all write access to the volume uncheck the writeable checkbox To disable authentication thereby allowing access to user you can check the Guest o
11. 1 primary 20 5 GB f ext4 5 logical 922 7 MB f swap suap s to dist lt Go Back gt ctivates buttons Partition disks If you continue the changes listed below will be written to the disks Otherwise you will be able to make further changes manually The partition tables of the following devices are changed 56513 0 0 0 sda The following partitions are going to be formatted partition 1 of SCSI3 0 0 0 sda as ext4 partition 5 of 56513 0 0 0 sda as swap Write the changes to disks Installing the base system Extracting base passud 4 3 Step by step installation guides 45 openATTIC Documentation Release 1 1 0 Configuring Kerberos Authentication When users attempt to use Kerberos and specifu a principal or user name without specifying what administrative Kerberos realm that principal belongs to the system appends the default realm The default realm may also be used as the realm of a Kerberos service running on the local machine Often the default realm is the uppercase version of the local DNS domain Default Kerberos version 5 realm Continue Enter activates buttons 1 Configuring Kerberos Authentication Enter the hostnames of Kerberos servers in the EXAMPLE LOCAL Kerberos realm separated bu spaces Kerberos servers for your realm srvkerberos example local Cont inue ivates buttons Configuring Kerberos Authentication Enter the hostname of the administr
12. a Group the other disks into RAIDS arrays of exactly 5 disks each with a chunk size strip size of 256KiB Do not create a partition table on these devices If your RAID controller does not support 256KiB chunks use the largest supported chunk size b Using mdadm create a Software RAIDO device on exactly two or four of your hardware RAID devices Again do not create a partition table on the resulting MD device Make sure the chunk size of the RAIDO array matches that of the underlying RAIDS arrays Note This way you will not be able to add more than 20 disks to one PV This is intentional If you need to add more disks create multiple PVs in the same manner c Using pvcreate create an LVM Physical Volume on the MD device and add it to a VG using vgcreate or vgextend d Do not mix PVs of different speeds in one single VG 3 When using ZFS You will need to specify the complete layout in the zpool create command so before running it consider all the following points a Group exactly six disks in each raidz2 Use multiple raidz2 vdevs in order to add all disks to the zpool b When adding SSDs add them as mirrored log devices 15 openATTIC Documentation Release 1 1 0 c Set the mount point to media poolname instead of just lt poolname gt d Do not use dev sdc etc but use dev disk by id paths instead So the command you re going to use will look something like this zpool create m media ta
13. source bridge br0 gt model type virtio interface serial type pty gt target port 0 lt serial gt console type pty gt target type serial port 0 lt console gt lt input type tablet bus usb input type mouse bus ps2 graphics type vnc port 1 autoport yes listen 0 0 0 0 keymap en us gt listen type address address 0 0 0 0 graphics video model type cirrus vram 9216 heads 1 lt video gt lt memballoon model virtio lt memballoon gt lt devices gt lt domain gt EOF virsh define STEMPFILE 7 3 Integration Tutorial 127 openATTIC Documentation Release 1 1 0 rm f STEMPFILE Lastly to start the VM add v rsh start SVM Testing it Running the script should now produce the following output root zoe S createvm sh tutorial vm06 Formatting media tutorial vm06 hda qcow2 fmt qcow2 size 10737418240 backing file media base qc Domain tutorial vm06 defined from tmp fileZH42zZ Domain tutorial vm06 started Let s see if that s actually true by checking 1ibvirt root soer 5 wirsh list Id Name State 1 tutorial vm06 running In order to connect to the VM find out the VNC display root zoe virsh vncdisplay tutorial vm06 A So connecting to the host s IP address and the given VNC port should now work and show you a shiny new virtual machine 7 3 5 Congratulations
14. Step 5 Expiry You can choose between snapshots without or with expiry date Snapshots can be automatically deleted just select the retention period in Seconds e Minutes e Hours e Days Weeks Wizard configuration Step 6 Execution Now you can configure the schedule options Execute immediately only once Execute later at a specific date time only once Orcreate Schedule by Selecting the start date start time Choosing end date end time or end date e Setting the schedule to active Decide if your scheduled snapshot should only run once immediately or at a given day time or if you want them to run for a specific period 86 Chapter 6 User Manual openATTIC Documentation Release 1 1 0 Please define the retention time for snapshots Never automatically delete snapshots Automatically delete snapahots after 3 E Figure 6 11 with expiry date Execute immediately Execute later Execute time 04 02 14 E Execute date Create Schedule Start date 04 02 14 3 Starttime End date 04 09 14 3 Endtime No end date Is active Figure 6 12 Will be executed immdediately 6 2 Storage 87 openATTIC Documentation Release 1 1 0 Configuration Assistant X Schedule Part 2 Options Execute immediately Execute later Create Schedule Start date 04 07 14 3 Starttime 06 00 v End date 05 30 14 3 End time 2
15. dee remis DEN Mee remm 0 oj tme rert cm L S 200 ae D LXI I an m ras unten rw o agus Disk stats for raid2r 10s per Second Normalized dakel RPCd time Owen ge Web HTTP s for Linux NFS Windows Cl Embedded TFTP fm Servces gruen An Record Hans User Management APlkeys 4 onne Up _ Pn 4 Sato vm res Figure 6 23 Just select the item and add it via drag and drop How to remove a shortcut bar 6 9 Menu shortcut bar 111 openATTIC Documentation Release 1 1 0 To remove the subitem from the menu shortcut bar select the item and drag it to the end of the shortcut bar drop the item and answer the security question Dashboard Volumes b HTT Figure 6 24 remove shortcut bar 6 10 Hiding the menu tree By clicking the lt lt button in upper right hand corner of the menu tree panel or the small arrow middle of the menu panel on the right you can hide the whole menu Click the same button to view the menu again openATTIC Documentation Release 1 1 0 Er Service State a Mount Points Sensors Monitoring al Storage SnapApps Volume Pool Management Volume Management 4 4 SAN LUNs Network Portals 4 Gl NAS G Web FTP Web HTTP Linux NFS Windows CIFS a f Embedded TETP EJ Services
16. rpm If for example the CPU temperature is too high or a fan doesn t work anymore you will see it here so you re able to take measures against it 6 1 6 Monitoring OpenATTIC is not only able to deal with storage issues By integrating the monitoring software Nagios it 1s also able to give you additional information about the storage as well as the system s health You don t have to add checks manually for example by creating a volume a nagios service will be created automatically as well as checks for important openATTIC services like openattic_rpcd and openattic systemd The monitoring panel gives you an overview of all service checks and their current states as well as location of the service resource host date and time of last and next checks It keeps you up to date so you can react for example if there is not much space left on a disk so you can resize it or a service is down so you can start it again 74 Chapter 6 User Manual openATTIC Documentation Release 1 1 0 openATTIC Menu Sensors 4 Q Status Sensor Current value Status 54 Dashboard CPU1 Temp 0 unspecified ok Command Log CPU2 Temp 0 unspecified ok Service State System Temp 27 degrees C ok a Mount Points CPU1 Vcore 0 94 Volts ok ESOS i senos CPU Vcore pee Fr ee ala Storage 12V 12 Volts ok SnapApps CPUJDIMM 1 54 Volts ok Volume Pool Management CPU2DIMM 152 Volts ok 9 Volume Management 15V 152 Volts ok 4 SAN 3
17. Chapter 4 Installation and Upgrade Guides openATTIC Documentation Release 1 1 0 4 1 3 Scheduler The disk scheduler s job is to reorder IO requests before they re sent to the storage system which has a dramatic impact on performance Done right it will reduce write latency done wrong it will wreak havoc So the scheduler needs to be configured correctly 1 If you re using Hardware RAID make sure the default scheduler is set to deadline This can be verified using the following command 5 grep sys class block sd queue scheduler Sys class block sda queue scheduler noop deadline cfq Sys class block sdb queue scheduler noop deadline cfg Sys class block sdc queue scheduler noop deadline cfg If the CFQ scheduler is selected instead edit etc default grub find the line that defines the GRUB CMDLINE LINUX DEFAULT variable and make sure it contains the elevator deadline option For example GRUB CMDLINE LINUX DEFAULT quiet elevator deadline Then run update grub and reboot 2 If you have SSDs make sure their scheduler is set to noop 3 For everything else use cfq Switching schedulers for different devices can be achieved using a script like the following for instance as a part of Set twraid schedulers to deadline for disk in dev disk by 1d sesi 36000508722 777772 772777 7227272772725 do sdx basename readlink disk echo deadline sys class block sdx queue scheduler
18. Figure 6 22 openATTIC with theme Gray graph with gradients and auto expand root nodes unchecked 6 8 Shutdown This is where you can exit the openATTIC user interface shutdown or reboot the open ATTIC server 6 8 1 Logout Leave the openATTIC user interface by clicking the Logout button and answering the confirmation message 6 8 2 Reboot j Doyoureallywantto logout Reboot openATTIC server by clicking the Reboot button and answering the confirmation message 110 Chapter 6 User Manual openATTIC Documentation Release 1 1 0 Reboot 9 Do you really wantto reboot openATTIC Yes No 6 8 3 Shutdown Shutdown the openATTIC server by clicking the Shutdown button and answering the confirmation message Shutdown QD Do you really want to shutdown openATTIC Yes No 6 9 Menu shortcut bar How to add a shortcut bar You can add subitems of Status Storage SAN of the menu tree on the left into the menu shortcut bar space next to the openATTIC logo f i a w al u a a ShapApps Linux NFS Volume Pool Management Mount Points Service State Hosts User Management APIKeys Personal Settings Command Log Monitoring Menu amp aah a rn sts for air Ios per Second Normalized lex Dashboard 3 u Voume een Service Ste E gt so Meine o E kien
19. JPEG B MEF D JPEG B MEF D JPEG B MEF D JPEG BE a 65 openATTIC Documentation Release 1 1 0 Fee QC blag pictures amp snapshots snapshots durchsuchen Pp Organisieren Offnen Neuer Ordner EM Bilder Ti Marne Anderungsdatum Typ Dokumente Musik Videos blag hilder 2014 05 07 15 18 56 11 04 2014 11 13 Dateiordni 188 Computer L DatPladde Ga mzsmbtest iSsreopena GP itn Misto S Daten 4172 16 11 10 te mia t blog_bilder_2014 05 07 15 19 56 Anderungsdatum 11 04 2014 11 13 Dateiordner Offline verf gbar Micht verf gbar Apt mirrors Mirrors for the Apt package manager used by Debian and Ubuntu can be easily created using Debmirror RPM mirrors Mirrors for RPM based distributions e g Fedora are created and updated using rsync Software distribution for Windows clients Windows clients can be managed using OPSI 5 2 Implementing a virtualization storage This section describes the implementation procedure for the Virtualization use case Please refer to this section for more general considerations 5 2 1 Prerequisites Virtualization clusters have critical latency requirements but do not normally require much bandwidth or suffer from fragmentation Make sure that you run on smaller SAS disks where single parity is sufficient and the disks are generally faster 66 Chapter 5 Implementing
20. You have just implemented an automated virtual machine deployment process Note that the part that deals with the actual openATTIC API is the little Python script from the Putting an API client together chapter all the crufty stuff is on the hypervisor side which will usually be handled by some kind of virtualization management system Check out Cloud Storage for more information 128 Chapter 7 Integration EIGHT DEVELOPER DOCUMENTATION If you want to help you don t have to be a coder reporting bugs also helps openATTIC consists of a set of components built on different frameworks which work together to provide a compre hensive storage management platform When an Application be it OpenStack or the oA GUI wants stuff to be done this is what happens The RPC API receives a request in form of a function call decides which host is responsible for answering the request and forwards it to the core on that host The openATTIC Core consists of two layers Django Models the brains They keep an eye on the whole system and decide what needs to be done FileSystem layer Decides which programs need to be called in order to implement the actions requested by the models and calls those programs via Systemd The Systemd executes commands in the system and delivers the results First of all start off by Setting up a development system Then code away implementing whatever changes you want to make W
21. openATTIC fully supports exporting volumes via HTTP allow ing you to set up a highly available software repository that gives you the benefit of maximum bandwidth 3 2 Virtualization Virtualization systems enforce stringent requirements upon their storage systems because if storage breaks lots of other components are affected and half of your infrastructure is down openATTIC has proven its worth in real life datacenters running all kinds of setups from single node setups with only a handful of virtual machines up to multi datacenter setups with thousands of VMs The most subtle requirement is low latency A slow storage system will affect each and every server that uses it causing performance issues everywhere that cannot be easily traced to one single source because they are ubiquitous This means that when setting up the system care needs to be taken in order to meet the performance requirements by making sure no hardware resources go to waste Eliminating single points of failure is another important goal You need to be able to tolerate failure of any single component without affecting the availability of the whole system And if done right you also won t have to take anything offline while adding or even removing storage nodes For more information see the Achieving Scalability and High Availability chapter Snapshot technologies can be leveraged in order to speed up backup and restore processes and even to run backup processes on a
22. s Mirror Volume s e Reload Volume list Note A more detailed explanation of the above mentioned actions can be found below see Volume Management Actions Volume Management Nam y Size Used 5 Warning Level Critical Level Path a tank 5 ani postmark zfs 970 75 GB 0 0096 1 75 85 zfs 10885168 NEN TET 75 85 volume 11911126 af77 4245 8420 c5489f6b7b16 zfs 970 75 GB 75 85 volume 28893dc9 a165 4954 8f6d 76f6d6593ca amp zfs 970 75 GB 0 00 80 80 volume 37d60ab5 0a17 4107 b135 5213548e8348 215 97075 GB 0 00 80 80 volume 5699b3b9 7601 48bc abSe f052a3b985e7 215 97075 GB 0 00 75 85 volume 68491862 b77 1 45 18 8e95 6987bb048147 97075 GB aldb a aith volume group ect LINE 27 57 demo2 gical volur 400 MB u i 888 demoiscsi logical volume 100GB d etapi X4 500 IB age volume 500MB test exa 452MB Jj 2205 75 85 Sey vgfaithdata volume group iro 888 BlockTesto3 logical volume 100MB 8 89 DebugVolume logical volume 10 00 GB E RA TEST gi 100 MB 8 88 birtest btrfs subvolume 307268 ff 171 75 85 E h03 f 200 02 GB I E 2 6796 75 85 39 demoTest xts j 5 16 75 85 888 distmark xts 000068 0 03 7 75 85 E 2 10 00 GB 75 8 xts 50 00 GB 75 39 fump3 logical volume 100MB E m fs fl 2 54 75 85 Gg laura VolTest logical 200MB 888 laura linux exa 2 T Expandal Collap
23. service apache2 restart web server config 2 protocol tips perl 6 03 1 Setting up liblwp useragent determined perl 1 0622 Processing triggers for initramfs tools update initramfs Generating boot initrd img 3 2 0 4 amd64 ee tr ggers for resolvconf Processing tr ggers for python support root alice 2 bob Re attach 0 Fullscreen W Stay on top al Duplicate e as A 0 Close Setting up 1 0 14b1 dfs g up sudo Setting up update alter nativas sing usr bi n 1 tdbbackup tdbtools to provide usr bin tdbbackup tdbbackup in auto mode Setting up xfsprogs 3 1 7 b1 ng up libfreeipmil2 1 1 5 3 g up l b pmiconsole2 1 1 5 g up l b pmidetect 1 1 5 3 g up freeipmi tools gs ng up nagios plugins 1 4 16 1 up 105 plugins contrib 4 20120702 ing triggers for l bapache2 mod php5 a d 4eb server apache2 Setting up pnp4nagios web 0 6 16 2 Enabling module rewrite To activate the new configuration you need to run service apache2 restart Reloading web server config apache2 w perl 6 04 1 1 6 03 1 Lwp useragent determined perl 1 06 1 procaca ing for initramfs tools update initramfs Generating boot initrd img 3 2 0 4 amd64 Processing triggers for resolvconf Processing triggers for python support root bob Figure 4 2 Installing t
24. you should add two hot spares so make that fourteen For larger setups use 24 disks Warning Any other number of disks will hinder performance 2 Are you building a storage backend for virtualization If so you will require SAS disks a very clean setup and a good caching mechanism to achieve good performance Note Using SSDs instead of SAS disks does not necessarily boost performance A clean setup on SAS disks delivers the same performance as SSDs and an unclean SSD setup may even be slower 3 If the enclosure has any room for hot spare disks you should have some available This way a disk failure can be dealt with immediately instead of having to wait until the disk has been replaced Note A degraded RAID only delivers limited performance Taking measures to minimize the time until it can resume normal operations is therefore highly advisable 4 You should have some kind of hardware device for caching If you re using a RAID controller make sure it has a BBU installed so you can make use of the integrated cache For ZFS setups consider adding two SSDs Note When using SSDs for caching the total size of the cache should be one tenth the size of the device being 6 Chapter 2 Requirements openATTIC Documentation Release 1 1 0 cached and the cache needs to be ten times faster So only add a cache if you to no guessing allowed measure don t make it too large e don t add an SSD cache to a volume t
25. 3V 3 24 Volts ok 3 3VSB 3 29 Volts ok LUNs VBAT 3 29 Volts ok a Network Portals Fanl 5535 RPM ok 4 en NAS Fan2 5535 RPM ok F Web FTP Fan3 no reading ns Web HTTP Fan4 no reading ns LT Linu NES PS Status 0 unspecified ok E as 4 m Windows CIFS P1 DIMM1A Temp 28 degrees C ok Gr Embedded TFTP P1 DIMM1B Temp no reading ns 4 9 Services P1 DIMM2A Temp 29 degrees C ok Cron Jobs P1 DIMM2B Temp no reading ns 3 i System P1 DIMM3A Temp 30 degrees C ok API Record P1 DIMM3B Temp no reading ns Hosts P2 DIMM1A Temp 31degrees C ok User Management P2 DIMM1B Temp no reading ns API Keys P2 DIMM2A Temp 34 degrees C ok Online Update P2 DIMM2B Temp no reading ns d Personal Settings P2 DIMM3A Temp 35 degrees C ok 4 g Shutdown P2 DIMM3B Temp no reading ns Logout 5VSB 4 92 Volts ok 3 Reboot g Shutdown Figure 6 5 Sensors panel By entering your e mail address in the user management panel you will get notifications for example when a service is in a critical state here is an example ckckck Nagios ck Notification Type PROBLEM Service Disk Space Host localhost Address 127 0 0 1 State CRITICAL Date Time Thu Oct 31 09 52 00 CET 2013 Additional Info DISK CRITICAL free space media daten 579849 MB 10 inode 99 By selecting a service check you can see relevant graphs of 4 hours 1 day 1 week 1 month and 1 year This is where you add graphs to your dashboard Select the service y
26. Cron Jobs a cep system F Record Hosts User Management API Keys gt Online Update d Personal Settings al Shutdown Lagout Reboot Shutdown 6 10 Hiding the menu tree 113 openATTIC Documentation Release 1 1 0 114 Chapter 6 User Manual SEVEN INTEGRATION System requirements are subject to change on a daily basis New services are installed all the time obsoleting others and the storage system has to adapt to these changes Hence being able to integrate openATTIC into other processes is important openATTIC provides an XML RPC API which allows other infrastructure parts to access its functionality This way processes can be easily automated ensuring that processes run the way they are supposed to The Cloud Storage use case outlines different products which are supported in conjunction with openATTIC The following section focuses on the installation of the respective cloud connectors In case such a connector derek lt s gt respective lt s gt does not exist for the software you want to use the Integration Tutorial tells you everything you need to get started building your own cloud connector 7 1 Cloud Connectors Cloud systems commoditize infrastructure meaning that an end user can order virtual servers storage volumes and network segments to be configured a la carte The cloud system completely automates the creation and management processes that are necessary in o
27. Disk Existing disk C VMs openattic 1 0 vmdk Memory 512 MB Network Adap NAT kd Customize Hardware N lt Back Finish Cancel F CE 1 0 VMware Workstation nEH Elle Edit View VM Tabs Help o d Libra x z 2 Home 1 0 wl My Computer openATTIC CE 1 0 amp Shared VMs P Power on this virtual machine Bl Edit virtual machine setting Devices Memory 512 Processors Hard Disk IDE 5068 CD DVD IDE Auto detect Ei Floppy Auto detect igNetwork Adapter NAT QusB Controller Present Sound Card Auto detect Description T Si Powered off Configuration file C VMs openATTIC openATTIC CE 1 0 ymx Hardware compatibility Workstation 9 0 virtual machine F 1 0 VMware Workstation SEEN File Edit View VM Tabs Help mre x n Library amp My Computer amp Shared VMs Click in the virtual screen to ee Install Debian 6 64 bit as you would on a physical computer When you are done and the operating system boots up click I Finisher 1 Finished Installing Help To direct input to this VM click inside or press Ctri G 1 0 VMware Workstation fs File Edit View VM Tabs Help Wi 2 0 Librat zu Home amp openATTIC 1 0 8 My Computer Shared VMs aie Polaron screen to Install Debian 6 64 bit as you would on
28. Eingabedaten deuten auch dann auf unterschiedliche erwaltu Datenspeicher hin wenn es sich bei dem zugrunde liegenden NFS Speicher um enfheru Datenspeichername ort der itsprofil openATTIC he Kon von Sy V Einste te Einste lt Zur ck Abbrechen A Name Ziel o Status Details Initiiert durch Angeforderte Startz Startzeit Zeit der Fertigstellung When done it should look something like this After you clicked the Finish button vSphere will initialize the data store and make it available to be used by virtual machines Note In order to support migration between multiple hosts you have to add the datastore to a your hosts manually Be sure to use exactly the same connection information on all your hosts otherwise vSphere will not recognize the mounts belonging to the same datastore 5 2 5 VirtualBox VirtualBox does not care where virtual machines are actually stored so simply mounting the NFS share on the Virtu alBox host is sufficient When mounting however be sure to use NFS version 3 mount t nfs o vers 3 openattic domain local media virtualbox vms media vms Then configure VM images to reside in a directory underneath media vms 5 3 Implementing Cloud Storage This section describes the implementation procedure for the Cloud Storage use case Please refer to this section for more general considerations 5 3 Implementing Cloud Storage 69 openATTIC Documentation Release 1 1 0 5 3 1 laaS OpenSt
29. RAID6 or raidz2 or your disks have a low URE rate 2 Make sure user authentication works by joining openATTIC into your Windows domain 5 1 2 Basic setup Create a volume a Make sure the volume you create fulfills your capacity requirements b The volume pool you use should reside on bigger slower disks if you have different disk types to choose from c We recommend using Ext4 or btrfs as the file system Note XFS s performance advantages are only relevant for latency critical applications which a file server is not Note ZFS does not support Windows ACLs so the enforcement of permissions is limited when using ZFS 2 Create a CIFS share to export the volume 3 Connect to the share using Windows Explorer and configure permissions 63 openATTIC Documentation Release 1 1 0 5 1 3 Clustered setup Create a mirrored volume In the volume management the volume should look like this Volume Management Name Type Size Free Used Status Path Host drbd5 connection 1000 00 MiB Connected Idevidrbd151 srvopenatticci0 1 master dns srvopenatticciO1 master dns DRBD Endpoint 999 00 MiB UpToDate Idevivgtest drbd5 srvopenatticciO 1 master dns srvopenatticci02 master dns Endpoint 999 00 MiB UpToDate Idevivgtest2 drbd5 srvopenatticci02 master dns 2 Select the volume and click the Create Filesystem button In the window that appears choose Ext4 for the file system choose the initial owner of th
30. Some of the listed commands are implemented by oaconfig itself others from the administrative subsystem of openATTIC Which commands are listed depends on the openATTIC installation To get help for a sub command execute oaconfig command help basic commands The following commands are always available e install Initializes the installed modules It needs to be executed after installing the base packages or after installing additional modules e install cli creates an API Key and a config file for oacli scan vgs instructs LVM to search for existing physical volumes and volume groups They will be searched but not recorded into the database add vg Adds an already existing volume group into the database add disk formats a disk and adds it to a volume group In case the volume group does not exist yet it will be created and added to the database Warning This command skips the validation of the graphical interface if the disk is already in use Only standard validation of creating a physical volume from pvcreate will be executed Please be careful if you want to use this command restart Restarts all openATTIC services reload Reloads the configs of all openATTIC services status Shows the current states of the openATTIC services 4 9 Maintenance 61 openATTIC Documentation Release 1 1 0 rootshell Starts a python shell as root user Administrative Subsystem Important commands of t
31. TERT EET FP 172 16 13 19 255 255 255 0 Select Port 3260 f AddPortal 3X Cancel hosts are capable of being initiators and which protocols they are able to use This information is configured in the Hosts panel under Attributes lt lt Dashboard Command Log 77 Service State Mount Points gs Sensoren Monitoring 4 3 Storage LL SnapApps Volume Pool Management y Volume Management 3 SAN LUNs To configure a host as an initiator LIO Network Portals Address 172 16 13 19 255 255 255 0 Add Portal Address Port 127 0 0 1 255 0 0 0 172 16 13 19 255 255 255 0 Select Port 3260 f AddPortal X Cancel 1 Add the host if it does not exist already by clicking the Add Host button and entering its fully qualified domain name Select the host to see its attributes Click Add attribute Click submit 6 3 LUNs SAN Select the Initiators entry on the right hand side Choose the storage protocol supported by your initiator The Initiators subsection now shows the initiator entry Depending on the protocol enter the FibreChannel WWN or iSCSI IQN of your host 91 openATTIC Documentation Release 1 1 0 Finding the IQN For iSCSI connections you will need to know the of the Initiator Windows On Windows systems the control panel offers an item called iSCSI Initiator where you will fin
32. VMware VMware Virtual S 21 5 GB The disk can be partitioned using one of several different schemes If you are unsure choose the first one Partitioning scheme All files in one partition recommended for new users Separate home partition Separate home usr var and tmp partitions Screenshot Go Back Continue Apply the partitioning Partition disks This is an overview of your currently configured partitions and mount points Select a partition to modify its settings file system mount point etc a free space to create partitions or a device to initialize its partition table Guided partitioning Configure software RAID SCSI3 0 0 0 sda 21 5 GB VMware VMware Virtual S gt 1 primary 20 5 GB f ext4 I gt 5 logical 922 7 MB f swap swap Undo changes to partitions Finish partitioning and write changes to disk Screenshot Help Go Back Continue Write the changes to disk Installing the base system 5 Kerberos Here you can enter the Kerberos Realm If you don t want to configure Kerberos you can skip this part by leaving the field empty and clicking Continue This is an example configuration for Kerberos Enter the Kerberos server general case domaincontroller and the administrative server for your Kerberos realm 6 Package manager Choose the protocol for file downloads Choose the country for the package manager Select the mirror server
33. available for snapshotting will be displayed here You can select the items you want to snapshot and click Save If there aren t any Plugins installed you will see the message There are no configuration options available in the right panel of the window So you can just skip this part 84 Chapter 6 User Manual openATTIC Documentation Release 1 1 0 Configuration Assistant X Available Items Item settings 29 MSSQL There are no configuration options available gt VMware Previous Next Wizard configuration Step 3 Additional Drives Choose additional drives to be snapshotted and drag them into the right half of the window Configuration Assistant x Additional Drives If other devices need to be included in the snapshot e g for raw device mappings they can be added via Drag amp Drop Volumes Drag and drop additional volumes here Volume Volume nn ITC oR SE ERR Ceo ESTEE TT EC TREE 5 test cron DemoMirrorO 1 test cron 2 Previous Next Wizard configuration Step 4 Pre Post Script Conditions If you want to execute any scripts before or after snapshotting enter them here 6 2 Storage 85 openATTIC Documentation Release 1 1 0 Configuration Assistant X Pre Post Scripts Before and after the snapshot is made user defined scripts can be executed Please enter the path to your scripts or leave these fields empty if you don t have any Prescript Postscript Previous Next Wizard configuration
34. delete jobs can be found in the following text How to add a job Hit the Add Job button Enter root as user Schedule the time Insert acommand or path to a script 100 Select the host on which the script should be executed 100 0 Chapter6 User Manual openATTIC Documentation Release 1 1 0 Note You can enter the path where a script is located or for example use oaconfig like this usr sbin oaconfig command Add Job X Host zoe master dns e User root Minute 5 Hour 0 3 6 9 12 15 18 21 Day af Month Month Day af Week 2 a AddJob Cancel This is where you can edit a job Select the job you would like to edit and click the Edit Job button Edit the data you want to change or replace Click the Edit Job button Edit Job X Host faith masterdns User root Minute 0 Hour 0 3 6 9 12 15 18 21 Day of Month Month 1 2 3 4 5 5 7 8 3 10 11 12 Day af Week 0 1 2 3 4 5 6 Command usr sbinfoaconfig dosnapshot j 77 amp Edi Job jj Cancel Delete job Select the job you want to delete Press the Delete Job button Answer the confirmation message 6 5 Services 101 openATTIC Documentation Release 1 1 0 Delete Job x vo Really delete this job iusmr sbin oaconfig dosnapshot j 77 Yes Ho 6 6 System 6 6 1 API record By adding for example a volume in the openATTIC user interface the openATTIC backend API plays an important role Wit
35. dev 273 6 2 7 3 6 deb7u2 Upgrade libmagic1 5 11 2 deb7ul 5 11 2 deb7u2 Upgrade Reload Changes Update Package lists xy Allow installation deletion 6 6 System 107 openATTIC Documentation Release 1 1 0 6 7 Personal Settings The Personal Settings panel summarizes some settings in order to give you one central panel where you can configure and adapt openATTICs user interface to your personal needs Snap amp pps Linux NFS Volume Pool Management Mount Points Personal Settings SD Auto expand root nodes Command Log show hints a Service State Allow installation deletion al Mount Points Enable gradients in graphs Sensoren Catch F5 and reload the current panel only 9 Monitoring a Scie Theme 4m SnapApps Volume Pool Management Volume Management 4 LUNs g LUNs T Web FTP Web HTTP Linux NFS Windows CIFS 2 Embedded TFTP Services Cron Jobs cr system Hosts Q2 User Management API Keys Online Update Personal Settings a 0 Shutdown Logout Reboot 0 Shutdown Figure 6 18 Personal Settings panel Service State O IS Access 5 Gray Default Note By checking or unchecking an option openATTIC will save the configuration you just have to reload the page except when changing the theme Let s have a closer
36. have to offer and require a different strategy which is provided using SAN protocols 6 3 1 Protocols Basically all SAN protocols are an extension of the SCSI protocol traditionally used for connecting controllers and disks transporting SCSI commands and data over a copper or fiber optical link to remote machines This way the same paradigms for accessing local disks also apply to accessing volumes on a remote storage system When dealing with SCSI setups there is a bit of terminology that is useful to know Controllers that wish to make use of a storage device are called nitiators They are responsible for initiating SCSI sessions and taking the decision of when to send which commands e Storage devices are called Targets because they are targeted by the Initiator nitiators can be implemented both in software or in hardware Hardware initiators are called Host Bus Adapters HBAs because they provide an interface between the Host s PCI bus and the SCSI target Whether or not an is available and or necessary depends on the protocol used and the application For FibreChannel HBA is required for FCoE and 1SCSI it is optional Targets provide one or more Logical Unit Numbers LUNs which are used by the initiator to identify the storage volume targeted by the operation This way targets can provide multiple volumes to different Initiators The most significant difference between SAN protocols is their classificat
37. it is 4 FibreChannel support requires at least Linux 3 5 2 5 Required knowledge openATTIC is targeted towards administrators If you re looking for an end user interface you should take a look at Cloud Storage Since storage is always configured as a part of some larger system setting it up requires some knowledge about storage in general and the system you re going to use it for Knowing what your target system s requirements are is therefore necessary in order to build a system that delivers the performance and capacity you need Check out the Use Cases section for more information You should also have a basic understanding of the difference between file based and block based storage protocols and their applications 2 4 System requirements 7 openATTIC Documentation Release 1 1 0 You do not require a deep understanding of how the software components that openATTIC uses are configured and how they interact 8 Chapter 2 Requirements USE CASES Being one of the key components of your infrastructure openATTIC can be used in a number of ways ranging from simple shared file servers up to high performance virtualization clusters This chapter gives you an overview of possible configurations other products openATTIC can be combined with and the benefits and limitations of the various setup variations 3 1 Fileserver Central file storage has been a requirement in the business world from the da
38. mit Linux 3 2 0 4 amd64 4 3 Step by step installation guides 49 openATTIC Documentation Release 1 1 0 Debian GNU Linux 7 8 tty1 ppenATTIC http openattic demo ppenattic demo login _ The system mustn t be configured as nagios server amd64 architecture e At least 2GB RAM Free space in the configured UCS volume group or a free disk Installation 1 Insert the following repositories into etc apt sources list deb http apt open attic org ucs3 1 1 main deb src http apt open attic org ucs3 1 1 main 2 Install the package openattic ucs There is a possibility that some configuration parameters will be promted in the course of the installation Further informations can be found here lt REFERENZ KONFIRU GRATION DER PAKETE gt 3 Runoaconfig install 4 The next step depends on whether the system is a domain member server or not f not please add the server to the domain f yes please go to the menupoint join domain within the UCS gui There is now another join script named 400penattic Run this join script 5 While installation openATTIC has been integrated into the UCS overview page and is now ready for access 1 You can now acceess openATTIC via you domain user The installation is now complete 4 4 Package based installation on Debian and Ubuntu In order to use the Apt repository of openATTIC create a file under etc apt sources list named openattic list
39. openattic 1 1 o0vf 19 openATTIC Documentation Release 1 1 0 Import Virtual Appliance settings These are the virtual machines contained in the appliance and the suggested settings of the imported VirtualBox machines You can change many of the properties shown by double dicking on the items and disable others using the check boxes below Description Guest OS Type 8 cpu Configuration openattic 1 1 0 Linux 2 6 64 bit 1 RAM 384 MB E Floppy 7 iv Network Adapter V Intel PRO 1000 MT Server 82545EM Hard Disk Controller IDE PIIX4 Hard Disk Controller IDE 4 4 Hard Disk Controller SCSI Lsilogic Virtual Disk Image CA Virtual Disk Image VirtualBox VMs openattic 1 1 openattic 1 1 disk2 vmdk VirtualBox VMs openattic 1 1 openattic 1 1 diskl vmdk E Reinitialize the MAC address of all network cards Restore Defaults Importing virtual disk image openattic 1 1 disk1 vmdk 2 3 Em 50 X 50 seconds remaining 4 Starting the virtual machine Select the openattic demo VM and click the Start button above or right click the VM and select Start 5 Completion The system will boot automatically openATTIC version 1 1 Here you can access the system with user root and password openattic openATTIC version 1 2 You can access the system with user root and password ini
40. pm 05 13 2014 11 27 am 05 13 2014 10 34 am 05 09 2014 11 48 am 05 09 2014 7 25 am 05 06 2014 8 01 pm 04 29 2014 4 11 pm 04 25 2014 12 16 pm 04 25 2014 12 13 nm 1 sbin lvcreate Success 0 gt sbin lvcreate of 2 Command Isbinllvcreate Isbinllvcreate Isbinllvcreate Isbinllvcreate Isbinllvcreate Isbinllvcreate Isbin lvcreate Isbinllvcreate Isbinllvcreate Isbin lvcreate Isbin lvcreate Isbinllvcreate Isbinllvcreate Isbinllvcreate Isbin lvcreate Isbinllvcreate Isbinllvcreate Isbin lvcreate Isbinllvcreate Isbin lvcreate Isbinllvcreate Isbinllvcreate Isbin lvcreate Isbinllvcreate Isbinllvcreate Isbinllvcreate Ichinllucreate b b amp Ivcreate Isbinllvcreate User root root root root root root root root root root root root root root root root root root root root root root root rnnt L 200M n demoOl vgfaithdata O Logical volume demoOl created Figure 6 2 filter example root Exit Status 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 n Delete old entries 2014 05 14T14 53 45 206 2014 05 14T14 53 45 799 Delete old log entries by hitting the Delete old entries button on the right You can enter the date manually or pick a date in the calendar 72 Delete old entries AX rt ET Log Entries newer than the date you Delete enter here will b
41. realm srvkerberos example local the hostname of the administrative password changing server for the EXAMPLE LOCAL Kerberos realm Administrative server for your Kerberos realm srvkerberos example locall Screenshot epenAfTiC Configure the package manager Please select the protocol to be used for downloading files If unsure select http it is less prone to problems involving firewalls Protocol for file downloads ftp Screenshot Go Back Continue epenAfTiC Configure the package manager The goal is to find a mirror of the Debian archive that is close to you on the network be aware that nearby countries or even your own may not be the best choice Debian archive mirror country v cu nepuutic 2d Denmark El Salvador Estonia Finland France French Polynesia Georgia Greece Hong Kong Hungary Iceland India Indonesia Ireland Jleraal Screenshot Chapter 4 Installation and Upgrade Guides openATTIC Documentation Release 1 1 0 Configure the package manager Please select a Debian archive mirror You should use a mirror in your country or region if you do not know which mirror has the best Internet connection to you Usually ftp your country code gt debian org is a good choice Debian archive mirror ftp de debian org ftp2 de debian org ftp halifax rwth aachen de debian morphium info ftp uni erl
42. setup would be using an LV formatted with the Ext4 file system This is a very affordable and quick way to get started However scalability is limited and you don t have any failure tolerance outside of what you can provide within a single server through technologies such as RAID openATTIC Documentation Release 1 1 0 3 1 2 Clustered setup Of course a file server will also benefit from clustering as outlined in the Achieving Scalability and High Availability section 3 1 3 Snapshots Accidental deletion of files is something that happens every day especially in a shared environment where many people have access to the file system openATTIC provides a snapshot mechanism that automatically exports snapshots of the file system as a hidden subdirectory so that users can easily recover deleted files from snapshots Of course snapshots enforce the same permissions as the file system itself so users can only restore snapshots if they were able to access the original file as well 3 1 4 Mirror servers While your infrastructure continues to grow you will get to the point where you have a bunch of systems that need to download the same files over and over when installing software or applying updates Also your collection of ISO images and virtual machine templates will continue to grow especially if you re using Cloud systems like OpenStack which allow the users to create their own images Software repositories usually use the HTTP protocol
43. snapshot instead of the original machine See the Target Offloading chapter for details See also Implementing a virtualization storage 3 2 1 oVirt OpenATTIC has been extensively tested and used in conjunction with the oVirt virtualization platform a recently published case study can be found here oVirt is a fully open source alternative to enterprise virtualization systems such as VMware vSphere based on the KVM virtualization technology 10 Chapter 3 Use Cases openATTIC Documentation Release 1 1 0 3 2 2 VMware vSphere vSphere is VMware s virtualization operating system which is widely used in data centers today openATTIC fully supports providing storage for VMware 3 3 Cloud Storage As stated in Required knowledge openATTIC is targeted towards administrators In order to provide products usable by end users a couple of products have been developed recently that hide all the complexity They achieve this by only asking the user which size the volume needs to be and completely automating the creation and management processes openATTIC has been designed from the start to be the perfect storage backend for these systems Cloud storage comes in multiple flavors For one you can register for a service that stores files for you online keeping them synchronized on multiple devices at home or at work and allowing you to easily share them with other people But Cloud storage is also used with virtualization allowing you to add
44. storage to a virtual server easily whenever you need it See also Implementing Cloud Storage 3 3 1 laaS OpenStack openQRM The term Infrastructure as a Service refers to systems that allow untrained end users to create virtual servers and manage their own infrastructure as they need it without requiring administrator privileges or manual work to be done IaaS products take care of the configuration and at the same time ensure that the policies defined by the administrators are enforced Examples of such systems are OpenStack is an IaaS project that aims to provide a ubiquitous open source cloud computing platform for public and private clouds It consists of a series of products one of which is a storage configuration system named Cinder which creates volumes as per the user s request and makes them available for use on virtual servers Cinder can be configured to use openATTIC as its storage backend through a special driver that is developed and actively supported by the openATTIC team openQRM provides a standardized server deployment workflow integrating and combining both common and custom system administration tools and solutions into a powerful single management console for your complete IT service Infrastructure openATTIC integrates into openQRM via a plugin that is developed and actively supported by the openATTIC team Another infrastructure project that 1s gaining traction is Ganeti which can also be conf
45. the host computer s dial up or external Ethernet network connection using the host s IP address Use host only networking Connect the guest operating system to a private virtual network on the host computer Do not use a network connection 10 I O controller types Choose the recommended option LSI Logic 11 Select a disk Choose Use an existing virtual disk 12 13 Choose the vmdk file 4 2 Demo VMs 25 openATTIC Documentation Release 1 1 0 Select I O Controller Types Which SCSI controller type would you like to use Select a Disk Which disk do you want to use Disk Create a new virtual disk A virtual disk is composed of one or more files on the host file system which will appear as a single hard disk to the quest operating system Virtual disks can easily be copied or moved on the same host or between hosts Use a physical disk for advanced users Choose this option to give the virtual machine direct access to a local hard disk Which previously configured disk would you like to use 26 Chapter 4 Installation and Upgrade Guides 14 15 16 17 18 19 4 2 openATTIC Documentation Release 1 1 0 Ji Browse for Existing Disk ES L gt Computer gt Lokaler Datentr ger C VMs vC Ms durchsuchen P Organisieren Neuer Ordner fi J Downloads Name nderungsdatum Typ Gr e d ownCloud a openattic 1 0 17 05 2013 17 11 VMwar
46. the new volume e Click Create Volume Add Volume X Name Demo Volume Fool vgfaithdata w File System xfs w Size in MB 5000 Warning Level 75 96 Critical Level 85 gt Owner openattic amp Create Volume jo Cancel Delete a volume e Select the volume you want to delete in the volume list Click Delete Volume button e Confirm Delete Volume demo Are you sure There is no undo and you will lose all data on that volume vo You are aboutto permanently delete the following volume Yes Ho Resize a volume e Select the volume you want to resize in the volume list click Resize Volume button You can change the size by editing the value in the Megabyte field or using the scrollbar e Click the Edit button 80 Chapter 6 User Manual openATTIC Documentation Release 1 1 0 Confirm your changes Resize Volume X Please enter your desired size Megabyte 100 lt gt Edit d Cancel Basic steps for mirror configuration with a new volume Click Add Volume button Configure the volume properties leave file system field empty Click Create Volume button Add Volume X Hame test Volume Group vg cal w File System w size in MB 500 Warning Level 75 96 Y Critical Level 85 Owner openattic w amp Create Volume Cancel Click the Mirror button e Select the mirror host from the list of volumes
47. the top of the window information and news if p Ps You can press the F1 key to get instant help or visit www virtualbox org for the latest d A a Import an appliance into VirtualBox 2 Import the appliance by clicking Open appliance and browsing to the directory in which you stored the down loaded openATTIC demo VM Select it and click open New Settings Start um Appliance to import VirtualBox currently supports importing appliances saved in the Open Virtualization Format OVF To continue select the file to import below Click Next Click Import 3 Importing the Appliance 18 Chapter 4 Installation and Upgrade Guides 4 2 Demo VMs openATTIC Documentation Release 1 1 0 9 Import Virtual Appliance amp ar GO gt demo vm v 4 demo vm durchsuchen Organisieren v Neuer Ordner Zuletzt besucht Name nderungsdatum Typ openattic 1 1 ovf 09 03 2014 21 00 Open Virtualizatio 53 Bibliotheken Bilder E Dokumente a Musik B Videos Computer L Windows7_OS C Lenovo_Recoven Sy Daten_ 172 16 _ 4 Dateiname openattic 1 1 ovf v Open Virtualization Format o New Settings Start Import Virtual Applianc Appliance to import VirtualBox currently supports importing appliances saved in the Open Virtualization Format OVF To continue select the file to import below C demo vm
48. the volume block device layer where the application is located will be taken Which means that the snapshot of the application itsself can be deleted again because it s stored within the block device snapshot By deleting the software layer snapshot you can ensure that there is no performance loss of the running system The following steps will show you how to deal with the configuration wizard and the different configuration options Available options Add new configuration 6 2 Storage 83 openATTIC Documentation Release 1 1 0 Collapse all hides all subitems of the installed SnapApp plugin folders left side of the panel i e MSSQL VMware Delete config The available SnapApp plugins are displayed on the left in the right panel you can see existing configurations sched ules and their last execution date time By selecting a configuration in the list you can see the list of created snapshots name create date in the panel below Wizard configuration Step 1 Configuration Name Start the wizard configuration by clicking the Add configuration button Enter a name for your new config Configuration Assistant x Welcome The following wizard configures automated snapshots using the openATTIC SnapApps Please enter aname for the new configuration Description demoTest Next Wizard configuration Step 2 Available Items If you have one or more SnapApp Plugin s installed items
49. their parameters are The same information can be found in the Available functions section openATTIC Client oacli openATTIC comes with a tool which you can use to access the RPC API This tool is very useful in order to execute tests or work with openATTIC via commandline instead of using the graphical interface 116 Chapter 7 Integration openATTIC Documentation Release 1 1 0 Sections By starting oacli it creates its structure and sections based on the information it gets from the API Word completion can be used by pressing Tab key Oacli srvopengrmsto01 gt auth fqdn help lvm pkgapt clustering ftp hostname munin rpcd cmdlog get function args hoststats nagios samba drbd get installed apps http nfs shell end get loaded modules ifconfig peering System exit get object JST ping sysutils srvopengrmsto01 gt lvm srvopenqrmsto0l 1lvm gt LogicalVolume VolumeGroup Ztsobnapshot ZfsSubvolume end exit help srvopengrmsto01 1vm LogicalVolume srvopengrmsto0l 1lvm LogicalVolume gt The commandline shows the hostname of the host the Shell is currently connected to as well as the section you are in The root section is marked by a hash You can exit a section by typing two dots and pressing enter Exit the oacli by typing exit or using ctr1 D Help You can find a help command in every section which lists existing commands as well as a short documentation of the command within the section srvop
50. vSphere Using VMware vSphere Client log in to your vSphere Virtual Center and add the openATTIC volume as an NFS datastore to your virtualization hosts To do so l 2 3 4 68 Click a host in the inventory screen and click on the Configuration tab In the hardware panel choose Storage and click on Add Storage Choose Network File System NFS as the storage type Enter the server s address the volume path and a name for the datastore Chapter 5 Implementing the Use Cases openATTIC Documentation Release 1 1 0 VMware ESXi 5 5 0 1331820 virtuelle 5 Speicher hinzuf gen Netzwerkdateisystem suchen Welcher freigegebene Ordner wird als vSphere Datenspeicher verwendet eicher Letz M S Eigenschaften 07 C k Netzwerkdateisystem Dr adapter Serai Sum Absch e len Server lopenattic domain locall 07 C kadapte Beispiele nas nas it com 192 168 0 1 oder 07 C FE80 0 0 0 2AA FF FE9A 4CA2 te Einste erwaltu Ordner Imedia vmware vms Beispiel vols vol0 datastore 001 5 schreibgesch tzt mounten te Funkt ER ee i Wenn f r diese NFS Freigabe ein Datenspeicher bereits im Datencenter anfigural vorhanden ist und Sie vorhaben denselben Datenspeicher auf neuen Hosts zu Routing konfigurieren stellen Sie sicher dass Sie dieselben Daten Server und Ordner i eingeben die Sie f r den urspr nglichen Datenspeicher verwendet haben fizierung Unterschiedliche
51. verify 4 Partitioning 40 Chapter 4 Installation and Upgrade Guides openATTIC Documentation Release 1 1 0 Configure the keyboard Keumap to use American English Albanian Arabic Asturian Bangladesh Belarusian Bengali Belgian Bosnian Brazilian British English Bulgarian Bulgarian phonetic layout Canadian French Canadian Multilingual Catalan Chinese Croatian Czech Danish Dutch Dvorak Dzongkha Esperanto Estonian Ethiopian G0 Back ctivates buttons Configure the network Networking can be configured either bu entering all the information manuallu or by using DHCP or a variety of IPv6 specific methods to detect network settings automatically If you choose to use autoconfiguration and the installer is unable to get a working configuration from the network you will be given the opportunity to configure the network manually Auto configure networking lt Go Back Configure the network Please enter the maximum time you would like to wait for network link detection Haiting time in seconds for link detection Cont inue Tab move Space selects Enter activates buttons 4 3 Step by step installation guides 41 openATTIC Documentation Release 1 1 0 42 Tab Tab 1 Configure the network Please enter the hostname for this sustem The hostname is a single word that identifies your system to the network If you don t know what your hostna
52. 20 Chapter 7 Integration Understanding StorageObjects openATTIC Documentation Release 1 1 0 If you take a closer look at the objects returned by the API you will notice that openATTIC refers to them as StorageObjects obj Scorageobjece app volumes filesystemvolume appe MPErTS up BLEISSuUuDVOlume Pere 33 unicode btrtestc fy 2075 24 blockvolume 4 appr obj LogicalVolume SIS unicode s brrtesr Ly volumepool app DLTIS oo Ecitie ue ur unicode s HLTrYtesrt ly unicode btrtest In the storage world multiple concepts exist to describe storage which may or may not apply to the same thing depending on what the thing actually is and how it has been configured Taking a closer look at the btrfs volume pool above you can see that this object uses all three of openATTIC s high level abstractions 1 The filesystemvolume part indicates that this object provides a file system somewhere Hence it can be shared using NAS protocols and accessed using the likes of Windows Explorer 2 The blockvolume part means that this object is a block device This is because this btrfs file system has been created inside an LVM logical volume which can be formatted with a file system like we have done here or shared via SAN protocols to let the client handle the formatting in whatever way they like 3 Finally the volumepool part i
53. 20135 13 41 21 09 2013 13 42 te Netzwerk OSC 1812 I PG 27 09 2013 13 41 snapshots Anderungsdatum 07 05 2014 15 20 Offlinestatus Online Dateiordner Offline verf gbar Micht verf gbar ES un c3 5 8 0 ATTI Volumeverwaltung SnapApps Windows CIFS Monitoring Menu Volume Management ae Name Type Size Used Path Host Owner EL SnapApps exs 30 PRE meoanackup mssqoump 13 191 mziegier Volume Pool Management S DU ae i ge n g nm d EE UOI puru uu T s BEDS UE X m 7 ilder ext e medi ilder 9 m mziegler 79 Volume Management en BEEN EEE MARNE ER SAN 8 i T blog clone ext4 10 Imedia blog clone 13 19 m mziegler 9 893 buid area ext3 10 Imedia build area 13 19 m mziegler a Network Portals E Snapshot 3 E 4 Gl NAS a Name blog_bilder_2014 05 07 15 19 56 ET Web FTP x X Web HTTP a 8 an v ay c Linux NFS windows CIFS aq F f Embedded TFTP EI 4 ET Services ug eren daba 3 t Create Snapshot Cancel 4 ER System Hey miror iso ext3 45 Imedia mirror iso 13 19 m mziegler API Record a Hosts w Mirror 0 Create Snapshot 9 Create Clone Resize Volume iam Add Volume Delete Volume 5 1 Implementing a file server E m Typ Dateior Dateior JPEG B MEF D
54. 24 4 Mount options The defaults should be fine for most situations but if your clients require special options to be set you can do so here Finally click the Add Export button to create the new export 6 4 3 HTTP See also This step is part of Mirror servers Being the foundation of the World Wide Web the Hypertext Transfer Protocol has been the cornerstone of information transfer between all kinds of different systems It is supported by every operating system from standard computers embedded or mobile devices to large scale industrial installations and handles the transport of huge even endless files just as well as tiny bits of text The HTTP panel allows you to export volumes using HTTP To create an export click the Add Export button and provide the following information 1 Choose the volume you would like to share 2 If you would like to share only a certain subdirectory of the volume you can enter its path in the path field By default this field is populated with the root directory of the volume Note Exporting only a subdirectory makes sense for HTTP because this allows you to customize the appear ance and layout of the data inside the HTTP share independently from the way the data is actually stored For example you can export a Debian mirror while hiding the scripts that you use to manage the mirror by exporting a subdirectory and linking the mirror directory there 6 4 Shares 97 openA
55. 3 00 No end date mM Is active v Previous Next Figure 6 13 scheduled snapshots Configuration Assistant X Schedule Part 3 Times Part 2 Please select the time Minute 30 M Hour 0 v 12 v 1 13 2 14 3 V 15 V 4 16 5 F 17 IF 6 v 18 v 7 19 E 8 20 9 v 21 v 10 22 11 23 Previous Next Figure 6 14 Scheduled snapshots select the time interval in which snapshots should be taken 88 Chapter 6 User Manual openATTIC Documentation Release 1 1 0 Configuration Assistant x Schedule Part 3 Times Part 3 Please selectthe week day and months Day Day of Week Monday Saturday Tuesday Sunday Wednesday v Thursday Friday v Monday January July v Feburary August March v September April October November v June December Previous Next Figure 6 15 Scheduled snapshots select the interval days weeks months in which snapshots should be taken 6 3 LUNs SAN While file shares are adequate for many applications there are others which require a more direct way of accessing storage For instance systems may rely on file systems that are not supported on the storage system directly for instance NTFS or the application may need to employ block device oriented technologies like MD RAID or LVM Such applications are not well suited using the file based approach that NAS protocols
56. 412 10 06 pm Next Check 06 25 2412 10 02 pm 0612512412 10 11 pm 06 25 2412 10 22 pm 06 25 2412 10 20 pm 06 25 2412 10 03 pm 06 25 2412 10 00 pm 06 25 2412 10 28 pm 06 25 2412 10 13 pm 06 25 2412 9 55 pm 06 25 2412 10 23 pm 06 25 2412 10 13 pm 06 25 2412 10 21 pm 06 25 2412 10 02 pm 06 25 2412 10 06 pm E Dashboard Dashboard S Dashboard Chapter 6 User Manual openATTIC Documentation Release 1 1 0 6 2 Storage 6 2 1 Volume Pool Management The Volume Pool Management panel displays not only all volume groups but structure based information like a raid and disks within a volume group if there are sub devices beneath a volume group you can see a in front of the volume group You can see detailed information about the volume groups as well Type of the listed item volume group zpool array raid The size of the volume groups raids arrays pools and disks Free and used space of the volume groups in GiB and percent The state of the volume groups pools raids and disks In the image below you can see that vgfaithdata consists of a raid 0 named MDRAID array mdO The raid 0 again is splitted into two raid 5 Each raid 5 raid2r raidOr consists of five disks see disk object You can also see the that the type of the disks is SAS 15k which means that those are SAS Serial attached SCSI hard drive disks with 15000 rpm rotational speed 15
57. 5 udev 10M 0 10M 0 dev tmpfs 1 2G 304K 1 2 1 run tmpfs 5 0M 0 5 0M 0 run lock tmpfs 2 4G 0 2 4G 0 run shm faith media tank tutorial vm01 737G 0 737G 0 media tutorial vm01 7 3 Integration Tutorial 123 openATTIC Documentation Release 1 1 0 Hooray we have successfully mounted the volume 7 3 3 Automating the export process Now that we know the steps we re going to have to take we can of course automate them using a Python script but first of all we re going to need an API key in order to access it We can easily create one using the API keys GUI panel 1 In the menu tree navigate to the keys panel 2 Klick the Add key button 3 Select an owner for the key and give it a useful description so that you can easily identify it later on Be sure to check the Active check box otherwise the key won t work 4 Submit the form via the Add key button The form will disappear and a new key will be created 5 Display the URL by right clicking the key and choosing Show API URL from the menu It will look something like this http eaa8e f0 bc93 45d1 beb2 ac61a8748e8480faith master dns 31234 Copy paste the URL somewhere you ll need it in a bit Putting an API client together A python script that automates the volume creation and export process may look like this import sys from xmlrpclib import ServerProxy if len sys argv 2 print Usage python createvolume py v
58. 7 Ld load average 0 14 0 14 0 14 USERS OK 5 users currently logged in DISK CRITICAL ivarlib cinderimnt 9783e11ebb7da64t3d90faB 102026604 Disk load for sde is at 0 02 Unnamed Unit u2 Disk load for dm 27 is at 0 01 BlockTest03 Disk load for dm 11is at 0 01 ceph03 Disk load for dm 29 is at 0 01 demo2 Disk load for dm 12 is at 0 01 demoiscsi Disk load for dm 31is at 0 01 demoTest Disk load for dm 3 is at 0 00 fump3 Disk load for dm 33 is at 0 02 LAURA_TEST Disk load for dm 25 is at 0 01 laura VolTest Disk load for dm 2 is at 0 00 netappHTTP Graphs 4hours 1day 1week 1month 1year Graph CPU Time CPU Time CPU Time 2 5 07 20 07 40 08 00 08 20 08 40 09 00 09 20 09 40 10 00 10 20 10 40 11 00 cur Min Avg Max O user 561 60m 150 00m 230 79m 1 57 nice 20 00m 20 00m 20 00m 20 00n O system 171 20m 110 47m 132 86m 280 40m iowait 127 60n 40 47n 68 50m 249 73m 0 00 0 00 0 00 0 00 El softirq 10 00m 0 00 5 20m 28 20m Start time April 1 2014 7 12 a m End time April 1 2014 11 12 a m Fi gure 6 7 Monitoring panel OVCTVICW Nagios Services Service Description Plugin Output Target V c Tis User 0 43 Sys 0 19 IOwait 0 09 Idle 99 07 Current Load OK load average 0 14 0 14 0 14 Current Users USERS OK 5 users currently logged in DISK CRITICAL lvar lib cinderimnt 9783e 11ebb7da64f3d90fa8 106026604 Disk space v Dis
59. Enter HTTP proxy information leave blank for none Configuring apt 34 Chapter 4 Installation and Upgrade Guides openATTIC Documentation Release 1 1 0 openAfTic Partition disks If you continue the changes listed below will be written to the disks Otherwise you will be able to make further changes manually The partition tables of the following devices are changed SCSI3 0 0 0 sda The following partitions are going to be formatted partition 1 of SCSI3 0 0 0 sda as ext4 partition 5 of SCSI3 0 0 0 sda as swap Write the changes to disks D No Screenshot Continue N openAfTic Installthe base system Installing the base system Retrieving mount openAfTic Configuring Kerberos Authentication When users attempt to use Kerberos and specify a principal or user name without specifying what administrative Kerberos realm that principal belongs to the system appends the default realm The default realm may also be used as the realm of a Kerberos service running on the local machine Often the default realm is the uppercase version of the local DNS domain Default Kerberos version 5 realm EXAMPLE L L Screenshot Continue 4 3 Step by step installation guides 35 openATTIC Documentation Release 1 1 0 epevA TiC Install the base system Enter the hostnames of Kerberos servers in the EXAMPLE LOCAL Kerberos realm separated by spaces Kerberos servers for your
60. Export a wg Service St Ma Mount Poir E Volume Sambateest Sa e Monitoring Directory imedia sambateest 5 Storage Address Select v de SnapApps 172 16 13 19 255 255 255 0 4 Volume Pa 172 16 0 119 255 255 255 0 73 Volume Me 4 3 SAN LUNs a Add Export Cancel Web FTP Web HTTP 3 Linux NFS Windows CIFS HERPES SEE IE ERR SER RRRRRESSESEESSISEZRESSESSEETSESEESEE SIRE TER SER SEES SER RES HERR GRE GG 4 Services Add Export Delete Export To create a share click the Add Export button and provide the following information 1 Choose the volume you would like to share 2 If you would like to share only a certain subdirectory of the volume you can enter its path in the path field By default this field is populated with the root directory of the volume 3 Select the IP address on which the export is to be available Finally click the Add Export button to create the new export 6 5 Services 6 5 1 Cron Jobs The cronjob panel lists all existing cronjobs and gives you detailed information about existing job like the command which will be executed in the scheduled time configuration information of the job and on which host this job runs You can add edit and remove cron jobs as well In the background openATTIC uses the utility software cron which is very useful in cas
61. Insert the following lines e Debian 50 Chapter 4 Installation and Upgrade Guides openATTIC Documentation Release 1 1 0 u univention Host srvuniv04 ucs dns Univention Corporate Server Willkommen auf dem Memberserver srvuniv04 M Univention Management Console Verzeichnisdienstverwaltung der UCS Dom ne ucs dns und Systemverwaltung von srvuniv04 AN openATTIC openATTIC Speicherverwaltung srvunivention02 ucs dns Domaincontroller Master der UCS Dom ne ucs dns Univention Die Website der Univention GmbH Univention Forum Das Univention Forum Univention Dokumentation Dokumentation zu Univention Corporate Server Figure 4 1 Univention Corporate Server overview deb http apt open attic org wheezy main deb src http apt open attic org wheezy main Ubuntu deb http apt open attic org trusty main deb src http apt open attic org trusty main Note Please make sure 1inux modules extra package for your kernel version is installed Nightly build deb http apt open attic org nightly main deb srco httpt apt open attic org nightly main We only support the amd64 architecture Importing the PGP key can be done with the following command apt key adv recv keyserver hkp keyserver ubuntu com A7D3EAFA You can then proceed to install openATTIC by running e apt get update apt get install openattic oaoconfrig Install 4 5 Installing an openATTIC cluster openATTIC can be installed as a cluste
62. Log in to your openATTIC server using ssh and make sure that the volume you wish to use for oVirt belongs to the user and group ID 36 by running chown R 36 36 media lt volume gt Otherwise the storage domain may fail to initialize 5 2 Implementing a virtualization storage 67 openATTIC Documentation Release 1 1 0 p os uz 2 X9 7 Your datacenter instance has to be created as an NFS type datacenter which is the default Log in to your oVirt management system and select the Storage tab Click New Domain Enter a name for the new storage domain Choose Data NFS in the domain function field if you want VMs to be stored on this volume Otherwise select the function you wish to use the volume for The export path has to contain both the address of the openATTIC server as well as the path of the volume When done it should look something like this Open Virtualization Manage New Domain x Name lepenATTIC Syst Data Center Default NFS V3 zi Domain Function Storage Type Data NFS Format 3 Use Host srvkvm14 zi Export Path jopenattic domain local media ovirt_vms Remote path to NFS export takes either the form FODN path or IP path e g server example com export VMs gt Advanced Parameters Cancel After you clicked button oVirt will start to initialize volume and make it available as a storage domain 5 2 4 VMware
63. OSIX standards which makes it ideal for providing basic infrastructures The NFS panel allows you to share volumes using NFS To create a share click the Add Export button and provide the following information 96 Chapter 6 User Manual openATTIC Documentation Release 1 1 0 x T a open P ATTIC Volumeverwaltng SnapApps Windows CIFS Monitoring Menu NFS a S Dashboard Address Path Command Log 172 16 17 163 32 Imedia zmirror apt 172 16 13 0 24 Imedia mirror iso a Service State lt 172 16 15 0 24 Imedia mirror iso Mount Points 172 1602555 me th o Sensoren Add Export X Fox m 172 16 e Monitoring 172 16 NFS Export 4 E Storage 15 17216 Volume mirror iso v SnapApps 172 16 Directory Imedia mirror iso Volume Pool Management Address 172 16 15 0 24 73 Volume Management 4 SAN Options rono subtree root squash LUNs the NFS manual e Network Portals 4 NAS Web FTP f Add Export Cancel e 1 Choose the volume you would like to share 2 If you would like to share only a certain subdirectory of the volume you can enter its path in the path field By default this field is populated with the root directory of the volume 3 Enter the IP address es of hosts which should be allowed to mount the exported volume This field can contain a hostname an IP address a subnet specified as address CIDR e g 172 16 15 0
64. TESTS this may fail a couple of times kinit Preauthentication failed while getting initial credentials kinit Preauthentication failed while getting initial credentials Configuring openATTIC ok Stopping openATTIC systemd ok Starting openATTIC systemd L ok Stepping openATTIC rpcd L Ok Starting openATTIC ped ok Reloading web server config apache2 Configuring Libnss Restarting Samba and Winbind initialized contig trom etc openudoettic olt contf Could not connect to the server Errno 111 Connection refused Initialized config from etoc openattic oli conf pong method return sender 1 252 gt dest 1 253 reply serial 2 ok Stopping Samba daemons nmbd smbd ok Starting Samba daemons nmbd smbd ok Stopping the Winbind daemon winbind ok Starting the Winbind daemon winbind To see if it worked let s try getent passwd mziegler mziegler 20422 10513 Z2iegler Michael home SAPDOM mziegler bin true 4 7 Configuring Authentication and Single Sign On When logging in each user passes through two phases Authentication and Authorization The authentication phase employs mechanisms to ensure the users are who they say they are The authorization phase then checks if that user is allowed access 4 7 1 Authentication openATTIC supports three authentication providers 1 Its internal database If a user is known to the database and they entered their password corr
65. TIC systemd Stopping openATTIC rpcd Starting openATTIC rpcd Reloading web server config apache2 Creating tables Installing custom SQL alling indexes Installed 65 object s from 2 fixture s Stopping openATTIC Starting openATTIC system Stopping openATTIC rpcd Starting openATTIC rpcd Reloading web server config apache2 We have an admin already not creating default user Found lo Found eth etc openattic cli conf already exists quitting Completed successfully root alice B Re attach 0 Fullscreen W Stay on top 9 Duplicate e as as A Selecting previously unselected package openattic module drbd Unpacking openattic module drbd from openattic module drbd 1 1 1 1 201403112103 all deb Processing triggers for man db ProFTPD is started in standalone mode currently running 9 Close A 2 bob Processing triggers for man db Setting up drbd8 utils 2 8 3 13 2 Setting up openattic module drbd 1 1 1 1 201403112103 systemd is running pid 28310 Stopping openATTIC temd Starting openATTIC systemd Stopping openATTIC rpcd Starting nATTIC rpcd Reloading web server config apache2 Creating tables Creating table drbd_connection Creating table drbd endpoint Installing custom SQL Installing indexes Installed 65 object s from 2 fixture s Stopping openATTIC s Starting Stopping Starting o Reloading web server config apache2
66. TTIC Documentation Release 1 1 0 lo 3 da amp open P ATTIC Volumeverwaltung SnapApps Windows CFS Monitoring Menu 4 HTTP y ipa Path Browse Dashboard Imedialapt repa bcc Command Log Imedia mirror iso re BENDER Imedia simplecdd images p Mount Point al m Imedia blog_bilder ES P Sensoren E F imedialzmirror aptihtdacs Monitoring Imedia zmirror rpm rt Storage SnapApps Add Export x 5 Volume Pool HTTP Volume Man Volume demo zfs volume data vi 4 SAN Directory imedia demo zfs volume data htdocs LUNs Network Par 4 Gl NAS NEM a ef AddExpor 2 Cancel Web HTTP 9 Linux NFS A windows CIFS en Embedded TFTP a Services v amp eye Add Export Delete Export By convention such subdirectories are named ht docs Finally click the Add Export button to create the new export Next to each export the Browse column provides a link to the volume so you can easily view it in your web browser 6 4 4 FTP Optimized for transfer of large files the File Transfer Protocol allows a bit more fine grained control over the handling of file transfers Clients are more focused on file transfer than web browsers are allowing multiple transfers in parallel and transferring files in a background connection instead of blocking the control connection for the period of the transfer In contrast to HTTP mirrors when using FTP you will usually wan
67. TTIC volumes 7 3 1 Prerequisites We ll assume that you have two systems ready One is a blank Debian or Ubuntu installation the other one a basic openATTIC installation The systems should have enough resources that running VMs on them is any fun but apart from that they don t have to be anything fancy for now Being a bit familiar with Python also helps but the scripts we re going to use are pretty short and easy to understand If you want to see the actual VM deployment process in action you should also have a QCOW2 VM image handy from which the VMs will be cloned 7 3 2 First steps in oacli First of all we re going to make sure the API is available by creating a volume using oacli Connect to the openATTIC system via ssh and run the oacli command It will greet you with a shell prompt such as this root faithi e5 oacli Initialized contig from etc opeuattic olt conf faith gt Now you re ready to interact with the openATTIC API directly so let s find out what it can do Listing volume pools First of all we ll take a look at available volume pools to find one to use for our volumes faith gt volumes faith volumes StorageObject faith volumes StorageObject ids filter volumepool isnull false obj StorageOb ject volumes filesystemvolume btrfs Burrssubvolume Eg i593 unicode btrtest Ls Los 24 blockvolume lem
68. a physical computer When you are done and the operating system boots up click I Finished Installing T Finished Installing Help To direct input to this VM click inside or press Ctrl G Bau 28 Chapter 4 Installation and Upgrade Guides openATTIC Documentation Release 1 1 0 openat c Passwort www 4 3 Step by step installation guides This section will guide you through the different installation types step by step If you already have a running ubuntu or debian system you might want to take a look at the ref quick start lt quickstart_guides_install gt section 4 3 1 ISO installation in graphical mode The openATTIC iso file for virtualbox VMware Workstation can be downloaded from www open attic org downloads html Available versions openattic 1 0 iso OpenATTIC Stable v1 0 openattic 1 1 iso OpenATTIC Stable v1 1 openattic weekly iso openATTIC Weekly Build This guide is for the installation using the openATTIC ISO image in graphical mode The following screenshots will guide you step by step through the installation After booting from the CD you will see the following screen openATTIC Debian GHU Linux installer boot mew Install Graphical in Jal 1 Advanced options gt Help Install with speech synthesis Press ENTER to boot or TAB to edit mem entry You can choose between the different installation options To run the installation in graphical mode choose Graphical Inst
69. ack openQRM How to make use of openATTIC storage for OpenStack depends on the actual project you re installing Glance Note We are currently working on this part of our documentation An update will be available soon Cinder The openATTIC team provides a Cinder driver See also OpenStack Nova Nova can be integrated in two ways 1 Mount an NFS share to var lib nova instances 2 Alternatively you can configure Nova to use Ceph openQRM The openATTIC team provides an openQRM plugin openQRM 5 3 2 Synchronized file storage OwnCloud 1 Install ownCloud 2 Create a volume to be used for ownCloud data 3 Move the var lib owncloud data directory to your volume 4 Create a symlink at var lib owncloud data that points to the volume 70 Chapter 5 Implementing the Use Cases SIX USER MANUAL This section covers the openATTIC graphical user interface GUI focusing on storage tasks like adding volumes and shares system management tasks like the configuration of users and API credentials and the integrated monitoring system 6 1 Status 6 1 1 Dashboard You can configure the dashboard in order to create a personalized overview For example to get an overview of the health state of your system important disks or services You don t have to waste time on searching for all the important components and their states in different panels you can just summarize them here Add graphs by
70. all 1 Language configuration 4 3 Step by step installation guides 29 openATTIC Documentation Release 1 1 0 Select your location The selected location will be used to set your time zone and also for example to help select the system locale Normally this should be the country where you live This is a shortlist of locations based on the language you selected Choose other if your location is not listed Country territory or area Canada Hong Kong India Ireland New Zealand Nigeria k Philippines Singapore South Africa United Kingdom Zambia Zimbabwe other Screenshot Go Back System language configuration Set the time zone V Select a language Choose the language to be used for the installation process The selected language will also be the default language for the installed system Language Chinese Simplified Ara Chinese Traditional 98 Croatian Hrvatski Czech e tina Danish Dansk Dutch Nederlands Dzongkha Er Esperanto Esperanto Estonian Eesti Finnish Suomi French Francais Galician Galego Georgian goGmgmo German Deutsch Graak iv Screenshot Go Back Continue Choose keyboard layout 2 Network configuration Choose between configuring the network manually or using auto configure Waiting time in seconds for link detection 3 System configuration Create the hostname E
71. allation guides 31 32 openATTIC Documentation Release 1 1 0 Configure the network Attempting IPv6 autoconfiguration Cancel Configure the network Please enter the hostname for this system The hostname is a single word that identifies your system to the network If you don t know what your hostname should be consult your network administrator If you are setting up your own home network you can make something up here Hostname openattic demo Screenshot Go Back Configure the network The domain name is the part of your Internet address to the right of your host name It is often something that ends in com net edu or org If you are setting up a home network you can make something up but make sure you use the same domain name on all your computers Domain name example locall Screenshot Go Back Continue y Chapter 4 Installation and Upgrade Guides openATTIC Documentation Release 1 1 0 open ATTIC Set up users and passwords You need to set a password for root the system administrative account A malicious or unqualified user with root access can have disastrous results so you should take care to choose a root password that is not easy to guess It should not be a word found in dictionaries or a word that could be easily associated with you X A good password will contain a mixture of letters numbers and punctuation and should be chan
72. ame of a system group to be configured During the authorization phase if a user is active but not a staff member openATTIC will then check if the user is a member of the configured user group and if so make them a staff member automatically 4 7 3 Configuring Domain authentication and Single Sign On To configure authentication via a domain and to use Single Sign On via Kerberos a few steps are required 1 Configuring openATTIC As part of the domain join proces the oaconfig script creates a file named etc openattic domain ini which contains all the relevant settings in Python s ConfigParser format The domain section contains the kerberos realm and Windows workgroup name The pam section allows you to enable password based domain account authentication and allows you to change the name of the PAM service to be queried using the service parameter Note that by default the backend changes user names to upper case before passing them on to change the is_kerberos parameter to no if this is not desired Likewise the kerberos section allows you to enable ticket based domain account authentication In order to make use of the domain group membership check add a section named authz and setthe group parameter to the name of your group in lower case like so authz group io oa To verify the group name you can try the following on the shell getent group io oa 10 04 x 30174 s rieger lpaduano dbreitu
73. anage openATTIC users and permissions here Here are the supported actions in the User Management panel Add an openaTTIC user 6 6 System 103 openATTIC Documentation Release 1 1 0 Add Peer Host x Base URL http APIKEY 9demo 31234 f Submit X Cancel Figure 6 17 This is where you can add the initiator attribute in order to map storage from openATTIC to a host in the list Add Initiator x Type ISCSI M WWN IQN amp Submit A Cancel e Remove user accounts e Change user permissions deactivate activate an account set or unset SuperUser permissions Change your password see edit existing user s change password below register for monitoring notifications by adding an e mail address to your account View the volumes of a user Creating different user accounts is useful for example when you want to add a volume and set a specific user as the owner When creating a user account for a customer you might want to create it without SuperUser permissions It is also useful to create a user when you want to connect i e cloud platforms like openStack or openQRM to openATTIC You need an API Key to connect a cloud platform to openATTIC this API Key always belongs to a specific user So you might want to do that with a special account A more detailed explanation can be found in the following text User management panel How to add a new openattic user Click the Add User button Enter a u
74. andlers ModelHandler provides the actual functionality by ini tializing the core and calling its methods 130 Chapter 8 Developer documentation openATTIC Documentation Release 1 1 0 8 2 4 Extending the API To extend the API add a module named rpcapi to your Django application and make sure it has a variable named RPCD_HANDLERS which contains a list of handler or proxy classes that make up the interface you wish to expose The transport layer will automatically pick up your module and add it to the exposed APIs 8 3 openATTIC Core The openATTIC core makes heavy use of the Django framework and is implemented as a Django project consisting of several apps one for each supported functionality or backend system Each app bundles a set of submodules Models are used to represent the structure of the objects an app is supposed to be able to manage The RPC API is used for interaction with the models And lastly the System API can be used in order to run other programs on the system in a controlled way 8 3 1 Models Models are used to provide an abstraction for the real world objects that your app has to cope with They are respon sible for database communication and for keeping an eye on the state of the whole system being able to access any other piece of information necessary Please check out Django at a glance for more information 8 3 2 Filesystem API The filesystem API abstracts handling different file systems transl
75. angen de debian tu bs de ftp uni kl de debian cruisix net mirror lundl de mirror de leaseweb net cdn debian net ftp tu clausthal de debian uni duisburg essen de ftp freenet de ftp informatik rwth aachen de Screenshot Go Back Continue open ATTIC Configure the package manager If you need to use a HTTP proxy to access the outside world enter the proxy information here Otherwise leave this blank The proxy information should be given in the standard form of http I userl passl amp host port HTTP proxy information blank for none http proxy example local 8080 Screenshot Go Back Continue openAfTic Configure the package manager Scanning the mirror k Cancel 4 3 Step by step installation guides 37 openATTIC Documentation Release 1 1 0 Load installer components from CD essssssssu Loading additional components Retrieving netcfg 7 Completion After completing the installation the system will boot automatically The system is based on Debian Wheezy kernel 3 2 GNU GRUB version 1 99 2 deb u2 Debian GNU Linux mit Linux 3 2 0 4 amd64 Now you can see the login prompt with a link where you can access openATTIC via the browser Please login as user openattic and password openattic 4 3 2 ISO installation in text mode The openATTIC iso file for virtualbox VM ware Workstation can be downloaded from http www open attic org downloads
76. apter 4 Installation and Upgrade Guides openATTIC Documentation Release 1 1 0 Tab moves Space selects Enter activates buttons Tab moves Space selects Enter activates buttons 4 3 Step by step installation guides 43 openATTIC Documentation Release 1 1 0 Here we choose the first option use entire disk Choose the disk where the system should be installed Partition scheme files in one partition is standard and adequate for most cases Apply the partitioning Write the changes to disk Install the base system 5 Kerberos Here you can enter the Kerberos Realm If you don t want to configure Kerberos you can skip this part by leaving the field empty and clicking Continue This is an example configuration for Kerberos Enter the Kerberos server general case is a domaincontroller Enter the administrative server for your Kerberos realm 6 Package manager Choose the protocol for file downloads Choose the country for the package manager Chapter4 Installation and Upgrade Guides openATTIC Documentation Release 1 1 0 Partition disks This is an overview of your currently configured partitions and mount points Select a partition to modify its settings file system mount point etc a free space to create partitions or a device to initialize its partition table Guided partitioning Configure software RAID 56513 0 0 0 sda 21 5 GB
77. ates actions initiated by the model into commands to be executed and calls Systemd accordingly 8 4 System API The system API handles execution of commands on the system in a controlled fashion Note that it is not responsible for interpreting the output in any way all interpretation is the job of the higher layers 8 4 4 DBus Interface The system API is a DBus RPC API available on the System bus under the name org openattic systemd Note A tool that simplifies inspection of DBus interfaces is pdbus 8 4 2 Accessing the System API In order to make calls to the System API from the core you can easily retrieve systemd plugins by their path using the systemd helpers get dbus object function which when passed a dbus path returns the object associated with that path 8 3 openATTIC Core 131 openATTIC Documentation Release 1 1 0 gt gt gt from systemd import get dbus object gt gt gt volumes get dbus object volumes gt gt gt volumes lt ProxyObject wrapping dbus dbus SystemBus system at Ox7fc9a748df50 1 1973 volumes at Ox7fc9a8 You can then proceed to calling the methods exported by this plugin on the proxy gt gt gt volumes write fstab P Systemd transactions When it comes to doing complex tasks like the creation of a volume usually a whole bunch of commands needs to be ran in sequence in order to implement the task For this Systemd provides Transactions The client code can use the s
78. ative password changing server for the EXAMPLE LOCAL Kerberos realm Administrative server for your Kerberos realm srvkerberos example local Continue lt Tab gt moves lt 5 activates buttons 46 Chapter 4 Installation and Upgrade Guides openATTIC Documentation Release 1 1 0 lt Tab gt moves Space selects Enter activates buttons Tab moves Space selects Enter activates buttons 4 3 Step by step installation guides 47 openATTIC Documentation Release 1 1 0 Select the mirror server elects Enter activates buttons Enter HTTP proxy information leave blank for none gt selects lt Enter gt activates buttons Configuring apt Select and install software 7 Completion After completing the installation the system will boot automatically The system is based on Debian Wheezy kernel 3 2 Now you can see the login prompt with a link where you can access openATTIC via the browser Please login as user openattic and password openattic 4 3 3 Installation in Univention Corporate Server UCS Since version 1 0 openATTIC supports also the installation under Univention Corporate Server 3 1 Requirements e UCS Member Server 48 Chapter 4 Installation and Upgrade Guides openATTIC Documentation Release 1 1 0 Configuring apt Retrieving file 9 of 9 Select and install software Retrieving file 1 of 3 GNU GRUB version 1 99 27 deb7u2 Debian GNU Linux
79. ause this part is not as easy to implement in Python Put the following in a file named createvm sh bin bash if z 51 1 then echo Usage 0 vm name exit 1 fi VM 1 python createvolume py SVM mkdir media VM mount overs 3 faith media tank SVM media SVM echo faith media tank SVM media SVM nfs vers 3 auto 0 0 gt gt etc fstab Now let s run it a few times and see if it works root zo0e S createvm sh tutorial vm03 root zoe S createvm sh tutorial vm04 roobt szoe e 5 fZoreatevm sh tutorial root zoe S df h Filesystem Size Used Avail Use Mounted on faith media tank tutorial vm01 737G 1 0M 737G 1 media tutorial vm01 falth media tank tutorial vm02 737G 1 0M 737G 1 media tutorial_vm02 faith media tank tutorial vm03 737G 1 0M 737 1 media tutorial vm03 faith media tank tutorial vm04 737G 1 0M 737G 1 media tutorial vm04 faith media tank tutorial vm05 737G 1 0M 737 1 media tutorial vm05 Looks great so far Now let s create some actual virtual machines in these volumes 7 3 4 Automatic VM deployment In the introduction we noted you should also have a QCOW2 VM image to clone deployed VMs from First copy this image to media base qcow2 Extending createvm sh Now in order to run VMs from it we will create new QCOW2 images that are based upon the original image and store all the changes so that VMs will boot from the original image but will not modify it so it ca
80. bject stores focus on scalability high availability and redundancy and leave the rest to the application Note We are currently working on this part of our documentation An update will be available soon 3 4 1 Swift OpenStack Object Storage Swift is a scalable redundant storage system Objects and files are written to multiple disk drives spread throughout servers in the data center with the OpenStack software responsible for ensuring data replication and integrity across the cluster Storage clusters scale horizontally simply by adding new servers Should a server or hard drive fail OpenStack replicates its content from other active nodes to new locations in the cluster 3 4 2 Ceph Ceph does the same thing but also provides block storage and file system based storage in one fell swoop and allows for more sophisticated control over the data placement and redundancy 3 4 3 Hadoop Built on top of HDFS Hadoop allows to apply large scale algorithms to the data stored in an object store and to generate reports 3 5 Storage consolidation When running a datacenter for quite some time storage boxen accumulate and stuff starts getting confusing openAT TIC allows to consolidate storage from all kinds of systems openATTIC or otherwise to be visible and manageable by a single openATTIC system Note We are currently working on this part of our documentation An update will be available soon 12 Chapter 3 Use Cases openATTIC Docume
81. button in the right corner of the graph window in the dashboard overview If you want to reload the graph just click the the button in the middle in the right corner of the graph window By clicking the left button in the right corner of the graph you can minimize the window To maximize it click the button again 71 openATTIC Documentation Release 1 1 0 6 1 2 Command Log The Command log lists commands executed in the background as result of actions taken in the user interface for example the creation of a volume When the user creates a volume the list of actions in the Command Log will include sbin lvcreate Furthermore you can see if the execution of the command was successful or not Click the skip button to view old log entries It s also possible to filter for commands with keywords for example nagios or for a specific date format mm dd yyyy for example 03 31 2014 Just click in the Search field and enter your keyword or a specific date the panel will then display all matches Log Entries End time 05 19 2014 12 22 pm 05 19 2014 11 55 am 05 19 2014 11 39 am 05 19 2014 11 35 am 05 19 2014 11 18 am 05 19 2014 11 15 am 05 19 2014 11 12 am 05 19 2014 11 03 am 05 19 2014 10 53 am 05 19 2014 10 34 am 05 16 2014 1 52 pm 05 16 2014 1 47 pm 05 16 2014 1 38 pm 05 16 2014 1 33 pm 05 16 2014 1 22 pm 05 16 2014 10 08 am 05 14 2014 2 58 pm 05 14 2014 2 50 pm 05 14 2014 2 26
82. cation can be adjusted here 4 2 Demo VMs VM processor configuration 23 openATTIC Documentation Release 1 1 0 Guest Operating System Installation A virtual machine is like a physical computer it needs an operating system How will you install the guest operating system Installer disc image file iso C Users dbreitung Downloads openattic 1 0 iso Name the Virtual Machine What name would you like to use for this virtual machine Virtual machine name openATTIC CE 1 0 Location ciVispenerTi The default location can be changed at Edit gt Preferences 24 Chapter 4 Installation and Upgrade Guides openATTIC Documentation Release 1 1 0 8 VM RAM configuration Memory for the Virtual Machine How much memory would you like to use for this virtual machine Specify the amount of memory allocated to this virtual machine The memory size must be a multiple of 4 MB 64 GB Memory for this virtual machine MB 9 Maximum recommended memory 6204 MB lt 4 E Recommended memory 512 MB lt Guest OS recommended minimum 64 MB 9 Network type Choose Use network address translation NAT Network Type What type of network do you want to add Network connection Use bridged networking Give the guest operating system direct access to an external Ethernet network The guest must have its own IP address on the external network T Give the quest operating system access to
83. chaches safe to use barriers data ordered All data is forced directly out to the main file system prior to its metadata being committed to the journal from man page mount This is an abstract of how a command looks like when mounting a device volume you can find those commands in the Command Log panel which is also described above gt bin mount t e ext4 gdev vgtaithdata demo media demo Menu 4 Status Device Mount Point FS Type Options 5 Dashboard rootfs rootfs TW Command Log sysfs Isys sysfs rw nosuid nodev noexec relatime Service State proc Iproc proc rw nosuid nodev noexec relatime i Mount Points udev Idev devtmpf rw relatime size 10240k nr_inodes 1539074 mode 755 S devpts Idevipts devpts rw nosuid noexec relatime gid 5 mode 620 ptmxmode 000 8 Monitoring tmpfs Irun tmpfs rw nosuid noexec relatime sizez 12326 16k mode 755 4 Storage Idevimapper vgfaith root ext4 rw relatime errors remount ro user_xattr acl barrier 1 da SnapApps tmpfs Irunllock tmpfs rw nosuid nodev noexec relatime size 5 120k A Volume Pool Management tmpfs Irun shm tmpfs rw nosuid nodev noexec relatime size 2465220k lt 9 Volume Management Idevimapper vgfaith netappHTTP Imedia netappHTTP ext4 rw relatime user_xattr barrier 1 data ordered a LUN is Idevimapper vgfaithdata distmark Imedia distmark xfs rw relatime attr2 delaylog logbsize 256k sunit 5 12 swicdt Idevimapper vgfaithdata laura linux Imedia laura li
84. commandline oacli If you want to integrate openATTIC into another system you ll need an API Key Otherwise you can t connect to the openATTIC Host in order to request data or execute actions via the openATTIC API Supported actions of the API Keys panel 6 6 System 105 openATTIC Documentation Release 1 1 0 Volumes of User x Volume Used back 131 backup_13 19_2 52 btrundso 52630006 08 deleteTest01 52630 08 08 demoTest sss 1696 isotestvm laura linux g s 4996 michaell oo 00 netappHTTP ss 8296 Add an API Key Edit an existing API Key e Show API Key URL in case you need the key so you can copy and paste it e Remove an API Key How to add an API Key click the Add button choose an openATTIC user as owner insert a description if needed make sure to set the key on active Add Key x Owner v Description Active 4 AddKey Cancel How to edit an API Key e Select the API Key you want to edit in the list you can change the owner the description or set the key to active or deactivate the key Click the Edit Key button to safe the changes Edit Key x Owner v Description openQRM_community Active v f EdtKey 3 Cancel This is where you can view an API Key URL 106 Chapter 6 User Manual openATTIC Documentation Release 1 1 0 e Select the API Key you want to see the URL click the Show API URL button click the OK or Cance
85. d add it to openATTIC automatically Otherwise you can create one on an empty disk using the oaconfig add disk command for exam ple 4 8 Additional openATTIC Modules 57 openATTIC Documentation Release 1 1 0 oaconfig add disk dev sdb vgstorage This command would create the vgstorage volume group and make it available to openATTIC Ideally the device you use here should be a hardware or software RAID so that you don t lose any data if a disk fails 3 The volume group is now available and can be used 4 8 2 MDRAID Allows the combination of multiple disks to a single device that distributes its data across the member disks in a way specified by the user allowing for load balancing failure tolerance or both Usually used in combination with the LVM module Installing 1 Install the openattic module mdraid package oaconfig install openattic module mdraid 2 This module will periodically scan for RAID devices and update their status in the GUI 4 8 3 TWRAID Manages 3ware RAID controller devices that group multiple disks into a single device in order to provide failure tolerance and caching Installing 1 The openATTIC TWRAID module requires the tw c1i utility to be available It can be retrieved from the HWRAID for Linux repository so please add it to your etc apt sources list file 2 Install the openattic module twraid package oaconfig install openattic module twraid 3 This module will periodicall
86. d the on the Configuration tab Eigenschaften von ISCSI Initiator Ziele Suche Bevorzugte Ziele Volumes und Ger te RADIUS Konfiguration Die vorliegender Konfigurationseinstellungen sind global und betreffen alle k nftigen verbindungen mit dem Initiator Unter Umst nden bleiben alle bestehenden Verbindungen funktionsf hig Sie k nnen jedoch auch unterbrochen werden Falls das System neu gestartet wird oder vom Initiator anderweitig versucht wird erneut eine verbindung mit dem Ziel herzustellen Beim Herstellen einer verbindung mit dem Ziel erm glichen erweiterte verbindungsFunktianen die Steuerung einer bestimmten Verbindung Initiatorname ign 1991 05 com microsoftimziegler win master dns Klicken Sie auf ndern um den Namen des Initiators zu Andern ndern Klicken Sie zum Festlegen des geheimen CHAP Schl ssels des Initiators F r die Verwendung mit der wechselseitigen CHAP AuthentiFizierung auf CHAP Klicken Sie zum Einrichten der IPsec Tunnelmodusadressen F r den Initiator auf IPsec Klicken Sie zum Generieren eines Berichts zu allen Bericht angeschlossenen Zielen und Ger ten im System auf die Berichtsoption Weitere Informationen zur Konfiguration OK Abbrechen bernehmen 92 Chapter 6 User Manual openATTIC Documentation Release 1 1 0 Linux On Linux you can find the IQN in the file etc iscsi initiatorname iscsi after installing and starting the op
87. done Set SSD schedulers to noop for disk in dev disk by id scsi SATA_INTEL_SSD 7777777277227727727277777 do sdx basename readlink S disk echo noop gt sys class block Ssdx queue scheduler done Set 15k SAS disks schedulers to cfq for disk in dev disk by i1d Tscesi 350000081772777777 scsi 35000039777 7777727 do sdx basename readlink S disk echo cfg gt sys class block S sdx queue scheduler done Note When writing such a script ensure that the wildcards only match the actual disks and not any partitions on them So just using dev disk by id somethingx will usually not suffice 4 2 Demo VMs Integrate an openATTIC demo for virtualbox or vmware See also 4 2 Demo VMs 17 openATTIC Documentation Release 1 1 0 4 2 1 Demo VM for VirtualBox The openATTIC demo vm version 1 1 or 1 2 can be downloaded from http apt open attic org vm or from http www open attic org downloads and integrated into VirtualBox Manager as follows 1 open VirtualBox and click File Import Appliance Machine Help Virtual Media Manager Ctrl D A Import Si Ctrl I 2j Details f P wv Snapshots Export Appliance Ctrl E VirtualBox 2 Preferences Ctrl G this window is a list of all virtual machines on your computer The list is empty now because you haven t Exit Ctrl Q machines yet Create a new virtual machine press the New button in the main tool bar gt e or located at
88. e currently running Starting Nagios Performance C Daemon PNP4Nagios npcd Restarting nag os3 monitoring daemon nagios3 Waiting for status dat to appear done 127 0 0 1 netmask 255 0 0 0 addr 127 0 0 1 CARRERE RE PERE PEPE FFE addr 1 broadcast 172 16 14 255 netmask 255 255 255 0 addr ng Service Current Load Service Current Users g Service D sk Space Service HTTP Service SSH Service Total Processes Service openATTIC RPCd Service openATTIC Systemd Completed successfully Figure 4 7 oaconfig install on Bob 4 6 Joining openATTIC to a Windows domain Joining a domain is super easy using this command Keep your domain name and administrator password handy root debpkgtest oaconfig domainjoin mziegler master dns SAPDOM User mziegler Domain master dns Realm MASTER DNS Workgroup SAPDOM Machine Account DEBPKGTESTS Updating krb5 cont Probing Kerberos Password for mziegler MASTER DNS Configuring Samba a method return sender 1 248 gt dest 1 251 reply serial 2 Removing old keytab Joining Domain Enter mziegler s password x x 54 Chapter 4 Installation and Upgrade Guides openATTIC Documentation Release 1 1 0 Using short domain name SAPDOM Joined DEBPKGTEST to realm master dns Processing principals to add Logging in as DEBPKG
89. e file system and click the Create Filesystem button Volume Management Name Type Size Free Used Status Path Host a mca it a TEI P ER srvopenaticci lmasterdns DRBDEndpont 99900MB devivgestdrbdS srvopenatticciO Lmaster dns srvopenatticci02 master dns Endpoint 999 00 MiB UpToDate Idevivgtest2 drbd5 srvopenatticci02 master dns 3g tank Create Filesystem X sdia tank srvopenatticci0 1 master dns 3j tank2 File System xfs 2dia tank2 srvopenatticci02 master dns E vgtest Warning Level 75 srvopenatticci0 1 master dns a drbd5 x iv vgtest drbd5 srvopenatticci0 1 master dns E vgtest2 Critical Level 85 E srvopenatticci02 master dns 3g drbd5 Owner openattic ivivgtest2 drbd5 srvopenatticciO2 master dns Create Filesystem Cancel The volume management should now display the DRBD connection with a file system and it should look like Volume Management Name Type Size Free Used Status Path Host g drbd5 xfs 1000 00 MiB 967 72 MiB online Connected media drbd5 srvopenatticciO 1 master dns srvopenatticci0l master dns Endpoint 999 00 MiB UpToDate Idevivgtest drbd5 srvopenatticciO 1 master dns srvopenatticci02 master dns Endpoint 999 00 MiB UpToDate Idevivgtest2 drbd5 srvopenatticci02 master dns Note Creating the file system takes a little while especially if your DRBD connection is still in the initial synchronization phase Until the file system has been fully created t
90. e kept Chapter 6 User Manual openATTIC Documentation Release 1 1 0 6 1 3 Service State Running openATTIC requires some services to be running as well for example openattic rpcd openattic systemd as well as apache2 for web access The Service state menu offers an overview of all important services and their current state You can start and stop services by selecting the service and clicking the button Start or Stop Warning Stopping important services like openattic_rpcd openattic_systemd or apache2 for a working webin terface causes the openATTIC system to not work fluently Note Please connect to the openATTIC system via ssh in case you re not able to restart the services via the webinter face Type 1 e etc init openattic_rpcd start or etc init d apache2 start Normally you will get a response which says that the service was started successfully Service State Service Name Status apache2 o dbus nagios3 nfs kernel server ntp openattic_systemd proftpd samba ssh iscsitarget Q OQ q qQ lt q 8 qc openattic rpcd Figure 6 3 Service State panel 6 1 4 Mount Points The Mount Points panel offers an overview of all mount points and their properties e Device Mount Point File system Type of the device Options attributes In the following text a more detailed description of the above listed points can be found openATTIC uses the package mount
91. e the code located therein Mercurial already offers you a full fledged source control where you can commit and manage your source code Please refer to Hg Init a Mercurial tutorial if you are not yet familiar with this tool In order to submit changes to the openATTIC team refer to Submitting code to openATTIC 8 2 RPC The APl is the key component that allows the outside world to talk to openATTIC As outlined in the introduction its task 1s to decide which host is responsible for handling a request forwarding it to the core on that host and encoding the response in a way that it can be sent back to the caller The RPC API consists of three layers Transport layer 2 Proxy layer 3 Handler layer 8 2 1 Transport layer Besides the XMLRPC interface openATTIC also provides the API via Ext Direct for easier integration with ExtJS the framework used for the implementation of the GUI The transport layer consists of rpcd extdirect py and the runrpcd py management command These files provide a Django view and an HTTP server and are responsible for API module loading and exposing the lower layers via the respective interfaces 8 2 2 Proxy layer The proxy layer implemented by rpcd handlers ProxyModelHandler provides the target host detection facility and handles forwarding requests either to the local Model handlers or the remote host s XMLRPC server 8 2 3 Handler layer The handler layer implemented by rpcd h
92. e virtual dis 2 419 520 Zuletzt besucht Bibliotheken Bilder 24 Dokumente Musik A Videos Computer amp Lokaler Datentr c Netzwerk wal Dateiname openattic 1 0 v VMware virtual disks vmdl Abbrechen Here you can keep the existing format VMware Workstation ES o Convert existing virtual disk to newer format The chosen virtual disk can be converted to the newest format supported by this Workstation 9 0 virtual machine However after conversion the virtual disk will be unusable with older virtual machines Click the finish button Then you can start the virtual machine openATTIC version 1 1 Here you can access the openATTIC system via console by entering root as user and openattic as password openATTIC version 1 2 Login with user root and password init By typing the ifconfig command you will get the ip address of the demo vm To access the openATTIC user interface you can login with user openattic and password openattic Demo VMs 27 openATTIC Documentation Release 1 1 0 New Virtual Machine Wizard Ea Ready to Create Virtual Machine Click Finish to create the virtual machine Then you can install Debian 6 64 bit The virtual machine will be created with the following settings Name openATTIC CE 1 0 Location 5 Version Workstation 9 0 Operating Syst Debian 6 64 bit Hard
93. e while getting initial credentials etc krb5 keytab is outdated Update it using these commands net ads keytab flush net ads keytab create net ads keytab add HTTP gss acquire cred failed Unspecified GSS failure Minor code may provide more information Apache is not allowed to read etc krb5 keytab or wrong KrbServiceName in etc apache2 conf d openattic 4 8 Additional openATTIC Modules Installing the openattic metapackage will get you started with a pre defined set of openATTIC modules that should be adequate for most situations However openATTIC allows you to choose a different set of modules in accordance with your needs For instance the LVM module is installed by default but you can completely remove it if you only wish to use ZFS in your setup 4 8 1 LVM Handles the partitioning of physical disks into volumes using the Linux Logical Volume Manager LVM supports enterprise level volume management of disks and disk subsystems by grouping disks into volume groups The total capacity of volume groups can be allocated to logical volumes which are accessed as regular block devices LVM also supports snapshots thereby allowing you to instantly create a copy of a volume even while it is being accessed Installing 1 Install the openattic module lvm package oaconfig install openattic module lvm 2 Add a volume group f a volume group already exists on your system the installation process will recognize it an
94. e you want to do something on a regular base or for a temporary period for example taking a snapshot of a volume By creating a job in the Cron Jobs panel openATTIC will create a crontab cron table Crontab is the configuration file in which you can find the given information and the command you have scheduled in the openATTIC user interface 6 5 Services 99 openATTIC Documentation Release 1 1 0 6 5 2 Cron Syntax You can use the following syntax Minutes 0 59 Hours 0 59 for every minute Days 0 31 for every hour for every day Month 1 12 Days of week 0 7 for every month X for every day of week Note 0 to are Sunday to Sunday 7 is like also Sunday You can use commas for separation 6 5 3 Examples Day of month gt m w p 10 10 O LEN pr Hour Day of Month Month Day of Week User Command 0 3 6 9 12 15 18 21 12 3 4 5 6 7 8 9 0 1 2 3 4 5 6 0 3 6 9 12 15 18 21 123455 89 0 12 3 4 5 6 0 3 6 9 12 15 18 21 12345 9 0 123456 0 3 6 9 12 15 18 21 0 1 2 3 4 5 6 0 3 6 9 12 15 18 21 9 0 1 2 3 4 5 6 0 3 6 9 12 15 18 21 2 3 4 0 12 3 4 5 6 0 3 6 9 12 15 18 21 12 3 4 5 6 7 8 9 0 123456 0 1 2 3 4 5 6 036912151821 0 3 6 9 12 15 18 21 0 3 6 9 12 15 18 21 4 5 6 7 8 9 0 12 34 5 6 root lusrisbinloaconfig di losnapshot j 82 Figure 6 16 Cronjob overview A more detailed description about how to add edit and
95. ectly authentication is passed 2 Using Pluggable Authentication Modules to delegate authentication of username and password to the Linux operating system If PAM accepts the credentials a database user without any permissions is created and authentication is passed 3 Using Kerberos tickets via mod auth kerb Apache will verify the Kerberos ticket and tell openATTIC the username the ticket is valid for if any openATTIC will then create a database user without any permissions and pass authentication 4 7 2 Authorization Once users have been authenticated the authorization phase makes sure that users are only granted access to the openATTIC GUI if they posess the necessary permissions Authorization is always checked against the openATTIC user database In order to pass authorization a user account must be marked active and a staff member 4 7 Configuring Authentication and Single Sign On 55 openATTIC Documentation Release 1 1 0 Users created by the PAM and Kerberos authentication backends will automatically be marked active but will not be staff members Otherwise every user in your domain would automatically gain access to openATTIC which is usually not desired However usually there is a distinct group of users which are designated openATTIC administrators and therefore should be allowed to access all openATTIC systems without needing to be configured on every single one In order to achieve that openATTIC allows the n
96. ed out using the intuitive openATTIC interface CONTENTS 1 openATTIC Documentation Release 1 1 0 2 CONTENTS QUICK START OK so you just want to get going without all the gory details Then here you go 1 1 Install Installation for Debian Wheezy apt key adv recv keyserver hkp keyserver ubuntu com A7D3EAFA echo deb http apt open attic org wheezy main etc apt sources list d openattic list apt get update apt get install openattic oaconfig install oaconfig add disk dev sdX vgsomething And like this for Ubuntu Trusty 14 04 apt key adv recv keyserver hkp keyserver ubuntu com A7D3EAFA echo deb http apt open attic org trusty main etc apt sources list d openattic list apt get update apt get install linux image extra uname r openattic Odcontig install oaconfig add disk dev sdX vgsomething That s it now go to http yourbox openattioc and have fun See also Installation and Upgrade Guides if you need help with preparing the installation the installation itself or if you need to know how to setup an openATTIC cluster 1 2 First steps 1 Take a look at the Volume pool management panel It should display the volume group you just added with the oaconfig add disk command 2 On the Volume management panel you can create volumes Create one or two trying out different file systems 3 Check out the modules for C7FS and NFS shares Create some sha
97. en iscsi service 6 3 4 Configuring Volumes LUNs openATTIC completely hides the complexity of configuring different SAN protocols for different hosts depending on which protocols the target hosts support For this reason the GUI only asks you to select the hosts for which you would like a volume to be accessible and then decides itself which protocols are appropriate Note If an initiator supports multiple protocols openATTIC will configure targets for all of them The choice which protocol to use is up to the Initiator In order to configure a LUN open the LUNs panel select the volume you want to make available and click the Edit LUN button You will see a list of hosts that already have access to the volume open 4 TTIC Menu LUNs 4 Q Status Volume Status Dashboard debpkgtest C M OCC cM OM S T ccs Mn Fa Edit LUN debpkgtest Ox Mount Points Hosts al Sensoren Host e Monitoring Hostname LUN ID 45 Storage debpkgtest master dns 1 SnapApps 4 Volume Pool Management 73 Volume Management CX san inm x FT een gts PURI paar 4 NAS 13 19 master dns Web Web amp PY Add 4 Close Linux NFS 4 _ Close Windows CIFS ms To add a host click the Host list button at the bottom of the panel Enter LUN ID in the column on the right next to the host you wish to add and click
98. engrmsto0l 1lvm LogicalVolume gt help Documented commands type help lt topic gt all end filter values help lvm info set ext all values exit rts THEO idobj mount unmount avail fs filter get ids mount all unmount all create filter combo get ext is in standby remove disk stats filter range get shares is mounted set Miscellaneous help topics syntax sections srvopengrmsto0l 1lvm LogicalVolume gt help filter Usage lvm LogicalVolume filter lt kwds gt Search for objects with the keywords specified in the kwds dict kwds may contain the following special fields NN NN x xclude 4 kwargs for an exclude call NN x _ fields xargs for a values call 7 2 XML RPC API 117 openATTIC Documentation Release 1 1 0 Any other fields will be passed as x xkwargs to filter See the Django docs lt https docs djangoproject com en dev topics db queries gt _ for det The commands help syntax and help sections do not refer to the commands themselves they only give a short overview of the introduction of the structure of the oacli shell Call Up The existing commands are identic in every section with the exported methods within those sections Some of the methods expect complex arguments which consists of objects For such cases oacli supports simple arguments as you would do it in a bash as well as the input of an object in JSON syntax srvopengrmsto0l 1lvm LogicalVolume gt get 15
99. er dns E drbd5 i iv vgtest drbd5 srvopenatticciO 1 master dns vgtest2 Critical Level 85 srvopenatticci02 master dns 8 drbd5 Owner openattic Y ivivgtest2 drbd5 srvopenatticci02 master dns 7e Create Filesystem Cancel The volume management should now display the DRBD connection with a file system and it should look like Volume Management Name Type Size Free Used Status Path Host g drbd5 xfs 1000 00 MiB 967 72 MiB online Connected media drbd5 srvopenatticciO 1 master dns srvopenatticci0l master dns Endpoint 999 00 MiB UpToDate Idevivgtest drbd5 srvopenatticciO 1 master dns srvopenatticci02 master dns Endpoint 999 00 MiB UpToDate Idevivgtest2 drbd5 srvopenatticci02 master dns Note Creating the file system takes a little while especially if your DRBD connection is still in the initial synchronization phase Until the file system has been fully created the volume will be in the Locked state Please wait amoment for the file system to be fully created 3 Create an NFS share to export the volume Make sure that all nodes that need access to the share are accounted for either by creating an export that includes the whole subnet or by creating an export for each node 4 Mount the share in your virtualization system as described in the following sections 5 2 3 oVirt To use the openATTIC volume for virtual machine deployment in oVirt you have to add it as an NFS storage domain To do so 1
100. fferent functions Only those methods of your Systemd plugin that are associated with a signature string will be exposed by DBus so you have to make use of the systemd plugins method orsystemd plugins deferredmethod decorators in order for your methods to be available The systemd plugins method decorator accepts two signatures in signature describes the function parameters out signature describes the structure of the return value Methods decorated with method will always be called directly and cannot be part of transactions 132 Chapter 8 Developer documentation openATTIC Documentation Release 1 1 0 If you ned a method to partake in transactions you need to decorate it using systemd plugins deferredmethod This decorator only accepts an in signature because methods cannot return anything when ran as part of a transaction the caller would have no way of retrieving the return value The invoke function Since systemd s main job is the execution of commands it comes with a function called systemd procutils invoke that does the heavy lifting 8 5 Integration Testing When making changes to openATTIC you will want to make sure those changes work as intended and do not break anything For that you can use Gatling the openATTIC integration test suite Gatling uses the openATTIC XML RPC API and runs a complete test of all features making sure they work as intended 8 5 1 Prerequisites In order to run Gatling you need
101. first selecting Monitoring from the menu tree on the left Select the service and click the Dash board button You can change the suggested name for the graph if you want to and click ok and your graph will appear on the Dashboard open Afric Menu Dashboard Status board Volumes alex ffic on brO All protocols bytesis 2 Comman d Log Volume Used v Traffic on bro ligi Service State esx dpri s Mount Points 13 19 2 gore IT EQ Monitoring 5 Storg demoTest 01 SnapApps michael2 Volume Pool Management netappHTTP Volume Management 98 SAN demoTest_enterprise i LUNs demoTest enterprise clone3 ne k Portal NAS CPU Time CPU Tims x Systemd time x qj Web FTP gs p wee HTTP CPU Time openATTIC Systemd Linux NFS S dows CIFS 1 Embedded TFTP 1 0 4 9l Services ren Cron Jobs 4 Th System API Record Hosts User Management a Avg cul avg API Keys Dus 271 83n 291 96m B tine 6 02n 6 11m B ni 50 00m amp Online Update mn fic on eth1 All protocols bytesis Personal Setting 2 irrent Load load 0 Shutdown Current Load Traffic on ethl Logout 700 sot Reboot 00 40 Shutdown 500 d 400 T 10 300 9 200 100 10 cur Avg Cur g B load 277 20m 11707m ftpctrl in byte 0 00 0 00 ftpdata in bytes 0 00 0 00 Figure 6 1 Dashboard panel Remove graphs by clicking the x
102. g username and password works like this gt gt gt from xmlrpclib import ServerProxy gt gt gt sp ServerProxy http user password 8 host 31234 7 gt gt gt sp volumes StorageObject all Or using an API key gt gt gt from xmlrpclib import ServerProxy gt gt gt sp ServerProxy http __ lt apikey gt lt host gt 31234 gt gt gt sp volumes FileSystemVolume filter pool 5 Warning Python s xmlrpclib is not thread safe so be careful when writing threaded applications In particular do not share ServerProxy instances between multiple threads The following works for PHP when using the openATTIC XMLRPC Proxy Library which takes care of the encoding busywork lt php include openattic client php Soa new OpenAtticProxy http __ lt apikey gt lt host gt 31234 print r 5oa volumes StorageUbJject all print_r Soa gt volumes gt FileSystemVolume gt filter array pool gt 5 7 2 3 Deep dive The examples above gave you a very quick overview on how to connect to the API Of course the API provides a rich set of functions which can be used to control every part of the openATTIC system In fact the GUI uses it itself so there is no point in the GUI that is not accessible via the API For easy exploration and testing every openATTIC system comes with a command line utility named oacli which shows you which sections and functions are available and what
103. ged at regular intervals The root user should not have an empty password If you leave this empty the root account will be disabled and the system s initial user account will be given the power to become root using the sudo command Note that you will not be able to see the password as you type it Root password Please enter the same root password again to verify that you have typed it correctly Re enter password to verify EI Screenshot Go Back Partition disks The installer can guide you through partitioning a disk using different standard schemes or if you prefer you can do it manually With guided partitioning you will still have a chance later to review and customise the results If you choose guided partitioning for an entire disk you will next be asked which disk should be used Partitioning method Guided use entire disk Manual Screenshot Go Back Continue e openAfTIC Partition disks Note that all data on the disk you select will be erased but not before you have confirmed that you really want to make the changes Select disk to partition 5 513 0 0 0 sda 21 5 GB VMware VMware Virtual 5 Screenshot Go Back Continue 4 3 Step by step installation guides 33 openATTIC Documentation Release 1 1 0 Partition disks Selected for partitioning SCSI3 0 0 0 sda
104. h master dns faith master dns faith master dns faith master dns faith master dns faith master dns faith master dns faith master dns faith master dns faith master dns faith master dns faith master dns faith master dns Last Check 06 25 2412 9 12 pm 0612512412 9 21 pm 06 25 2412 9 32 pm 06 25 2412 9 30 pm 06 25 2412 9 13 pm 06 25 2412 9 10 pm 06 25 2412 9 38 pm 06 25 2412 9 23 pm 06 25 2412 9 05 pm 06 25 2412 9 33 pm 06 25 2412 9 23 pm 06 25 2412 9 31 pm 06 25 2412 9 12 pm 06 25 2412 9 16 pm Last Check 06 25 2412 9 12 pm 0612512412 9 21 pm 06 25 2412 9 32 pm 06 25 2412 9 30 pm 06 25 2412 9 13 pm 06 25 2412 9 10 pm 06 25 2412 9 38 pm 06 25 2412 9 23 pm 06 25 2412 9 05 pm 06 25 2412 9 33 pm 06 25 2412 9 23 pm 06 25 2412 9 31 pm 06 25 2412 9 12 pm 06 25 2412 9 16 pm Next Check 06 25 2412 10 02 pm 06 25 2412 10 11pm 06 25 2412 10 22 pm 06 25 2412 10 20 pm 06 25 2412 10 03 pm 06 25 2412 10 00 pm 06 25 2412 10 28 pm 06 25 2412 10 13 pm 06 25 2412 9 55 pm 06 25 2412 10 23 pm 06 25 2412 10 13 pm 06 25 2412 10 21 pm 06 25 2412 10 02 pm 06 25 2412 10 06 pm Next Check 0625 2412 10 02 pm 06 25 2412 10 11 pm 06 25 2412 10 22 pm 06 25 2412 10 20 pm 06 25 2412 10 03 pm 06 25 2412 10 00 pm 06 25 2412 10 28 pm 06 25 2412 10 13 pm 06 25 2412 9 55 pm 06 25 2412 10 23 pm 06 25 2412 10 13 pm 06 25 2412 10 21 pm 06 25 2412 10 02 pm 06 25 2
105. h the API record function you can record those API actions by clicking the menu entry on the left subitem of System and it will start recording When you re done with recording actions in the user interface click the API record entry again then it will display the result in a separate window which will look like this add volume example API xl volumes VolumePool create volumea l F demoTest 100 owner warning 5 Tseritical 85 1 If you want to participate or develope your own plugin or extensions for openATTIC this feature could be very useful in order to see how openATTICs API works for example you can see the expected parameters of a function 6 6 2 Hosts Here you can see all hosts openATTIC is connected with There are peers which are connected to openATTIC via an API Key for example to connect a cloud platform to openATTIC as well as hosts which use storage provided by openATTIC and mapped via the protocols FibreChannel or iSCSI in order to extend the available storage of a virtualization host for example Hosts are listed on the left on the right you can see the host attributes peer initiator If you select a host you will see a small arrow in front of the peer and or initiator directory if there are any entries Add host s in order to configure attributes for this host Enter the IP address or hostname click Add Host button Edit host s Select the host you want t
106. hat is itself on SSDs 5 Do you plan on using replication in order to provide failure tolerance If so you will require the same hardware for all of your nodes because when using synchronous replication the slowest node limits the performance of the whole system make sure the network between the nodes has a low latency and enough bandwidth to support not only the bandwidth your application needs but also has some extra for bursts and recovery traffic Note When running VMs a Gigabit link will get you pretty far Money for a IOGE card would be better spent on faster disks you should have a dedicated line available for replication and cluster communication There should be no other active components on that line so that when the line goes down the cluster can safely assume its peer to be dead 6 Up to the supported maximum of 128GB per node add as much RAM as you can afford The operating system will require about 1GB for itself everything else is then used for things like caching and the ZFS deduplication table Adding more RAM will generally speed things up and is always a good idea 2 4 System requirements 1 openATTIC is designed to run on Linux 2 Supported Linux distributions are Debian Wheezy Ubuntu Precise 12 04 LTS Ubuntu Trusty 14 04 LTS Univention Corporate Server 3 1 3 In order to use ZFS make sure ZFS on Linux is available for your distribution For the distributions listed above
107. he administrative subsystems are syncdb Creates a database schema It is recommended to not use this command itself use the command oaconfig install instead haveadmin Shows if at least one administrative user of the database exists mkapikey Creates an API Key for a user changepassword Changes the password of a user shell Executes a python shell as openattic user 4 9 2 How to backup the openATTIC database 62 Chapter 4 Installation and Upgrade Guides FIVE IMPLEMENTING THE USE CASES As outlined in Use Cases there are a number of ways of setting up openATTIC Once the initial installation has been completed you can proceed to integrating openATTIC into your environment depending on your needs The guides in this chapter provide step by step tutorials on how to build the various setup variants 5 1 Implementing a file server This section describes the implementation procedure for the Fileserver use case Please refer to this section for more general considerations 5 1 1 Prerequisites File servers usually don t impose latency critical requirements upon the storage system The limiting factors are storage capacity and bandwidth This means that using bigger slower disks is fine However care needs to be taken when it comes to parity The bigger your disks are the more likely a rebuild will fail due to an unrecoverable read error URE Make sure you either have at least double parity using
108. he volume will be in the Locked state Please wait a moment for the file system to be fully created 3 Create a CIFS share to export the volume 4 Connect to the share using Windows Explorer and configure permissions 5 1 4 Snapshots openATTIC supports creation and export of snapshots of the shared volume Those will be visible in a hidden directory in the share s root directory called snapshots in which snapshots will be available This directory will be populated automatically when you create a snapshot using the volume management Each snapshot will be available as a subdirectory inside snapshots 5 1 5 Mirror servers In order to set up a mirror server follow the procedure outlined above and simply use an HTTP export instead of a CIFS share 64 Chapter 5 Implementing the Use Cases Organisieren 3 19 masterdns blog pictures Neuer Ordner ffnen Bilder Dokumente Musik Videos Name m snapshots i last found DSC 1908JPG DSC 1908 MEF E DSC 1909JPG DSC 1908 MEF DSC 1810JPG DSC 1910 MEF DSC 1911JPG DSC 1911 MEF ME Computer L DatPladde iC mzsmbtest srvopena Ge ith C stoa3 055 GP Daten 8172 18 11 10 openATTIC Documentation Release 1 1 0 Anderungsdatum 07 05 2014 15 20 21 09 2013 13 33 21 09 20135 13 41 21 09 2013 13 42 21 09 2013 13 41 21 09 2013 13 42 21 09 20135 13 41 21 09 2013 13 42 21 09
109. hen you re done decide whether or not you want to submit the code 8 1 Setting up a development system In order to begin coding on openATTIC you will require a development system Setting one up can be easily done with the following steps 1 openATTIC requires a bunch of tools and software to be installed and configured which is handled automatically by the Debian packages While you could of course configure these things manually doing so would involve a lot of manual work which isn t really necessary Set up the system just as described in nstallation and Upgrade Guides but do not yet execute oaconfig install We recommend using the Nightly Build for dev systems 2 Set the installed packages on hold to prevent Apt from updating them 3 Install Mercurial 4 Goto the srv directory and clone the openATTIC repository there apt mark hold openattric x apt get install mercurial ed sev hg clone https bitbucket org openattic openattic 5 In the file etc default openattic change the OADIR variable to point to the clone 129 openATTIC Documentation Release 1 1 0 OADIR srv openattic 6 In the file etc apache2 conf d openattic change the WSGIScriptAlias line to point to the clone WSGIScriptAlias openattic srv openattic openattic wsgi 7 Run oaconfig install You can now start coding in srv openattic The openATTIC daemons GUI and the oaconfig tool will automatically adapt to the new directory and us
110. html or http apt openattic org iso Available versions Openatbtic l 0 190 OpenATTIC Stable v1 0 1 180 OpenATTIC Stable v1 1 openattic weekly iso openATTIC Weekly Build This guide is for the installation using the openATTIC ISO image in text mode The following screenshots will guide you step by step through the installation After booting from the CD you will see the following screen You can choose between the different installation options To run the installation in text mode choose Install 1 Language configuration 38 Chapter 4 Installation and Upgrade Guides openATTIC Documentation Release 1 1 0 Debian GNU Linux 7 8 tty1 openATTIC http openattic demo master dns openattic openattic demo login _ openATTIC Debian installer boot menu Install Graphical install Advanced options Hel Install with speech synthesis Press ENTER to boot or to edit a em entry 4 3 Step by step installation guides 39 openATTIC Documentation Release 1 1 0 System language configuration Set the time zone Choose keyboard layout Required components will be loaded automatically 2 Network configuration Choose between configuring the network manually or using auto configure Waiting time in seconds for link detection 3 System configuration Create the hostname Enter the domain name if available otherwise leave it empty Insert a root password Re enter password to
111. ic vm ttyl ttic vm login 0 4 E STRG RECHTS Demo VMs 21 openATTIC Documentation Release 1 1 0 22 ct distrib dual files Debian GNU Linux with ABSOLUTELY NO WARRANTY to permitted by applicable law root amp openattic vm s ifconfig Link inet addr 172 16 inet6 addr f880 UP B DCAS RX packets TX packets collisions t RX bytes Lint inet addr inet6 addr UP LOOPBAC HWaddr 08 00 27 65 c0 72 LU ID ICG 172 16 17 a0n0 27ff 5 c072 64 S MTU 1500 dropped 0 overruns 0 frame 0 dropped 0 overruns O 0 nis To p i 12 0 KiB Loopback 7 1 Mask 2 B 16 0 dropped 0 overruns 0 frame 0 0 161 8 KiB TX BERE nn 172 1617185 openatt Login Benutzername openattic Passwort eee a VMware Workstation SEN Eile Edit View VM Iabs Help Oe Libr x il a B Computer ries VMware Workstation 9 Create a New Virtual Machine Create a virtual machine on this computer Open a Virtual Machine Open a virtual machine on this computer 4 Connect to a Remote Server b Open virtual machines on a remote server Virtualize a Physical Machine ug Create a virtual machine from an existing physical machine Virtual Network Editor Change the network configuration used by C virtual machines on this computer ME Workstation Preferences Customize VMware Workstation to
112. ick of a button This way you re not limited to the space of one storage node in any way 2 2 Performance When you re centralizing storage for a multitude of machines you have to make sure the storage system is able to take the load This cannot be achieved simply by buying more and better hardware Scaling up vertically by upgrading the hardware of a single machine gets pretty expensive beyond a certain point Scaling out horizontally by buying more machines is fair enough regarding the price but at the end of the day it always comes down to a single user waiting for a single disk to do stuff so this approach does not do anything to increase that particular user s experienced performance The only really effective way to keep performance high is to avoid making the mistakes which degrade it openATTIC has proven its worth in real world datacenters running as central storage for a virtualization cluster where latency is critical Throughout this guide you will find hints and warnings about performance issues Taking these into account is strongly advisable to make the best of your hardware 2 3 Hardware requirements openATTIC is designed to run on commodity hardware so you are not in any way bound to a specific vendor or hardware model However there are a couple of things you should be aware of when designing the system 1 Buy an enclosure with enough room for disks The absolute minimum recommendation is twelve disks but if you can
113. igured to use openATTIC through its ExtStorage interface 3 3 2 Automation The key component of Cloud storage is automation openATTIC has been designed with Automation in mind from the very beginning and provides an XML RPC interface through which every feature that openATTIC provides can be configured remotely Using openATTIC as the foundation for automated deployment will give you maximum flexibility Please refer to the ntegration Tutorial for a demonstration of how this works 3 3 Cloud Storage 11 openATTIC Documentation Release 1 1 0 3 3 3 Synchronized file storage OwnCloud openATTIC can be used as a storage backend for OwnCloud to provide a shared file storage and synchronization service Your users will get the benefit of having the latest version of their files on all devices and being able to easily share them with others Administrators won t need to worry about where the storage comes from because OwnCloud seamlessly joins multiple volumes together and takes care of the decision on where to put files 3 4 Object Storage Object storage systems provide a way of storing data as a large array of objects The object storage system does not care about the structure of these objects structure is left to whatever system is using the object store This can be an emulation of a classic file system but it does not have to be that way any structure the application requires is possible because the object store just doesn t care O
114. ion in the OSI model meaning that different SAN protocols operate over different kinds of networks 6 3 LUNs SAN 89 openATTIC Documentation Release 1 1 0 e FibreChannel is a data link layer 2 protocol It does not use any underlying network structure at all and requires its own infrastructure of switches called Fabric e FibreChannel over Ethernet is a network layer 3 protocol and operates on standard Ethernet networks iSCSI is an application layer 7 protocol and operates on standard IP networks such as the Internet Since all these protocols share the same paradigms they can all be configured in one single interface in openATTIC 6 3 2 Configuring openATTIC as a Target In order to make use of SAN protocols openATTIC needs to be configured as a Target first How this is done depends on the protocol used FibreChannel Note In order to use FibreChannel you need at least the kernel version 3 5 When using Debian Wheezy which currently uses the kernel version 3 2 you can install the kernel from the wheezy backports repository 1 Make sure your openATTIC system is equipped with at least one QLogic FibreChannel HBA 2 Install the irmware qlogic package 3 Configure the Linux FC driver to set your HBAs to Target mode 4 Reboot the system for the changes to take effect 5 Runoaconfig install in order to detect available FC targets Use the following commands to do this apt get install firmware qlogic echo
115. is at 0 00 4hours 1day 1week 1month 1year Icinder mnt 9783e 11ebb7 da64f3d90faB 10e026604 Unnamed Unit c1 u2 BlockTest03 ceph03 demo2 demoiscsi Create Nagios portlet x Please enterthe title forthe new Portlet ES tar domee Tras per second Inu irre OK Cancel 150 m 100 m 50 m 12 00 14 00 16 00 18 00 20 00 00 Btot i 04 00 08 00 Min Host faith master dns faith master dns faith master dns faith master dns faith master dns faith master dns faith master dns faith master dns faith master dns faith master dns faith master dns faith master dns faith master dns faith master dns Last Check 06 25 2412 9 12 pm 06 25 2412 9 21 pm 06 25 2412 9 32 pm 06 25 2412 9 30 pm 06 25 2412 9 13 pm 2412 9 10 pm 06 25 2412 9 38 pm 06 25 2412 9 23 pm 06 25 2412 9 05 pm 2412 9 33 pm 2412 9 23 pm 25 2412 9 31 pm 06 25 2412 9 12 pm 06 25 2412 9 16 pm Figure 6 6 Add graph to dashboard SP CPU Time Current Load current Users EJ Disk space Disk stats for Disk stats for BlockTest03 Disk stats for ceph03 Disk stats for demo2 Disk stats for demoiscsi Disk stats for demoTest P Disk stats for fump3 Disk stats for LAURA_TEST G Disk stats for laura VolTest Disk stats for netannHTTP Plugin Output Target User 0 43 Sys 0 19 0 09 99 0
116. is volume with a file system partition it or put it into an LVM volume group just like any local disk 6 4 Shares File shares provide a means to access files on a remote system in the same way that you access files on the local disks Depending on the operating system and protocols used users won t even notice the difference because the file share seamlessly integrates into the system In this scenario the actual file system is running on the storage server This means that the storage can provide advanced functionality like caching snapshots deduplication and backups Of course each protocol is better suitable for some applications than for others the module descriptions outline what each protocol is best used for and link to use case implementation guides which describe the protocols in the context of their application 6 4 1 CIFS See also This step is part of Implementing a file server CIFS formerly called Server Message Block SMB is a protocol established by Microsoft that is optimized for build ing central file storage servers used throughout the organization This protocol has its strengths in user authentication single sign on and authorization management gt a n ATTIC Volumeverwaltung SnapApps Windows CIFS Monitoring Menu Samba Share name Path Available ELI SnapApps 4 Volume Pool Management demo btrfs Imedia demo btrfs Ff Volume Management demo zfs media demo zfs G
117. it tests to your modules Sign up for a BitBucket account if you have not already done so Fork the openattic repository into your own account Please see the tutorial on how to do so A vU N Push the changes you have commited locally to your fork of the repository You do not have to fork the repository before making any changes you can just as easily push changes you made already into a newly created fork 6 Send us a pull request See also This documentation is also available as a PDF file 134 Chapter 8 Developer documentation INDICES AND TABLES e genindex modindex search fulltoc 135
118. k is a performance indicator the higher the revolution per minute the faster is the disk SAS 15k rador RAID 5 2gB E E93 F3 zpool 1088 51GB 0 00 Online Tia Figure 6 9 Volume Pool Management panel How to add a volume group to openATTIC e oaconfig add vg adds an existing volume group to the openATTIC database oaconfig add disk formats a disk and adds it to a volume group If the volume group doesn t exist yet it will be created and added to the database 6 2 2 Volume Management As its name says the Volume Management Panel manages anything that has something to do with volumes Every volume group and the volume which belongs to that volume group are listed There are also more details about each item in the list like Type either volume group or the file system else you will see a for block volumes Size Used space in percent depending on the set warning and critical level the status bar will turn orange red when the level is achieved Status online ok offline Warning level in percent 6 2 Storage 77 openATTIC Documentation Release 1 1 0 Critical level in percent Path i e dev vgfaithdata test The owner of the volume Free space of the volume Used space of the volume The following actions are supported Add Volume s Delete Volume s Edit Volume s e Resize Volume s e Snapshot Volume s Mount Volume s Unmount
119. k stats for Disk stats for BlockTest03 Disk stats for ceph03 Disk stats for demo2 Disk stats for demoiscsi Disk stats for demoTest Disk stats for fump3 Disk stats for LAURA TEST Disk stats for laura_VolTest Disk stats for netannHTTP Graphs Graph load 15 loads 76 Disk load for sde is at 0 02 Unnamed Unit Ic1 u2 Disk load for dm 27 is at 0 0196 BlockTest03 Disk load for dm 11is at 0 01 ceph03 Disk load for dm 29 is at 0 01 demo2 Disk load for dm 12 is at 0 0196 demoiscsi Disk load for dm 31is at 0 01 demoTest Disk load for dm 3 is at 0 0096 fump3 Disk load for dm 33 is at 0 02 Disk load for dm 25 is at 0 01 Disk load for dm 2 is at 0 00 4hours 1day 1week 1 lyear LAURA TEST laura VolTest netappHTTP Current Load 400 nf 300 m 200 n 100 m 9 2 00 1400 16 00 18 00 20 00 22 00 00 00 02 00 04 00 06 00 08 00 10 00 cur Min Avg Max Bl load 5 149 40m 50 00m 141 101 398 60n Start time March 31 2014 11 14 a m End time April 1 2014 11 13 a m Figure 6 8 Monitoring panel overview Host faith master dns faith master dns faith master dns faith master dns faith master dns faith master dns faith master dns faith master dns faith master dns faith master dns faith master dns faith master dns faith master dns faith master dns Host faith master dns fait
120. l button to close the window API URL x Use this URL to connectto the openATTIC API using the API Key you selected Note that the input field only allows for easier copy paste any value you enter here will be ignored http __ bc1628d8 b121 4924 a8e1 ce49767d2784 faith master dns 31234 OK Cancel Delete an API Key e Select the API Key you want to delete answer the confirmation message Delete Key x Do you really want to delete openattic s key keyEnterpriseQRM Yes No 6 6 5 Online update In case there are some packages which need to be updated you will see them in the Online Update panel There are also detailed information about the package name the installed version the candidate version and which action install upgrade delete is necessary to get the latest version Some packages are no longer needed so they will be removed Available options Reload Changes list Update Package list Allow installation deletion APT Upgrading 11 newly installing 0 deleting 0 keeping 12 packages downloading 29 44 MiB 0 14 MiB will be freed Name Installed Version Candidate Version Action udisks 104 7 104 7wheezyl Upgrade 15216 2 7 1 15216 2 deb7u2 Upgrade python2 7 273 6 2 7 3 6 deb7u2 Upgrade lighttpd 14 31 44deb7u2 HMMdebzu3 grec python magic 5 11 2 deb7u1 5 11 2 deb7u2 Upgrade file 5 11 2 deb7ul 5 11 2 deb7u2 Upgrade python2 7 minimal 273 6 2 7 3 6 deb7u2 Upgrade python2 7
121. le system xfs supported volume size up to 1 exbibyte EiB supported file size up to 16 tebibytes TiB improve large file performance reduce fragmentation high performance 64 bit journaling file system excels in parallel input output operations due to its design enables extreme scalability of I O threads file system bandwith and size of the file system itself We recommend using XFS for virtualization max file size up to 8 EB max partition size up to 8 EB btrfs B tree file system experimental online volume growth and shrinking Online balancing btrfs moves objects between disks to balance the load Subvolumes File cloning max file size 16 EB max supported volume size 16 EB Volume Management Actions Here you can find some basic steps like creating deleting resizing mirroring a volume described in more detail This is where you can add a volume Click the Volume button and enter the name of the new volume Choose the volume group in which the volume should be created 6 2 Storage 79 openATTIC Documentation Release 1 1 0 Select a file system Note If you want to mirror the volume or share it using SAN protocols do not create a file system on this volume See also Mirror configuration below Enter the size Warning Level default is at 75 but you can change it if you want to Critical Level default is at 85 but you can change it as well Owner choose the owner of
122. local to the machine you are logged in to or remote on other storage nodes in the same cluster The configuration will just work transparently However your clients will still need to connect to the correct storage node in order to access data and volumes will be limited in size to the amount of storage on a single node Furthermore this setup does not tolerate the failure of a storage host only the failure of individual disks 1s accounted for 2 1 2 Mirrored cluster If the limitations of a simple cluster setup are unacceptable you can go one step further and install a mirrored cluster This setup provides failure tolerance by mirroring all data of one node to a standby node which gets activated in case the primary node fails The clients will not be aware of the failover process However this setup cannot be easily modified or extended and will only allow you to use the space provided by one node at a time openATTIC Documentation Release 1 1 0 2 1 3 Advanced cluster If you want to be able to modify the cluster structure more easily by simply adding or removing nodes you can achieve that using the advanced cluster setup This configuration combines the storage space of all nodes in the cluster and automatically distributes copies of data across different nodes providing both scalability and failure tolerance in the process To the clients the storage cluster looks like a single entity providing petabytes of storage space at the cl
123. look at the offered options 108 Chapter 6 User Manual openATTIC Documentation Release 1 1 0 Auto expand root nodes enabled by default view all menu entries and their subitems to see the menu entries without their subitems uncheck it Show hints enabled by default default is checked gives you configuration options hints for different cases if needed for example in the volume management panel when adding a volume Add Volume X Name test Volume Pool vgfaith File System If you want to use DRED with this A device do not yet create file system Size in MB on it even if you want to share it using SAN services later on Warning Level 75 Y Critical Level 85 v Owner gt Create Volume amp amp Cancel Figure 6 19 hints activated Allow installation deletion enabled by default Allow openATTIC to automatically install required packages or remove unnecessary packages Enable gradients in graph not enabled by default Displays graph with gradients in the monitoring panel and graphs which were added to the dashboard site Disk stats for test2 Total IOs per second m A a 3 2 32 3 3 gt a 3 3 3 Min Avg Max Bl tot iops 0 00 0 00 11 21m 170 40m Start time May 26 2014 6 22 a m Figure 6 20 This is how graphs look like without gradient Catch F5 and reload the current panel only not enabled by default
124. m name vmname sys argv 1 Paste your URL here oa ServerProxy http eaa8eff0 bc93 45d1l beb2 ac61a8748e848faith 31234 volume id oa volumes StorageObject create volume 45 vmname 1000 filesystem zfs lswernasng 935 989 Wege pps atm 2 9 User idr 2 oa volumes StorageObject wait volume id id 600 oa nfs Export create volume volume_id filesystemvolume oath media tank vmname options rw no_subtree_check no_root_squash address 172 1013 12329 The sections explained 1 Loading libraries and parsing arguments 124 Chapter 7 Integration openATTIC Documentation Release 1 1 0 import sys from xmlrpclib import ServerProxy if len sys argv lt 2 print Usage python createvolume py vm name vmname sys argv 1 2 Initializing the connection to openATTIC ServerProxy http eaa8eff0 bc93 45d1l beb2 ac61a8748e848faith 31234 Warning Python s xmlrpclib is not thread safe so be careful when writing threaded applications In particular do not share ServerProxy instances between multiple threads 3 Creating the volume the same way we did in oacli volume id oa volumes StorageObject create volume 45 vmname 1000 filesystem zfs Iswarning 95 Escritical owner eg ops User ides 2 4 Waiting for the volume creation process to complete oa v
125. me should be consult your network administrator If you are setting up your oun home network you can make something up here Hostname openattic demo Bo Back Cont inue Configure the network The domain name is the part of your Internet address to the right of your host name It is often something that ends in com net edu or org If you are setting up a home network you can make something up but make sure you use the same domain name on all your computers Domain name example local lt Go Back gt Cont inue moves ace Enter activates buttons Set up users and passwords You need to set a password for root the system administrative account A malicious or unqualified user with root access can have disastrous results so you should take care to choose a root password that is not easy to guess It should not be a word found in dictionaries or a word that could be easily associated with you A good password will contain a mixture of letters numbers and punctuation and should be changed at regular intervals The root user should not have an empty password If you leave this empty the root account will be disabled and the system s initial user account will be given the power to become root using the sudo command Note that you will not be able to see the password as you type it Root password lt Go Back gt Cont inue moves lt Space gt sele lt Enter gt activates buttons Ch
126. n be used over and over again The command to do this looks like this qemu img create f qcow2 b media base qcow2 media SVM hda qcow2 10G chown libvirt qemu libvirt qemu media S VM Append these commands to the end of createvm sh Next we ll add code that creates a configuration file for 1ibvirt and defines the new VM from it The new VM will have GiB of RAM 126 Chapter 7 Integration openATTIC Documentation Release 1 1 0 e CPU the boot disk set to the newly created image arandom VNC port The code to create the VM is a bit lengthy TEMPFILE 2 tempfile cat STEMPFILE EOF domain type kvm gt lt name gt SVM lt name gt memory unit KiB gt 1048576 lt memory gt lt currentMemory unit KiB gt 1048576 lt currentMemory gt lt vcpu placement static gt 1 lt vcpu gt lt 05 gt type arch x86 64 machine pc 1 0 gt hvm lt type gt boot dev hd 7 gt features lt 1 gt lt pae gt lt features gt clock offset utc on poweroff destroy on poweroff on reboot restart on reboot on erash restart on crash devices lt emulator gt usr bin kvm lt emulator gt disk type file device disk driver name qemu type qcow2 cache none aio threads gt source file media VM hda qcow2 gt target dev hda bus virtio disk interface type bridge
127. ng kwagner mziegler jkuhn tdehler 2 Configuring Apache Please take a look at etc apache2 conf d openattic At the bottom this file contains a configura tion section for Kerberos Uncomment the section and adapt the settings to your domain In order to activate the new configuration run apt get install libapache2 mod auth kerb a2enmod auth kerb a2enmod authnz ldap service apache2 restart 3 Logging in with Internet Explorer should work already Firefox requires you to configure the name of the domain in about config under network negotiate auth trusted uris 4 7 4 Troubleshooting As this is Kerberos and LDAP we re talking about you will run into trouble 56 Chapter 4 Installation and Upgrade Guides openATTIC Documentation Release 1 1 0 First of all remember that the Operating System chapter did tell you to install NTP and make sure that hostname fqdn outputs something that makes sense and please double check that this works before proceeding Now enjoy this little list of error messages We ve provided the usual meanings for your convenience e Client not found in Kerberos database while getting initial credentials The KDC doesn t know the service 1 e your domain join failed e Preauthentication failed while getting initial credentials Wrong password or etc krb5 keytab is outdated the latter should not happen because oaconfig domain Jjoin ensures that it is up to date Generic preauthentication failur
128. nk tank raidz2 dev disk by id scsi 3500000e1 1 2 3 4 5 6 raidz2 dev disk by id scsi 350000392 1 2 3 4 5 6 log mirror dev disk by id scsi SATA_INTEL_SSD 1 2 4 1 2 Operating System 16 Disable swap Make sure the output of hostname fqdn is something that makes sense e g srvopenattic0l example com instead of localhost localdomain If this doesn t fit edit etc hostname and etc hosts to contain the correct names In a two node cluster add a variable named SPEER to your environment that contains the hostname not the FODN of the cluster peer node This simplifies every command that has something to do with the peer Ex change SSH keys In pacemaker based clusters define the following aliases to make life easier alias maint crm configure property maintenance mode true alias unmaint crm configure property maintenance mode false After setting up MD raids make sure mdadm conf is up to date This can be ensured by running these commands usr share mdadm mkconf gt etc mdadm mdadm conf update initramfs k all u Install and configure an NTP daemon You may want to install Ladvd package which will ensure that your switches correctly identify your system using LLDP Make sure etc drbd d global common conf contains the following variables disk no drsk barrier no disk flushes no md fiushes net max buffers 8000 max epoch size 8000 syncer al extents 3389
129. ntation Release 1 1 0 3 6 Backup Backup is a standard procedure in every datacenter that protects against data loss and corruption events and allows data to be restored Data corruption or loss does not only occur through hardware failures or software errors By far the most data is lost as a result of human errors like accidental deletion While Snapshots are a useful short term way to handle that situation they require the data loss to be noticed within a short period of time Backups are usually kept longer so the time to notice data loss is extended The downside is that lots of storage space is required which is why magnetic tapes are still the predominant storage medium for long term backups Tapes are however more of a hassle and take longer to restore data from than snapshots which is why they alone are not a satisfactory solution Using disks for a short term and tapes for a long term backup is the ideal solution Not only are snapshots a much nicer way of restoring data through deduplication the storage system can actually reduce the amount of data that needs to be stored And since it acts like a cache device towards the tape library the life of the tapes is increased because technical problems like shoe shining can be avoided Integrating openATTIC into a backup solution is easy because it acts like a virtual tape library using the same protocol that the backup software uses to communicate with the actual tape library the back
130. nter the Domain name if available else leave it empty Insert a root password re enter password to verify 4 Partitioning Here we choose the the first option use entire disk Choose the disk where the system should be installed Partition scheme files in one partition is the standard and adequate 30 Chapter 4 Installation and Upgrade Guides openATTIC Documentation Release 1 1 0 Configure the keyboard Keymap to use Albanian Arabic Asturian Bangladesh Belarusian Bengali Belgian Bosnian k Brazilian British English Bulgarian Bulgarian phonetic layout Canadian French Canadian Multilingual Catalan Chinese Croatian Screenshot Go Back Continue open ATTIC Configure the network Networking can be configured either by entering all the information manually or by using DHCP or a variety of IPv6 specific methods to detect network settings automatically If you choose to use autoconfiguration and the installer is unable to get a working configuration from the network you will be given the opportunity to configure the network manually Auto configure networking No Screenshot Go Back Continue open ATTIC Configure the network Please enter the maximum time you would like to wait for network link detection Waiting time in seconds for link detection E IL LGGCILn OGCOOO LLegCIC Screenshot Continue 4 3 Step by step inst
131. nux ext3 rw relatime errors continue user_xattr acl barrier 1 data Ns Idevimapperivgfaithdata isotestvm Imedia isotestvum xfs rw relatime attr2 delaylog logbsize 256k sunit 512 swidt Network Portals Idevimapper vgfaithdata srvopenstack02 vmds01 Imedia srvopenstack02 vmds01 xfs rw relatime attr2 delaylog logbsize 256k sunit 5 12 swidt Shares Idevimapper vgfaithdata srvoj ppenstack02 glance01 Imedia srvopenstack02 glance01 xfs rw relatime attr2 delaylog logbsize 256k sunit 512 swildt Web FTP FTP debugfs Isyslkernelldebug debugfs rw relatime Web HTTP F rpc pipefs Ivarllib nfsirpc pipefs pc pipef rw relatime Linux NFS 11172 16 11 10 Daten Imedia daten cifs rw relatime sec ntlm unc 172 16 11 10 Daten username Windows CIFS x 172 16 13 19 media simplecdd images Isrvisimplecdd nfs4 rw relatime vers 4 rsize 1048576 wsize 1048576 namle I Embedded TFTP fusectl Isysifsifuselconnections fusectl rw relatime 4 Services none Isyslkernel config configfs rw relatime Cron Jobs nfsd Iprocifsinfsd nfsd rw relatime 4 3 System Idevidrbd3 varilib postgresql ext3 rw relatime errors continue barrier 1 data ordered Record faith master dns medialtank var lib cinder mnt 9783e11lebb7da 4f3d90fa810e026604 nfs4 rw relatime vers 4 rsize 1048576 wsize 1048576 namle Hosts tank volume 5699b3b9 7601 48bc ab5e f052a3b985e7 Imedia tank volume 5699b3b9 7e01 48bc ab5e f052a3b9 zfs rw relatime xattr amp
132. o edit in the list After editing the host click Edit Host button to confirm the changes Delete Hosts s 102 Chapter 6 User Manual openATTIC Documentation Release 1 1 0 Add Host x Host Name AddHost 4 Cancel Delete Host x 22 Do you really wantto delete host demo01 Yes Mo Select the host you want to delete in the list Hit the Delete Host button Answer the confirmation message Delete Host 2 Do you really want to delete host demo01 Yes No How to add an attribute to an host Select the host and depending on what you want to do click on the peer or initiator folder and then click the Add Attribute button Add attribute form Peer Insert an API Key in order to add a peer Initiator first select the protocol type 1SCSI or Fibre Channel then insert WWN IQN for adding an initiator see screenshots below click the Submit button This is where you can add the peer attribute in order to create a connection between openAT TIC and another host by creating an API key Remove attribute from a host when you no longer need it Select the host you want to delete an attribute from Select the folder peer initiator depending on which attribute you want to remove Mark the attribute you want to delete and click the Remove Attribute button Answer the confirmation message to remove the attribute 6 6 3 User management You can m
133. olumes StorageObject wait volume id id 600 5 Creating the NFS export for the new volume the same way we did in oacli oa nfs Export create volume volume_id filesystemvolume Dach media tank vmname options rw no subtree check no root squash address 172 10 33 13524 Of course this script hardcodes way too much in order to be usable in production system but it ll do for our first steps Copy paste the script into a file named createvolume py and be sure to replace the API url with your own Now let s see if it works root zoe python createvolume py tutorial vm02 root zoe showmount e faith Export list for faith media tank tutorial vm02 172 16 13 132 media tank tutorial_vm01 172 16 13 132 root zoe S mkdir media tutorial vm02 root zoe S mount overs 3 faith media tank tutorial vm02 media tutorial_vmO02 root zoe S df h Filesystem Size Used Avail Use Mounted on faith media tank tutorial_vmOl 737G 1 0M 737G faith media tank tutorial_vm02 737G 1 0M 737G media tutorial_vm01 1 1 media tutorial vm02 This looks promising openATTIC created a new volume named tutorial vm02 exported it via NFS and we were able to mount it successfully 7 3 Integration Tutorial 125 openATTIC Documentation Release 1 1 0 Automating the mount process Now that we re able to create and export volumes let s automate the mounting part We ll use a shell script for this bec
134. onnections only local all all peer IPv4 local connections all all all 127 0 0 1 32 md5 all 172 16 14 41 32 md5 IPv6 local connections host all all 1 1289 md5 Allow replication connections from localhost by a user with the replication privilege replication replication replication INSERT postgres peer postgres 127 0 0 1 32 md5 postgres 1 128 md5 Figure 4 5 Configuration file pg_hba conf on Alice 4 5 Installing an openATTIC cluster 53 openATTIC Documentation Release 1 1 0 Now you can restart the postgresql service WR 1 alice m Re attach 0 Fullscreen M j Stay on top al Duplicate e oN es A 0 Close root alice service postgresql restart Restarting PostgreSQL 9 1 database server main root alice Figure 4 6 Restart the postgresql service on Alice 4 5 4 Step 4 Execute oaconfig install Bob Now that you have hooked up Bob with Alice s database you can install openATTIC on Bob by executing oaconfig install 2 bob Re attach 10 Fullscreen Stay on top 8 Duplicate e A es A g Close Stopping openATTIC systemdNo usr bin python found running none killed Starting openATTIC systemd Stopping openATTIC rpcdNo usr bin python found running none killed Starting openATTIC rpcd Reloading web server config apache2 Created default user openattic with password openattic roFTPD is started in standalone mod
135. options gla2xxx qlini mod disabled etcoc modprobe d qla2xxx cont update initramfs k all u reboot oaconfig install Please check supported adapters here iSCSI iSCSI requires the IP address to be configured under which the target should be reachable to the outside world This can be done in the Network Portals panel Note The oaconfig install command creates a default network portal when scanning for the IP addresses of your openATTIC system In order to add a portal click the Add Portal button select the IP address and click on Add Portal Only those IP addresses for which portals have been configured will respond to iSCSI connections 6 3 3 Configuring Initiators If a volume is to be available via SAN protocols a LUN needs to be configured for it However openATTIC hides the complexity of configuring the relevant bits of information for different storage protocols so the same volume can easily be configured for both FC and iSCSI protocols if desired In order to do this openATTIC needs to know which 90 Chapter 6 User Manual Q Status Dashboard Command Log Service State 7 Mount Points E Sensoren Monitoring 4 8 Storage LL SnapApps Volume Pool Management y Volume Management 3 SAN LUNs openATTIC Documentation Release 1 1 0 LIO Network Portals Address 172 16 13 19 255 255 255 0 Add Portal Address Port 127 0 0 1 255 0 0 0 zLLT EETEETTEEE FEET FEET
136. ou want to add to the dashboard and click the Dashboard button You can rename the suggested graph name if you want to and click and your graph will appear on the Dashboard 6 1 Status 75 openATTIC Documentation Release 1 1 0 Nagios Services Service Description CPU Time Current Load Current Users EJ disk Space Disk stats for Disk stats for BlockTest03 S Disk stats for ceph03 Disk stats for demo2 SV Disk stats for demoiscsi Disk stats for demoTest Disk stats for fump3 Disk stats for LAURA TEST G Disk stats for laura VolTest S Disk stats for netannHTTP Graphs Graph Average Latency Average Latency riw Average Request size rlw Disk Load Disk Load Normal Disk Load Normalized d riw 10 Index 10 Index Normalized per Second Normalized per second Normalization Ratio Throughput Total lOs per second Nagios Services Service Description Plugin Output Target User 0 43 Sys 0 19 0 09 Idle 99 07 OK load average 0 14 0 14 0 14 USERS OK 5 users currently logged in DISK CRITICAL Ivarllib Disk load for sde is at 0 0296 Disk load for dm 27 is at 0 01 Disk load for dm 11is at 0 01 Disk load for dm 29 is at 0 0196 Disk load for dm 12 is at 0 01 Disk load for dm 31 is at 0 01 Disk load for dm 3 is at 0 00 Disk load for dm 33 is at 0 0296 Disk load for dm 25 is at 0 01 Disk load for dm 2
137. penATTIC has a plugin mechanism that allows SnapApps to be plugged into the system that handle the communication with applications MSSQL MSSQL databases support a snapshot mechanism based on VSS The openATTIC SnapApp leverages this mechanism in order to create a consistent snapshot of the database 3 6 Backup 13 openATTIC Documentation Release 1 1 0 VMware VMware vSphere supports snapshotting virtual machines including file system synchronization and storing RAM data The virtual machine is frozen stored to disk and then unfrozen The openATTIC SnapApp for VMware orchestrates this mechanism in order to create a consistent snapshot of virtual machines Chapter 3 Use Cases FOUR INSTALLATION AND UPGRADE GUIDES This section guides you through the necessary system preparation and the installation process of the openATTIC software Advanced installation steps like joining a Windows Domain or adapting the selection of installed modules are covered as well 4 1 Preparing the Installation Before installing openATTIC there are a couple of things you should be aware of when planning the system 4 1 1 Hardware Physical setup 1 Always dedicate two disks to a RAIDI for the system It doesn t matter if you use hardware or software RAID for this volume just that you split it off from the rest Note You can also use other devices to boot from if they fit your redundancy needs 2 When using hardware RAID
138. penATTIC system in order to be able to use it Hence we ll create an NFS export for it faith gt nfs teltninrso Exporr rtarithints Export create volume Trapp volumes ob i FlleSystemvolume id 650 addres nfs Export vidre 37 unicode_ tutorial_vm01 172 16 13 132 Again here s what the parameters mean e volume The FileSystemVolume ID of the volume we just created NFS is a NAS protocol and therefore requires a file system to exist on the volume which is why only FileSystemVolume can be specified here e address The address for the target node which is going to be allowed to access the volume e options NFS options for the share The options listed here are the defaults which usually work fine for VMs e path If we wanted to share only a subdirectory of the volume we could specify that here We don t want to so we specify the root path of the volume Mounting the volume Now that we have created and exported a volume let s see if this worked and verify the target system zoe is allowed to see it root zoe S showmount e faith Export list Tor faith media tank tutorial_vm01 172 16 13 132 There we go we re now able to mount it somewhere root zoe S mkdir media tutorial vm01 root zoe S mount overs 3 faith media tank tutorial vm01 media tutorial vm01 root zoe S df h Filesystem Size Used Avail Use Mounted on pootfrs 130G 5 2G 118G
139. ption pe de in The comment field will be shown in Windows Explorer s detail view and can contain a note to the user Note The comment is only visible in the detailed view of Windows Explorer which is not enabled by default Do not rely on the information put in this field to be actually seen by your users Finally click the Add Export button to create the new export which is instantly visible when browsing the openAT TIC host in Windows Explorer ec f GO T 13 19 master dns gt 4 I3 ISmasterdns durchsuchen P rganisieren Active Directory durchsuchen Netzwerk und Freigabecenter 7 garten Mame Typ Kommentare Desktop i blog pictures Freiqabe Pictures of aur team 6 Downloads demo Freigabe Zuletzt besucht j demo_sfs Freigabe 111 Bibliotheken E Bilder Dokumente Musik m Videos Computer T MatDladde ri 3 blog_pictures 6313 18 master dns Offline verf gbar Nicht verf gbar Freigabe Offlinestatus Online 6 4 2 NFS See also This step is part of Implementing a virtualization storage Network File System in short NFS is a protocol that allows Unix like systems to share files between one another and has been originally developed by Sun Microsystems in 1984 This protocol seamlessly integrates remote file systems providing access to the files stored within as if they resided on the local system Its strength 1s the compliance to P
140. r where any node can be used to manage the whole system and commands are distributed automatically 4 5 1 Step 1 Install two openATTIC hosts In order to use DRBD we will need a cluster of two hosts Install two openATTIC hosts as described in nstall 4 5 Installing an openATTIC cluster 51 openATTIC Documentation Release 1 1 0 Note Important You should only execute the command oaconfig install on one of the two hosts in the following example the command was executed on the host named A ice This will result in the installation of the entire openATTIC system including the database In the following example the first host is called A ice ip address 172 16 14 41 and the second Bob ip address 172 16 14 42 WR 1 alice i Re attach K Fullscreen W Stay on top al Duplicate aS A 9 Close g up snmp 5 4 3 8 2 g up sudo 1 8 det ee g up tdb tools 1 2 10 2 update alternatives using usr bin tdbbackup tdbtools to provide usr bin tdbbackup tdbbackup in auto mode Setting up xfsprogs 3 1 7 b1 Setting up libfreeipmil2 1 1 5 3 g up l b pmiconsole2 1 1 5 ng up l bipmidetect 1 1 5 ng up freeipmi tools a E Setting up nagios plugins 1 4 16 1 Setting up nagios plugins contrib 4 20120702 Processing triggers for libapache2 mod php5 Reloading web server config use Setting up pnp4nagios web 0 6 16 2 Enabling module rewrite To activate the new configuration you need to run
141. rder to deliver whatever the customer ordered A translation between the cloud system s inner workings and openATTIC s API is necessary The cloud connectors handle this translation enabling the cloud system to do its job 7 1 1 OpenStack Note We are currently working on this part of our documentation An update will be available soon 7 1 2 openQRM Note We are currently working on this part of our documentation An update will be available soon 7 2 XML RPC API The openATTIC API is the key component when it comes to automating storage management processes It is available on port 31234 and accessible using standard XML RPC This section outlines the necessary administrative prepara tions that need to be made and shows how to use the API programmatically giving code examples in Python and PHP 115 openATTIC Documentation Release 1 1 0 7 2 1 Authentication API calls need to be authenticated by using standard HTTP Basic Authentication openATTIC accepts two forms of credentials Username and password of an administrator account 2 two underscores as the username and an API key as the password Using API keys is recommended because keys provide a means of authentication that does not break when the user changes their password and that can be revoked individually without affecting other applications API keys can be managed in the API keys GUI panel 7 2 2 Quick Start Example In Python accessing the API usin
142. res and see if you can access them openATTIC Documentation Release 1 1 0 4 Chapter 1 Quick start TWO REQUIREMENTS When planning and setting up a storage system there are lots of things to be considered beforehand How much data do you need to store How much growth is to be expected What performance requirements do you have Which kind of administrative tasks will your staff be able to handle The following chapters will give you an overview of the parameters and limitations you should be aware of considering both overall system design questions as well as hardware and software requirements 2 1 Achieving Scalability and High Availability In the past several years the amount of data to handle has grown markedly with the result that your storage system will also have to grow to meet the increased demand For starters you can add new disk shelves to the existing system But one single server will hit a limit someday and you ll soon find yourself in need of better failure tolerance Scaling up a single system is therefore not a long term viable solution openATTIC supports scaling out by combining a set of machines to a cluster There are multiple options for this 2 1 1 Simple cluster Installing multiple nodes and combining them into a simple cluster will allow you to manage a multitude of storage systems as easily as a single large one The openATTIC GUI does not care whether the devices you are configuring are
143. s to say that this thing supports the creation of subvolumes The fact that this StorageObject provides all three abstractions is fortunate because it makes this demonstration a bit easier but does not have to be the case For example an LVM Volume Group will provide the volumepool information only and since the tank zpool from the above output has not been created inside an LVM logical volume its blockvolume part is empty as well Creating a volume Let s see how creating a volume in this pool works in oacli faith volumes StorageObject help create volume Usage volumes StorageObject create volume id name megs options Create a volume in this pool Options include 7 3 Integration Tutorial 121 openATTIC Documentation Release 1 1 0 filesystem The filesystem the volume is supposed to have Owner Ihe owner of the file system fswarning Warning Threshold for Nagios checks Iscobrtrcali Threshold for Nagios checks What exactly this means is up to the volume implementation Note The help command is implemented everywhere and documents all the available commands and their param eters The create_volume method expects four arguments The volume pool id volume name and size and a couple of volume dependent options For ZFS we ll need to set all of them like so 1 faith volumes StorageObject create volume 45 tutorial vm01 1000 filesystem zfs
144. se all Mount 4 Unmount ff Mirror 2 Create Snapshot Q Resize Volume je Add Volume Delete Volume Figure 6 10 Volume Management panel Depending on what you want to use a volume for you have to decide how to configure it You have to consider some points if you care about performance or high availabilty of your data for example There are some use cases annotated which should help you to make the right choice You can use openATTIC s storage for a fileserver as storage for virtualization providing cloud storage and more If you ve already decided what you want to do you may need a litte help to implement it here are some step by step instructions Supported file systems ZFS Z File System Combined file system and logical volume manager support for high storage capacities efficient data compression integration of filesystem and volume management e snapshots copy on write clones 78 Chapter 6 User Manual openATTIC Documentation Release 1 1 0 continous integrity checking automatic repair uses a software data replication model RAID Z and native NFSv4 ACLs max file size 16 EB max supported volume size 256 ZB ext3 third extended filesystem journaled file system improves reliability and eliminates the need to check the file system after unclean shut down commonly used by linux systems uses less CPU power than XFS max file size 2 TB max partition size 32 TB ext4 fourth extended fi
145. see max_locks_per_transaction superuser_reserved_ connections 3 change requires restart unix socket directory var run postgresql 3 change requires restart Zunix socket group 3 change requires restart Zunix socket permissions 0777 begin with to use octal notation bonjour off bonjour name change requires restart advertise server via Bonjour change requires restart i defaults to the computer name change requires restart Security and Authentication authentication timeout lmin 15 6005 ssl true change requires restart ssl_ciphers ALL ADH LOW EXP MD5 QSTRENGTH 3 allowed SSL ciphers change requires restart 551 renegotiation limit 512MB amount of data between renegotiations password encryption on sdb user namespace off INSERT Figure 4 4 Configuration file postgres conf on Alice 5 alice Re attach K Fullscreen DO NOT DISABLE a Stay on top Duplicate e id If you change this first entry you will need to make sure that the database superuser can access the database using some other method maintenance custom daily cronjobs replication and similar tasks Database administrative login by Unix domain socket ocal all ii TYPE DATABASE Noninteractive access to all databases 15 required during automatic 1 postgres peer USER ADDRESS METHOD local is for Unix domain socket c
146. sername and password set user as active choose permissions optional First name Last name Confirm delete x Really delete Initiator srvkvm01 master dns iscsi iqn 1993 08 0rg debian 01 effee519c0c6 Yes Mo 104 Chapter 6 User Manual openATTIC Documentation Release 1 1 0 Ipaduano tdehler dbreitung mziegler lt lt lt lt lt lt lt 06 lt g 66 openattic MA Show Volumes of User fe AddUser A Edit User Delete User E Mail address if you want to get notifications via Nagios Add User x User Name Password First Name Last Name E Mail Active Staff SuperUser Add User 4X Cancel This is where you can edit existing user s change password e Click the Edit User button e Select the user you want to edit and click the Edit User button When you re done with editing the user information click the Edit User button in the form to save the changes Delete user s Select the user you want to remove and click the Delete User button show volumes where selected user is the owner select the user and click the Show Volumes of User button to see the list of volumes the chosen user Owns 6 6 4 API keys API Keys are required in order to create a trusted connection to an openATTIC host After you ve installed a fresh openATTIC system you can find the API Key oacli access This key ensures that you can access the openattic
147. stall the openattic module btrfs package oaconfig install openattic module btrfs 2 You can now format newly created logical volumes using BTRFS 4 8 6 DRBD Supports mirroring of block devices to another host thereby enabling failure tolerance Installing 1 The DRBD module requires a working openATTIC cluster with a minimum of two nodes Please refer to Installing an openATTIC cluster for further information on how to configure a cluster 2 Once openATTIC has been installed on Bob it s time to install the openATTIC DRBD module by executing oaconfig install openattic module drbd on both hosts Now that the hosts are set up correctly we can create a volume in the openATTIC GUI to mirror it via DRBD on a different host The next step will be to create a volume in the openATTIC user interface and mirror it via DRBD Please have a look at the mirror conf section to see how that happens 4 8 7 Ceph Allows the combination of storage on a large number of hosts into a single entity Data placement and redundancy is taken care of automatically and scaling the system is simplified drastically If you need storage without limits Ceph is the way to go Note We are currently working on this part of our documentation An update will be available soon 4 8 Additional openATTIC Modules 59 openATTIC Documentation Release 1 1 0 WR 1 alice systemd is running pid 28422 Stopping openATTIC systemd Starting openAT
148. t To access the openATTIC user interface in the browser you need either the ip address or the host name of the openATTIC host just execute if config or hostname in the commandline to get the required information Please login with user openattic and password openattic openATTIC webinterface 4 2 2 Demo VM for VMware The openATTIC demo vm version 1 1 or 1 2 can be downloaded from http apt open attic org vm and integrated into the VMware Workstation 9 0 as follows 1 After opening the VMware Workstation 9 0 click on Open a virtual machine 20 Chapter 4 Installation and Upgrade Guides openATTIC Documentation Release 1 1 0 Machine Help do 253 Details J Snapshots New Settings Discard openattic 1 1 General 18 Preview BG Powered Off Settings Ctrl S Clone Ctrl O Remove Ctrl R Group Ctrl U openattic 1 1 Start Ctrl J Show Log Ctrl L Refresh Show in Explorer pty Create Shortcut on Desktop 1 disk1 vmdk Normal 10 00 GB 1 disk2 vmdk Normal 20 00 GB Sort roppyvevceur gt Audio Disabled Start the selected virtual machines Running Oracle VM VirtualBox GNU GRUB version 1 99 27 deb7u2 Debian GNU Linux mit Linux 3 2 0 4 amd64 t and keys to se t which entry is highlighted Press enter to boot the se e to edit the commands before booting or c for a command line og E STRG RECHTS Debian GNU Linux 7 latt
149. t your users to be authenticated and permissions to be enforced just like when using C FS shares In order to do that openATTIC authenticates users via the Windows domain and enforces the same permissions For technical reasons currently all volumes on the system are exported there is currently no way to create specific exports like with the other modules For this reason this module does not offer any configuration options in the interface However this may change in the future when functionality is added to this module 6 4 5 TFTP When building embedded systems the need for file transfer arises when it comes to keeping configuration files stored on a central server instead of on the devices themselves However implementing protocols like FTP on such devices may be challenging due to the severe limitations on resources For these applications Trivial File Transfer Protocol provides a remedy 98 Chapter 6 User Manual openATTIC Documentation Release 1 1 0 This protocol provides file transfer and file transfer only There is no authentication no resuming of failed downloads no parallel downloads just plain file transfer Since there is also no way of selecting which volume to connect to each IP address of the openATTIC node can only be used to export one single volume via TFTP c3 Volumeverwaltung SnapApps Windows CFS Monitoring Menu ki TFTP E 7 aan Path Address Dashboard Add
150. the Use Cases openATTIC Documentation Release 1 1 0 5 2 2 Basic setup Create a mirrored volume a Make sure the volume you create fulfills your capacity requirements b The volume pool you use should reside on smaller faster disks if you have different disk types to choose from In the volume management the volume should look like this Volume Management Name Type Size Free Used Status Path Host E drbd5 connection 1000 00 MiB Connected Idevidrbd151 srvopenatticciO 1 master dns srvopenatticci0l master dns Endpoint 999 00 MiB UpToDate Idevivgtest drbd5 srvopenatticciO 1 master dns srvopenatticciO2 master dns Endpoint 999 00 MiB UpToDate Idevivgtest2 drbd5 srvopenatticci02 master dns 2 Select the volume and click the Create Filesystem button In the window that appears choose XFS for the file system choose the initial owner of the file system and click the Create Filesystem button Volume Management Name Type Size Free Used Status Path Host m er me pour inane aes srvopenaticci lmasterdns DRBDEndpont 99900MB devivgestdrbdS srvopenaticci lmasterdns srvopenatticci02 master dns DRED Endpoint 999 00 MiB UpToDate Idev vgtest2 drbd5 02 master dns E tank Create Filesystem X sdia tank srvopenatticciO 1 master dns 3j tank2 File System xfs 2diatank2 srvopenatticci02 master dns 3 vgtest Warning Level 75 srvopenatticci0 1 mast
151. to have a development box handy that supports Python and you require an API URL How to obtain the API URL is described in XML RPC 8 5 2 Setting up Gatling The Gatling source code is maintained in a Mercurial repository at https bitbucket org openattic gatling To use it clone the repository to your development system using the following command hg clone https bitbucket org openattic gatling This will create a directory named gatling which contains the complete source code for Gatling Before you can run Gatling you will have to configure the API URL To do this create a file named after your host in the conf subdirectory of the Gatling tree e g conf srvopenatticO conf and put the following lines into it options connect API URL Then you can run Gatling using python gatling py t srvopenatticOl Note Depending on your system s general performance and the modules you have installed this can take a long time For more information please refer to the Gatling documentation 8 6 Submitting code to openATTIC So you have written some code that you would like to submit to the openATTIC team Great we love contributions We just need to ask you to follow these few steps 8 5 Integration Testing 133 openATTIC Documentation Release 1 1 0 1 Joining our IRC channel helps us to get to know you and your project This way we can guide you through your development and preparation phase Please add un
152. ud Connectors 7 2 XML RPCAPI 7 3 Integration Tutorial Developer documentation 8 1 Setting up a development system 8 2 BICADM 2329 933 24 8 3 openATTIC Core 8 4 System API 8 5 Integration Testing 8 6 Submitting code to openATTIC 9 Indices and tables openATTIC Documentation Release 1 1 0 The times when storage was considered a server based resource and every system needed to have its own hard drives are long gone In modern data centers central storage systems have become ubiquitous for obvious reasons Centrally managed storage increases flexibility and reduces the cost for unused storage reserves With the introduction of a cluster or virtualization solution shared storage becomes a necessity This mission critical part of IT used to be dominated by proprietary offerings Even though mature open source projects may now meet practically every requirement of a modern storage system managing and using these tools is often quite complex and is mostly done decentrally openATTIC is a full fledged central storage management system Hardware resources can be managed logical storage areas can be shared and distributed and data can be stored more efficiently and less expensively than ever before and you can control everything from a central management interface It is no longer necessary to be intimately familiar with the inner workings of the individual storage tools Any task can be carri
153. up software doesn t even notice the difference while you get to enjoy all the benefits 3 6 1 SEP sesam Once you have lots of tapes and machines you re backing up data from you re going to require a flexible management solution with a searchable index in order to keep the amount of data manageable SEP sesam is an enterprise ready backup solution that supports backing up and restoring operating systems hypervisors applications databases and data 3 6 2 Target Offloading Apart from easy recovery snapshots can also be used to take the load of the backup process off of the target system To achieve that a snapshot is taken from the live system and made available on a standby system which is then targeted by the backup software That way you don t need to freeze the live system during the backup period and there s no additional load the live system has to take It can just continue serving your customers uninhibited 3 6 3 Consistent Application Backups In order to create useful snapshots it is important to take into account the fact that data is stored in different places at any point in time Virtual Machines and databases have a significant amount of state data in RAM and without synchronizing this data to disk before creating the snapshot the snapshot will not be consistent and therefore useless If you want the snapshot to be consistent the application will need to be informed so it can synchronize its data prior to the snapshot o
154. versucht sie wiederherzustellen Erkannte Ziele Mame Status ign 2003 01 arg linux iscsi 13 19 x86864 debpkgtest Inaktive Ger te ign 2003 01 arg linux iscsi 13 19 x8664 iscsidemaz verbunden Statusbericht Anmeldung war erfolgreich The initiator will show you a list of discovered targets most of which will be labeled inactive Select the target you would like to connect to and click Connect The initiator will connect to the target and make its disks available to the system However in order to actually use it you will have to create a file system on the disk To do this open the system s Disk Management dialog which you will find in the computer management utility It will show you a new unused disk Right click the disk and create a volume on it in order to make it available under some drive letter in the My Computer utility Linux On Linux open iscsi can be used to connect to iSCSI volumes To do so perform an iSCSI discovery and a login as follows substituting 172 16 13 19 with the address of your openATTIC host ISOSIQON m discovery C St P 172 16 13 12 iscsiadm m node 1 The 1sscsi utility will now display a disk by the vendor LIO ORG which is your iSCSI connection 94 Chapter 6 User Manual openATTIC Documentation Release 1 1 0 SCS dev srO0 ls 1 0 0 cd dvd QEMU QEMU DVD ROM 7 2 0 1 0 dev sda C 0 0 1 disk LIO ORG IBLOCK A He You can now format th
155. vg_oall alice master dns a hh logical volume 500 MB devivg_oal hh alice master dns logic al volume 500 MB Idevivg_oaltest alice master dns a2 2478 LI 512 bob master dns By backup logical volume 500 MB Idevivg oa2ibackup bob master dns By demo oge al volume 100 MB Idevivg oa2idemo amp 2 2 B a H Gb Expandal 8 Collapse all Mount MA Unmount f Miror Create Snapshot 4 Resize Volume je Add Volume Delete Volume 6 2 3 SnapApps The openATTIC snapcore allows you to create snapshots of devices according to a schedule It is part of the ope nATTIC community version and is also the base for openATTIC SnapApps which are provided in the openATTIC enterprise edition The snapcore comes with a configuration wizard which helps you to configure scheduled snapshots step by step You can backup sensitive applications like databases or virtual machines as part of your nightly datacenter backup but to do so it sometimes requires some processes to be stopped and write access is not possible at that time So a better solution is to use snapshots for applications You can create snapshots from running systems and it only takes a few seconds or even milli seconds When a snapshot of an application is created the system will be brought into a consistent state by freezing it and not allowing write access to make sure that the snapshot is not broken After the snapshot of the application itself software layer was taken a snapshot of
156. which is included in every standard installation of any Ubuntu Debian version When a user creates a volume the device will be mounted automatically in openATTIC This is necessary in order to access the created volume and stored data on it most common mount points are dev mnt media To store data on a volume it needs to be formatted with a filesystem which will be done when the user selected a filesystem in the create volume process When you left the filesystem field empty in order to map it to another host i e via iSCSI to a windows host you need to format the volume manually In order to use the device store data or open files from it default options like rw which means read write will be passed as parameter when mounting a volume device You can also find those parameters in the mount points panel under Options As mentioned before there will be some default parameters passed when mounting a device this depends on which filesystem the device will be formatted with and or if the device is part of a raid 6 1 Status 73 openATTIC Documentation Release 1 1 0 Here is an example of options of a device with filesystem ext4 rw mount the device read write relatime modified atime reduces the fsync accesstime user_xattr extended user attributes in some cases needed for extended file options Enforces proper on disk ordering of Journal commits from man page mount 1 enabled makes volatile disk write
157. wo openATTIC hosts 4 5 2 Step 2 Database configuration on Bob Since Alice needs to share her database with Bob you will have to enter the database information database name user password and host from Alice into the database configuration file etc openattic database ini manually It should look something like this 4 5 3 Step 3 Database configuration on Alice Now its time to edit the etc postgresql VERSION main postgresql conf and etc postgresql lt VERSION gt main pg_hba conf configuration files on Alice Set the correct listen addresses within the postgres conf file Use Bob s ip address as in the example Add Alice s ip address to the pg_hba conf file within the IPv4 local connections section as follows 52 Chapter 4 Installation and Upgrade Guides openATTIC Documentation Release 1 1 0 django db backends postgresql_psycopg2 openatticpgsql openatticpgsql password 172 16 14 41 INSERT 3 alice Figure 4 3 Database configuration on Bob CONNECTIONS AND AUTHENTICATI Connection Settings J l sten_addresses localhost 172 16 14 42 what IP address es to listen on port 5432 max_connect ons comma separated l st of addresses t defaults to localhost all change requires restart change requires restart 100 change requires restart Note Increasing max connections costs 400 bytes of shared memory per connection slot plus lock space
158. y networks were invented And it makes sense too Having files available on the network strengthens both collaboration and independence because you can access your files from anywhere without having to ask anyone for a copy When using openATTIC for this kind of central storage it has to fulfill a set of requirements 1 Access to files needs to be authenticated in a secure manner 2 Users need to be able to manage file permissions themselves in a well defined manner 3 User management needs to be synchronized with the rest of the infrastructure 4 Single sign on should work so people don t need to enter their passwords all the time These basic requirements can easily be met using the CIFS protocol in a Windows domain The CIFS protocol has been specifically designed for this use case and provides strong authentication and authorization mechanisms Integrating openATTIC in a Windows domain is easy and the domain then provides centralized user management combined with Single Sign On Setting up a Windows domain used to require a Windows Server license and was therefore only worthwhile for busi nesses But since the release of Samba 4 all you need is a Linux box and you can get a Windows domain running within minutes Of course openATTIC can be set up in multiple ways that not only provide the necessities but allow for some extra features to be added on top See also Implementing a file server 3 1 1 Quick and dirty The simplest
159. y scan for RAID devices and update their status in the GUI 4 8 4 ZFS Next generation file system that handles volume creation snapshots disk management failure tolerance and caching Its use is recommended for running large file servers on slow disks Installing 1 The openATTIC ZFS module requires zfsonlinux to be available so please make sure you include the necessary sources for your distribution in your etc apt sources list file 2 Install the openattic module zfs package 58 Chapter 4 Installation and Upgrade Guides openATTIC Documentation Release 1 1 0 oaconfig install openattic module zfs 3 If you have LVM installed you can now format newly created logical volumes using ZFS to create ZPools 4 You can also create ZPools on the command line and run oaconfig install without any packages make them available to openATTIC 4 8 5 BTRFS While ZFS was originally developed on Solaris and is now being ported over to Linux BTRFS which aims to provide the same functionality was designed specifically for linux This results in advanced features like full Windows ACL support and better support for different kernel versions If you want to use openATTIC as a FibreChannel target using ZFS on the same node is going to be more challenging than using BTRFS However BTRES is still in development and is considered experimental Installing Currently the BTRFS module works best in combination with the LVM module 1 In
160. ynchronous Configure Syncer Rate Click Choose button and close the window 82 Chapter 6 User Manual openATTIC Documentation Release 1 1 0 ize Ised E backup connection 500 MB Connecter alice master dns DRBD Endpoint 499 MB UpToDate dn 100 MB Connecter idi 99 MB UpToDate 99 MB 20 48 GB 500 MB backup jettings A Asynchronous B Memory Synchronous Semi Synchronous C Synchronous Syncer Rate 300M e Mirror completion Now you can see the volume in the list with the DRBD endpoints in this example the primary host marked in the gui as P alice secondary host marked in the gui as S is bob and their 66 29 state UpToDate Volume Management Name Type Size Used Status Warnin Critical Level Path Host Owner 3 backup connection alice master dn P alice master dns DRBD Endpoint 499 MB UpToDate alice master dn bob master dns DRED Endpoint 499 MB UpToDate bob master dns demo MB alice master dns P alice master dns DRBD Endpoint 99 MB UpToDate alice master dns bob master dns DRBD Endpoint 99 MB UpToDate bob master dns a es 500 MB Connected alice master dns alice master dns DRED Endpoint 499 MB UpToDate alt alice master dns BRB Endpoint 499 MB 2 bob master dns a vooal volume group 204868 LiT alice master dns yy backup logical volume 500 MB Idevivg_oal backup alice master dns demo Idevi
161. your way of working Software Updates Check for software updates for VMware Workstation Help o View the help topics for VMware Workstation Chapter 4 Installation and Upgrade Guides openATTIC Documentation Release 1 1 0 2 Type of configuration Choose the option custom advanced New Virtual Machine Wizard Welcome to the New Virtual Machine Wizard What type of configuration do you want Typical recommended Create a Workstation 9 0 virtual machine in a few easy steps VMware Custom advanced Works tat TU n 9 Create a virtual machine with advanced options such as a SCSI controller type virtual disk type and compatibility with older VMware products Help Back Next I Cancel 3 Configuration of hardware compatibility 4 New Virtual Machine Wizard Choose the Virtual Machine Hardware Compatibility Which hardware features are needed for this virtual machine Virtual machine hardware compatibility Hardware Workstation 9 0 5 iv Compatible v ESX Server Compatible products Limitations Fusion 5 0 64 GB memory limit Workstation 9 0 8 processor limit 10 network adapter limit 2 TB disk size limit Guest operating system installation Choose the option I will install the operating system later Choose Linux as operating system and version Debian 6 64 bit 6 If necessary the virtual machine name and the lo
162. ystemd helpers Transaction context guard in conjunction with Python s with statement 1n order to make use of this functionality When running inside a transaction certain systemd calls that are marked as deferrable will be deferred until the end of the transaction block If the transaction block runs into an exception all the queued commands will be discarded and no action will be taken at all Otherwise the queued commands will be executed in sequence If one command in the sequence fails the following commands will be discarded as well Mocking DBus interfaces for Unit tests If you adhere to the pattern of using systemd helpers get dbus object for all access to the System API mocking it can be easily done using the mock python library See the ZFS unit tests for elaborate examples of how to do so 8 4 3 Extending the System API To extend the API add a module named systemapi to your Django application which contains classes derived from the systemd plugins BasePlugin class All classes that inherit from BasePlugin will be exposed automatically Paths DBus is an object oriented RPC mechanism In order to identify different objects each object is associated with a path This association is defined by setting the dbus_path class variable when defining a plugin class SystemD BasePlugin dbus path volumes Implementing Plugins DBus uses function signature strings to describe the number and type of arguments required by di

openATTIC Documentation Release 1.1.0 it

Contents

Download Pdf Manuals

Related Search

Related Contents