Dell PowerEdge R510 Reference Configuration
Contents
1. SQ Dabare End and combina Local DE Update Customers Connector Map 4 gt a Salesforce Does Custdrmer Exist E Boom SV Solestores Connection Set Gel 154 Acepuntr Q Dalabaje End and continue SFOC Customer to OB Inggri eel DB Properties hacer Cuime Record a e Branch Hesziage Message Mil End and corra Boom Programi Send Ermal Command hr q Process Call Data Process Page 13 Dell R510 Reference Configuration for Microsoft SQL Server 2008 R2 Fast Track Data Warehouse Standard Boomi integration components include Connector connect to any application or data source Always the first and last steps of an integration workflow the Connector enables access to another application or data source The connector sends receives data and converts it into a normalized XML format A Connector s primary role is to operationalize an API by abstracting the technical details of an API and providing a wizard based approach to configuring access to the associated application Connectors are also configurable to capture only new or changed data based on the last successful run date of an integration process 2 Data Transformation transform data from one format to another While core to any integration the data stored in various applications is rarely if ever semantically consistent For example a customer record represented in one application will have different fields and f2. The Dell PERC H700 is an enterprise level SAS 2 0 RAID controller that provides disk management capabilities high available and security features in addition to improved performance of up to 6GB s throughput Figure 2 shows the management console accessible through the BIOS utility Page 5 Dell R510 Reference Configuration for Microsoft SQL Server 2008 R2 Fast Track Data Warehouse Figure 2 Virtual Disk Settings PERC H700 Integrated BIOS Configuration Utility 2 02 0025 PD Mgmt Ctrl Mgmt Virtual Disk Management Virtual Disk 0 irtual Disk 0 136 12 GB Disk Group Fi Help F Operations F5 Refresh Ctrl N Next Page Ctrl P Prev Page Fi2z Ctlr Stripe element size By default the PERC H700 creates virtual disks with a segment size of 64KB During the Fast Track validation testing we utilized stripe element sizes of 64KB and 1MB to compare and contrast any performance improvements For most workloads 64KB default size will provide an adequate stripe element size We recommend testing various sizes depending on the workload characteristics of your configuration Read policy The default setting for read policy on the PERC H700 is adaptive read ahead During testing however we observed that changing the setting to No read ahead improved the overall performance by 4 we attribute the improvement to unnecessary read ahead during large sequential I O requests Adaptive read ahead typically improves performance in s
3. The following sections explain the tuning of selected hardware and software Hardware Component Architecture Redundant and robust tests have been conducted on DELL s PowerEdge servers to determine best practices and guidelines for building a balanced FTDW system Figure 1 Proposed Dell Fast Track Reference Architecture r te r A LU E L D hes a p tan i w ho pr y i a cra r gt 4 i x ay E gt ou Ue ens om 4 A a PowerEdge F510 1 Intel Xeon X5675 3 07Ghz Six Core CPU Windows2008 R2 SP1 SQL Server 2008 R2 Configuration availability may be further enhanced by configuring database clustering using multiple servers Table 1 Tested Dell Fast Track Reference Architecture Component Details PowerEdge R510 BIOS 1 6 3 CPU 1 Intel Xeon CPU X5675 3 07GHz HT Enabled pen Microsoft SQL Server 2008 R2 Enterprise Edition Page 4 Dell R510 Reference Configuration for Microsoft SQL Server 2008 R2 Fast Track Data Warehouse Table 2 Dell Fast Track Reference Architecture Solution Details Dell Fast Track 3 0 Configuration PowerEdge R510 7068273 Dell Fast Track 3 0 Configuration PowerEdge R510 7068280 with Dell Boomi Dell PowerEdge R510 Server The Dell PowerEdge R510 server is a 2 socket 2U high capacity multi purpose rack server offering an excellent balance of internal storage redundancy and value in a compact
4. Windows Server 2008 R2 SP1 SQL Server 2008 R2 Enterprise Single Socket Intel six core Aggregate Synthetic I O rate 3873 MB s Intel X5675 6 core CPU INTERNAL STORAGE RAID 1 Single RAID 1 Disk Group Synthetic I O rate 1005 MB s RAID 1 RAID 1 RAID 1 H700 PERC Controller Synthetic I O rate 3707 MB s The second synthetic IO test with SQLIO was performed with a large file to ensure reads are serviced from the storage system hard drives instead of from cache This shows the maximum real rate that the system is able to provide with sequential reads Page 10 Dell R510 Reference Configuration for Microsoft SQL Server 2008 R2 Fast Track Data Warehouse Figure 7 SQLIO Real Rate Test from Disk Large File POWER EDGE R510 SQL Server 2008 R2 Windows Server 2008 R2 SP1 SQL Server 2008 R2 Enterprise Single Socket Intel six core Aggregate maximum I O rate 1533 MB s Intel X5675 6 core CPU INTERNAL STORAGE RAID 1 Single RAID 1 Disk Group Maximum I O rate 386 MB s RAID 1 H700 PERC Controller o RAID 1 Maximum I O rate 1534 MB s RAID1 RAID 1 Fast Track Workload Evaluation The performance of a Fast Track database configuration is measured using two core metrics Maximum CPU Consumption Rate MCR and Benchmark Consumption Rate BCR Calculating MCR MCR indicates the per core I O throughput in MB or GB per second This is measured by executing a pre defined query against the data in the buffer
5. any integration requirement SaaS to On premise On premise applications are typically kept behind a firewall with no direct access via the Internet and no access even via a DMZ To handle this requirement the Boomi Atom can be deployed on premise to directly connect the on premise applications with one or more SaaS Cloud applications No changes to the firewall are required and the Atom supports a full bi directional movement of data between the applications being integrated In this deployment style your data does not enter Boomi s data center at any point SaaS to SaaS When all the applications being integrated can be accessed via a secure Internet connection the Boomi Atom can run in Boomi s cloud for a zero footprint deployment Boomi manages the uptime of the Atom in this configuration Your data is completely isolated from any other tenants in Boomis platform Cloud to SaaS Cloud If you are hosting your own applications either as an ISV or for internal use you can deploy the Boomi Atom into any cloud infrastructure that supports Java such as Amazon Rackspace OpSource etc This offers direct connectivity between your application and the applications you wish to connect In this deployment style your data does not enter Boomi s data center Managing Changes to Integration Processes Because applications are inherently dynamic in nature so are the integrations that connect them AtomSphere provides significant capabilities f
6. chassis The PowerEdge R510 server was developed with a purposeful design energy optimized options the performance of the Intel Xeon processor 5500 and 5600 series DDR3 memory and enterprise class manageability For more technical specifications of R510 Server please refer to the Power Edge R510 Technical Guide a link to which is provided in the References section of this document Processors The Microsoft Fast Track 3 0 reference guide describes how to achieve a balance between components such as storage memory and processors In order to balance the available internal storage and memory for the Dell PowerEdge R510 a single Intel Xeon X5675 Six core processor operating at 3 07GHz speed was used Note For environments that require high processing capabilities a second socket can be populated Memory For FTDW architecture Microsoft recommends using 8GB of memory per processor core With enough memory installed on the system the large scale queries involving Hash joins and sorting operations will benefit from SQL Server offloading operations from the Tempdb to Memory Selection of Memory DIMMS will also play a critical role in the performance of the entire stack In our test configuration we have configured the database server with 48GB of RAM running at 1066 MHz speed Refer to the Microsoft Fast track 3 0 Reference Guide for detailed recommendations on system memory configuration Internal Storage Controller PERC H700 Settings
7. users can subscribe to Alerts that broadcast via RSS any failed integration process or any unresponsive Atom For a simple view of all integration activity in an account users can also subscribe to a monitor feed and embed this into any another application that supports RSS Alerts provide the process name the Atom the status success or failure and the date time of the execution By using this alert users can quickly pinpoint the execution history for detailed diagnostic activity Atom Alerts will also send notifications when an Atom goes offline or comes back online specifying the Atom name the status and the date time of the status change Page 19 Dell R510 Reference Configuration for Microsoft SQL Server 2008 R2 Fast Track Data Warehouse Conclusion The Dell Microsoft Fast Track Data Warehouse architecture provides a uniquely well balanced data warehouse implementation solution By following the best practices at all the layers of the stack a balanced data warehouse environment can be achieved with a greater performance benefit than the traditional data warehouse systems The Dell Microsoft Fast Track Architecture provides the following benefits to customers Tested and validated configuration with proven methodology and performance behavior A balanced and optimized system at all levels of the stack by following the best practices of hardware and software components Avoidance of over provisioning of hardware resources Hi
8. Dell SMB Reference Configuration for Microsoft SQL Server 2008 R2 Fast Track Data Warehouse with the Dell BOOMi Integration Capability A Dell Technical White Paper Dell Database Solutions Engineering Dell Product Group August 2011 Dell R510 Reference Configuration for Microsoft SQL Server 2008 R2 Fast Track Data Warehouse THIS WHITE PAPER IS FOR INFORMATIONAL PURPOSES ONLY AND MAY CONTAIN TYPOGRAPHICAL ERRORS AND TECHNICAL INACCURACIES THE CONTENT IS PROVIDED AS IS WITHOUT EXPRESS OR IMPLIED WARRANTIES OF ANY KIND 2011 Dell Inc All rights reserved Reproduction of this material in any manner whatsoever without the express written permission of Dell Inc is strictly forbidden For more information contact Dell Dell the DELL logo the DELL badge and PowerEdge are trademarks of Dell Inc Microsoft Windows and SQL Server are either trademarks or registered trademarks of Microsoft Corporation in the United States and or other countries Intel and Xeon are either trademarks or registered trademarks of Intel Corporation in the United States and or other countries Other trademarks and trade names may be used in this document to refer to either the entities claiming the marks and names or their products Dell Inc disclaims any proprietary interest in trademarks and trade names other than its own October 2011 Page ii Dell R510 Reference Configuration for Microsoft SQL Server 2008 R2 Fast Track Data Warehouse Conte
9. Track Data Warehouse have the option of specifying whether they wish to attempt to auto repair bad data or simply reject rows that are dirty All validation results are routed through a clean or rejected path which allows users to explicitly handle either scenario Message user defined dynamic notifications For any step of the integration workflow Message components can be used to create dynamic notifications that make use of content from the actual data being integrated This allows the creation of messages like Invoice 1234 was successfully processed for customer ABC Inc Connectors are then used to deliver the message to the appropriate end point a Route dynamic content based routing Route components examine any of the content in the actual data being processed or use numerous other properties available to the user such as directory file name etc and route the extracted data down specific paths of execution Split intelligent data splitting and aggregation Split components re organize data into logical representations such as business transactions For example you can take incoming invoice headers and details and create logical invoice documents to ensure the applications being integrated process or reject the entire invoice vs discrete pieces Testing Integrations real time To further simplify and shorten the integration development cycle users can test their integrations directly in the bu
10. anage Your Integration Processes Regardless of where Boomi Atoms are deployed or how many processes are deployed the Atom s unique architecture enables the centralized management of ALL integrations from the Boomi AtomSphere platform The Manage functionality of the Boomi platform enables users to monitor the health and activity of all Atoms review detailed logs of what processes ran and when how long they took to run the result how many objects were processed etc Figure 10 Dell Boomi Process Execution View lt gt Boomr ATOMSPHERE Manage Atom Explorer Executions Select All None Running Refresh Status All l Date Range Past Hour A Z Salesforce Demo ba Process Details MM Salesforce Demo 2 Y M Salesforce Demo 3 gt MW Salesforce Demo 4 Z Salesforce_Peachtree Atom B Inbound Data Outbound Data Status All p Show Data for Connector Accounts amp Address Select Select All None Errors 2 Re run selected documents Size kB 0 91 Action 190 Dl fi Reviewing Overall Integration Performance The Process Execution view allows users to filter by date every integration process that ran in their account Users can track individual integrations by status which Atom ran the integration how much data was processed and how long the integration took to run On demand users can click thru to a detailed log of the execution and the Atom will tempor
11. arily serve this log up to the browser session Reviewing Individual Process Executions For each execution of an individual integration process users can view the details of that execution including each individual data set that was processed both inbound and outbound After viewing the execution details there are several options Page 18 Dell R510 Reference Configuration for Microsoft SQL Server 2008 R2 Fast Track Data Warehouse View the actual data that was sent or received with an external application dependent on security permissions This data will be retrieved dynamically because data sets are never stored in Boomis data center Retry the data which will request the Atom to retry the data sets you have selected and pass them to a new process execution View the link between inbound and outbound data sets When processing large amounts of data users can click on an individual data set to view the resulting data that was created from it Exploring Atoms Regardless of where Atoms are deployed the Atom Explorer is the central location to view the status of the Atoms see where they are running and set rules on how much history the Atom should retain An Atom will appear offline when it has not communicated with the platform within a 5 minute window You can use the Atom Explorer to access and manually execute the integration process in a specific Atom Subscribing to Process Alerts For proactive notification of failures
12. cache and measuring the time taken to execute the query against the amount of data processed in MB or GB MCR value provides a baseline peak rate for performance comparison and design purposes For the validated configuration with one Intel X5675 six core processors the system aggregate MCR was 1722 MB s The realized MCR value per core was 287 MB s Page 11 Dell R510 Reference Configuration for Microsoft SQL Server 2008 R2 Fast Track Data Warehouse Calculating BCR BCR is calculated in terms of total read bandwidth from the storage hard drives and not from the buffered cache as in the MCR calculation This is measured by running a set of standard queries specific to the data warehouse workload The queries range from 1 0 intensive to CPU and memory intensive and provide a reference to compare various configurations For the validated Fast Track configuration the aggregate BCR was 1021 MB s During the evaluation cycle the system configuration was analyzed for multiple query variants simple average and complex with multiple sessions and different degrees of parallelism MAXDOP options to arrive at the optimal configuration The evaluation results at each step were validated and verified jointly by Dell and Microsoft A summary of the Fast Track results are offered in the Appendix Populating Your Data Warehouse Integrating multiple data sources efficiently easily and accurately is essential to any enterprise data warehouse Dell
13. e Appendix Summary of Microsoft SQL Server Fast Track results The performance of the system configuration was analyzed with RAID1 for simple average amp complex query variants with 5 10 20 40 sessions Various maximum degrees of parallelism MAXDOP options were tested to arrive at the optimal configuration for this workload with MAXDOP 6 Following table shows the results for simple work load with MAXDOP 6 4 disk groups RAID 1 Physical I O throughput Logical I O throughput total MB s MB s The results in the following table are for medium work load with MAXDOP 6 4 disk groups RAID 1 poe reat total MB s MB s 5Session 704 1009 ossa TO Cossin A A The following results show the benchmarked rates from memory physical disks and peak for the validated solution These results can be used to compare solutions and choose an appropriate configuration that meets the throughput requirements Benchmark Scan Rate Benchmark Scan Rate FTDW Rated I O FTDW Peak I O Logical MB s Physical MB s MB s MB s Page 22
14. ers solution architects database administrators Storage administrators and business intelligence users who are evaluating planning and deploying an optimally balanced data warehouse solution The scope of this whitepaper is limited to the data warehouse Analytics tools and reporting services that use the data warehouse are outside the scope of this whitepaper Microsoft SQL Server Fast Track Data Warehouse In order to overcome the limitations of traditional data warehouse systems Microsoft has come up with a cost effective solution that optimally balances the hardware and software capabilities of the system It provides an easy to deploy data warehouse infrastructure by mainly focusing on storage tuning and database layout Fast Track Data Warehouse FTDW its implementing data warehouse solutions differently As most data warehousing queries scan large volumes of data FTDW designs are optimized for sequential scans reads These proven methodologies yield performance much better than that of traditional data warehousing systems Based on this fact DELL has made a deep study on the FTDW architecture and come up with a reference guide that helps customers implement FTDW on DELL hardware Page 3 Dell R510 Reference Configuration for Microsoft SQL Server 2008 R2 Fast Track Data Warehouse Dell Fast Track Data Warehouse Reference Architecture In order to optimize data warehouse stack component performance we must properly tune each layer
15. gh availability at all the levels of setup host Switches and storage Help to avoid the pitfalls of improperly designed and configured system Reduced future support costs by limiting solution re architect efforts because of scalability challenges Dell BOOMi integrated on demand data and application integration service to maximize data source flexibility while minimizing cost Page 20 Dell R510 Reference Configuration for Microsoft SQL Server 2008 R2 Fast Track Data Warehouse References Dell SQL Server Solutions www dell com sql Dell Services www dell com services Dell Support www dell com support OLTP and OLAP http datawarehouse4u info OLTP vs OLAP html Microsoft Fast Track Data Warehouse and Configuration Guide Information www microsoft com fasttrack http download microsoft com download B E 1 BE1AABB3 6ED8 4C3C AF91 448AB733B1AF Fast_Track_Configuration_Guide docx An Introduction to Fast Track Data Warehouse Architectures http msdn microsoft com en us library dd459146 aspx How to Enable the Lock Pages in Memory Option http go microsoft com fwlink Linkld 141863 SQL Server Performance Tuning amp Trace Flags http support microsoft com kb 920093 Power Edge R510 Technical Guide http www support dell com support edocs systems per510 en index htm Dell Boomi http www boomi com Page 21 Dell R510 Reference Configuration for Microsoft SQL Server 2008 R2 Fast Track Data Warehous
16. he primary user data and two disks to hold the database log files For Fast Track architectures we recommend that you use mount point rather than drive letters for Storage access It is also very important to assign the appropriate virtual disk and mount point names to the configuration in order to simplify troubleshooting and performance analysis Mount point names should be assigned in such a way that the logical file system reflects the underlying physical storage enclosure mapping Table 2 shows the virtual disk and mount point names used for the specific reference configuration and the appropriate storage layer mapping All the logical volumes were mounted to the C FT folder Table 3 Mount Point Naming and the Storage Enclosure Mapping Virtual Virtual Disk Logical Label Label Full Volume Path Page 8 Dell R510 Reference Configuration for Microsoft SQL Server 2008 R2 Fast Track Data Warehouse s 5 oers log C RowSETIog Figure 5 represents the storage system configuration for the proposed Fast Track reference Figure 5 Storage System Components SQL SERVER INTERNAL STORAGE POT EEES Temp DB Data file 1 Data file 1 Virtual disc group 1 RAID 1 Data file 2 Data file 2 Virtual disc group 2 RAID 1 Data file 3 Data file 3 Virtual disc group 3 RAID 1 Data file 4 Data file 4 Virtual disc group 4 RAID 1 The production staging and system temp databases were deployed per the recommendations provided in the M
17. helps make this possible with the Dell Boomi Integration Cloud As the recipient of the CODiE award for best cloud integration platform for the past three years Dell Boomi is widely recognized as the industry s leading application and data integration provider By building our data and application integration platform in the cloud we ve created a fundamentally different approach Dell Boomi helps to reduce TCO as compared to traditional integration tools or custom coding Because Dell Boomi is delivered in the cloud there is never any software to maintain and minimal IT resources are required for ongoing management In addition our library of pre built connectors eliminates the need to build and maintain custom code Dell Boomi also strengthens data security because data never passes through the Boomi platform data is only processed through the Atom runtime engine located in the cloud or in the customer s own infrastructure so the customer can select where the data flows Dell Boomi s intuitive visual design interface makes it easy to begin creating integration processes immediately Using familiar point and click drag and drop techniques users can build very simple to very sophisticated integrations with exceptional speed As the Dell Boomi community expands so does the number of connectors and process maps and many are already built and ready for use easing the job of connecting new applications Training costs are low due to the platfo
18. icrosoft Fast Track Data Warehouse 3 0 Reference Guide Performance Benchmarking Microsoft Fast Track guidelines help to achieve optimized database architecture with balanced CPU and storage bandwidth The following sections describe the performance characterization activities carried out for the validated Dell Microsoft Fast Track reference architecture Baseline Hardware Characterization using Synthetic 1 0 You must thoroughly analyze the storage hardware to make sure that the storage backend is capable of delivering the maximum possible throughput This will ensure that the performance of the system is not bottlenecked in any of the intermediate layers The disk characterization tool SQLIO was used to validate the configuration Please refer to the Fast Track Reference Guide link provided in the reference section for detailed guidelines Figure 6 shows the baseline performance numbers achieved for the validated reference architecture The results show the maximum baseline that the system can achieve from a cache called Line Rate A small file is placed on the storage and large sequential reads are issued against it with SQLIO This test verifies the maximum bandwidth available in the system to ensure no bottlenecks are within the data path Page 9 Dell R510 Reference Configuration for Microsoft SQL Server 2008 R2 Fast Track Data Warehouse Figure 6 SQLIO Line Rate Test from Cache Small File POWER EDGE R510 SQL Server 2008 R2
19. ild environment Integration testing includes watching as the data moves through the integration process viewing the actual data monitoring exactly where the integration fails and click thru on the failed step to examine error messages Page 15 Dell R510 Reference Configuration for Microsoft SQL Server 2008 R2 Fast Track Data Warehouse Figure 9 Dell Boomi Build Environment Real Time Integration Testing rc Gap BOOMrATOMSPHERE Process Sync Salesforce Accounts to Database b Save a Properties C7 Scheduling Version history 9 Helo EJ Close Test Configuration Pierre pote pour process wil be Farad whan POL a iasi Test wing Abam DE Customer to D Update End and continue Salesforce Demo atatia Local GB Update Customers Test Data Show Process Log aa Salesforce Doss Cust i Boomi 154 Salesforce Connection Gel ISV Accounts e 9 Database End and continue Local GB SEDE Customer to OB Insert Insert Customer Record Message Mail End and contenue Boom Send Email Configuring Integration Automation Integration processes can be configured for hands off execution AtomSphere provides both real time as well as batch style automation options depending on the requirements of the integration as defined below e Event based Invocation Direct Atom Invocation Included in every Boomi Atom is a lightweight HTTP Server Data can be HTTP posted to a specific Atom and
20. mall random workloads Page 6 Dell R510 Reference Configuration for Microsoft SQL Server 2008 R2 Fast Track Data Warehouse Figure 3 Internal Storage Controller Settings PERC H700 Integrated BIOS Configuration Utility 24 02 0025 its PD Mgmt Ctrl Mgmt Virtual Disk 4 DATA 1 558 37 GE Basic Settings RAID Level R ID 1 UD Size 556 37 GB Operation UD Name 3 RAID State Optimal Progress Physical Disks NA Disk ID Size strip Element Size 64KB Time Left No Operation N A Read Policy ILMO an Write Policy Fi Help Fi2 Ctlr RAID configuration One of the most critical decisions that we have to make when deploying a new storage solution is which RAID type s to use as that choice heavily impacts the performance of the application We have configured the proposed Fast Track configuration using RAID 1 disk groups for database data files and database log files Four RAID 1 data disk groups and one RAID 1 log disk group were created Figure 3 shows the proposed RAID configuration Figure 4 RAID Configuration Logs Hot Spares Application Configuration The sections below explain the settings applied for the operating system and database layers Windows Server 2008 R2 SP1 Default settings were used for the Windows 2008 R2 SP1 operating system Page Dell R510 Reference Configuration for Microsoft SQL Server 2008 R2 Fast Track Data Warehouse SQL Server Configuration These startup options we
21. ness intelligence reporting and various types of predictive analysis With today s never ending data growth and complexity it s becoming a tedious job for customers to balance capacity and performance within the data warehouse system Growing data volumes and loading challenges OLAP query complexity and number of users are causing response times to increase IT executives are looking for solutions that offer lower cost easier management and better performance There are many challenges in designing a database configuration for OLAP workloads One is ensuring an optimal balance of I O storage memory and processing power Dell and Microsoft jointly developed guidelines and design principles to assist customers in designing and implementing a balanced configuration specifically for Microsoft SQL Server data warehouse workloads to achieve out of box scalable performance Another challenge is data integration and cleansing especially where data is coming from multiple sources Based on direct input from customers Dell has incorporated Dell Boomi an efficient cloud based on demand application and data integration service as part of the balanced infrastructure This whitepaper describes the architecture design principles needed to achieve a balanced configuration for the Dell PowerEdge R510 server using the Microsoft Fast Track Data Warehouse 3 0 guidelines Audience and Scope This whitepaper is intended for customers partn
22. nts NOA UICN rr RA cd 3 AUMTencS and SEO POS OA OA OO os 3 Microsoft SQL Server Fast Track Data Warehouse oso 5 Dell Fast Track Data Warehouse Reference Archer de sa 4 Hardware Component Architecture ccs eastosicscteccss add e Lado 4 D l PowerEdge R510 SEVE ceciren aaa sa 5 POCOS Soi sE 5 MEMON oe somite odata taneous aaa ahaa uaaraaete E caaete ae isa E tae bua o mane eam ants 5 Internal Storage Controller PERG H700 Settings ost comet esta see aed 5 SPE elementos ta 6 E CARR CR 6 RAID CONTOU ATON toa UndNe 7 ADDlICALION CONTOU atO esna oa E a 7 WIndows server 2008 R2 SPA stats idad RARO 7 SOL Server Connora tO aserne NS ROS 8 Mtera Storade SYSTEM aoi era a O E O r a a a 8 Rertrormance Bencar KINO arcering annii NEE ias 9 Baseline Hardware Characterization using Synthetic 1 0 ssssesessssesoesesescssescscesescoeessescseeseseeo 9 Fast Track Worklo0ad EVAtUaA TION aiii 11 CCMA MEN aa enced te cheers eects a a a ise desea ese A a E E Ee EAE AAS 11 Caruana laca as 12 Poputatine Your Data Warenduse palio 12 BUILT an Integration Process ssteeiasados iii iia 13 Configuring Integration AUtOMa OMe ii iia 16 Debloy an Mtera tion POCOS cas E A A A A A E 17 Addressing Enterprise Class Integration sssesessecesesoeceseeceoesceeoesesceoeseeceoeseeceoeecesoreeeo 18 Reviewing Overall Integration Performance susan 18 Reviewing Individual Process Executions siii iia iii 18 EX DIOMING ALOM aeaa a a ion ceo E TT On 19 SLIDSCHIDING tO Proces
23. or managing integration changes in a very simple non disruptive and auditable manner Using a Test Mode integration changes can be tested and verified without impacting any integrations currently running in production Once tested the new integration process can be deployed to production to replace the outdated process For more advanced testing requirements AtomSphere provides Environments functionality Environments are distinct and persistent collections of Atoms enabling you to separate integration elements such as test versus production login credentials Environments are the recommended approach when the applications being integrated have dedicated test QA environments Once defined and tested processes can easily be promoted from one environment to another with a full audit trail of what was promoted when it was changed and by whom Page 17 Dell R510 Reference Configuration for Microsoft SQL Server 2008 R2 Fast Track Data Warehouse Addressing Enterprise Class Integration Business critical integration processes demand a different level of reliability and scalability To ensure that key integration processes are reliable and highly available the Enterprise Edition of AtomSphere features Molecules an enterprise grade version of Boomi s patent pending Atom technology When deployed across multiple physical servers Molecules enhance load balancing and ensure the reliability of mission critical integration processes M
24. ormats from that of another application Using Boomi s Data Transformation components users can map data from one format to another Any structured data format is supported included XML EDI flat file and database formats While transforming data the user can also invoke a variety of field level transformations to transform augment or compute data fields Over 50 standard functions are provided Users can also create their own functions and re use them in subsequent projects 0 Decision execute business logic and data integrity checks Boomi s Decision components provide true false data validation that enables users to explicitly handle a result based on the programmed logic For example an order can be checked against the target system to see if it has already been processed Based upon the outcome of the data check the request will be routed down either the true or false path Another example includes checking products referenced in an invoice to ensure they exist before processing the invoice 3 Cleanse data cleansing and validation Integrations are only as successful as the quality of data that gets exchanged Boomi s Cleanse components allow users to validate and clean data on a field by field row by row basis to ensure that fields are the right data type the right length and the right numeric format e g currency Users Page 14 Dell R510 Reference Configuration for Microsoft SQL Server 2008 R2 Fast
25. re added to the SQL Server Startup options e E This parameter increases the number of contiguous extends that are allocated to a database table in each file as it grows This improves sequential access e 11117 This trace flag ensures the even growth of all files in a file group when auto growth is enabled It should be noted that the Fast Track reference guidelines recommend that you pre allocate the data file space rather than allow auto grow e Enable Lock Pages In Memory Refer to Appendix for more information e 1834 Large Page Allocations Note This flag should be tested thoroughly on a case by case basis The validation for this configuration does not include this trace flags For more information on trace flags refer to the Appendix Internal Storage System The Fast Track reference architecture guidelines define three primary layers of storage configuration e Physical disk array RAID Groups for Data and Logs e Operating system volume assignment virtual disk e Databases User System Temp Log For each internal storage array e Four RAID 1 Disk Groups were created each consisting of 2 disks These RAID groups were dedicated for the primary user data e One RAID 1 disk group was created of 2 disks This RAID group was dedicated to host the database transaction log files e The remaining 2 disks were assigned as the storage hot spares For the entire internal storage setup there were eight disks dedicated to hold t
26. rm s simplicity and ease of use Page 12 Dell R510 Reference Configuration for Microsoft SQL Server 2008 R2 Fast Track Data Warehouse Dell Boomi Dell Boomi is the market leading provider of on demand application and data integration services and the creator of AtomSphere the industry s 1 Integration Platform as a Service iPaaS AtomSphere connects providers and customers of SaaS cloud and on premise applications via a pure SaaS integration platform that does not require software or appliances ISVs and businesses alike benefit by connecting to the industry s largest network of SaaS PaaS on premise and cloud computing environments in a seamless and fully self service model Dell Boomi allows customers to create real time SOA B2B and ETL based integration processes Building an Integration Process Since its inception Boomi has focused on simplifying the creation of integration processes for application integration data integration ETL and B2B integration By identifying the common steps needed to automate complex integration scenarios a series of common integration components have been created and are available to all Boomi users When developing an integration process these components are connected to create an end to end integration workflow Figure 8 Dell Boomi do BOOM ATOMSPHERE Process Sync Salesforce Accounts to Database bol Save L Erouerties C Scheduling Version History Helo EJ Close a
27. s Ale S eorne i e e e e iae e ie 19 COMGLUSION sai ias 20 RECTED OS ardid 21 ADDED sas OS 22 Dell R510 Reference Configuration for Microsoft SQL Server 2008 R2 Fast Track Data Warehouse summary Of Microsoft SOL Server Fast Track TESUNS coicrinaatsnta srta 22 Tables Table 1 Tested Dell Fast Track Reference Architecture Component Details oooooooooo 4 Table 2 Dell Fast Track Reference Architecture Solution Details sesesesseseseseososcseseseoecees 5 Table 3 Mount Point Naming and the Storage Enclosure Mapping essessseesesescoesssescsesescoseeseeo 8 Figures Figure 1 Proposed Dell Fast Track Reference AFCNIecture sd 4 FONS 2 WIECH DISK SCE NOS enn E E EE T EE 6 POUS Internal Storace Controller Seto usirsssros si bad 7 Figured JRAID GOMGCUPATION ess cl 7 Figure 5 Storage System Components iaa ae 9 Figure 6 SQLIO Line Rate Test from Cache Small File aii in 10 Figure 7 SQLIO Real Rate Test from Disk Large File A A 11 Figure Ge Delorean icon 13 Figure 9 Dell Boomi Build Environment Real Time Integration Testing oooocoooomoccccommmms o 16 Figure 10 Dell Boomi Process Execution VieW ssssssssssssssssssssssssosososoososossoosssssosoeooo 18 Page 2 Dell R510 Reference Configuration for Microsoft SQL Server 2008 R2 Fast Track Data Warehouse Introduction Data Warehousing is used for integrating storing and analyzing data in order to perform trend analysis busi
28. that data will be processed in real time e Event based Invocation Remote Atom Invocation Boomi also provides a Trigger API which allows you to securely invoke an integration process that is running inside an Atom regardless of where that Atom may be running without opening any holes in the firewall This is a very powerful option when you wish to provide external access to integration processes or trigger an integration based on some event in another application e Schedule based Invocation Included in every Boomi Atom is a schedule manager capable of invoking integration processes based on a schedule configured by the user Invocations can be scheduled to run as frequently as every minute The schedule based invocation option requires no changes to external applications Page 16 Dell R510 Reference Configuration for Microsoft SQL Server 2008 R2 Fast Track Data Warehouse Deploy an Integration Process Once your integration processes are built they are deployed into lightweight runtime engines known as Boomi Atoms The Boomi Atom is the secret sauce to Boomi s technology and allows your integration processes to run wherever needed and as many times as needed enabling nearly infinite scalability The Boomi Atom contains within it one or more complete end to end integration processes and executes those integration processes with absolutely no dependency on Boomi s platform This allows for several deployment options to accommodate
Download Pdf Manuals
Related Search