Situational Analysis Enterprise Backup Solution This document was prepared to analyze the backup infrastructure, and prepare an action plan, for the Ridgefield location. Content 1Situation Analysis3 2Objective3 3Situation Fact3 4Options4 4.1Option # 1: Veritas Netbackup4 4.2Option # 2: Legato Networker5 4.3Option #3: Commvault Galaxy7 4.4Enterprise Backup Solution – Evaluation Analysis8 4.5Summary of options available11 4.6Updated analysis of Legato Networker subsequent to inclusion of Visual Storage Resource Migrator and Alphastor11 5Recommendation17 1Situation Analysis This document was prepared to analyze the current backup environment and prepare an action plan, for the Ridgefield location regarding the incorporation an Enterprise Backup Solution. 2Objective Our objective is to determine the best course of action regarding the selection and implementation of an Enterprise Backup Solution. 3Situation Fact The current network environment has been outgrown the ability of Veritas BackupExec, the backup software platform used by BI Ridgefield- Production Services, in terms of amount of data being backed up, functionality, and reliability.
At the time of its initial purchase approximately six years ago (with BackupExec 7.x), the server infrastructure consisted of approximately 80 clients with one TB of data captured on a weekly full backup. This small-business level backup solution provided a good fit for the environment and served the company’s data protection needs well. Accordingly, we continued to leverage BackupExec 8.x – 9.x in our organization as the network infrastructure expanded though out the years. The server environment has now grown to the point where there are 370 servers with approximately 16 Terabytes of data captured on a weekly full backup.
In light of this, meeting the established backup/restore service agreement is becoming increasingly challenging. Some of the functionality/features required to address this challenge includes: -The ability to direct multiple streams of data to one media device simultaneously (Multiplexing). -A provision for re-starting backup jobs from the point at which they failed (Checkpointing). -Descriptive reporting on backup media content. -Automation of Media Duplication and Vaulting tasks. -Compete compatibility with SANs and NAS support As a result, Production Services has evaluated a number of solutions from the leading backup software manufacturers.
The final list was narrowed down to three competitors we thought could best meet our outlined requirements. They are: Veritas NetBackup, Legato Networker, and Commvault Galaxy. The tables below list the details of the evaluations. 4Options The reviews of the three options are listed in the following table: 4.1Option # 1: Veritas NetBackup Option Table # 1: ProsCons Administrative/management tasks performed from a centralized location.
(Familiar Microsoft Management Console style interface). Provides the ability to browse resources through Graphical User Interface when creating backup and restore jobs, reducing the possibility of typographical errors. Provides straightforward media management. Multiple media erased, moved and exported at once. Existing BackupExec 9.1 tape media can be imported / read in NetBackup.
Eliminates need to keep BackupExec media servers in environment. Remote agents can be deployed remotely to many servers at once. Only requires one agent install for all applications (SQL,Oracle.Sybase). One can view real-time alert and job status (Byte Count, Rate, Files backed up, Errors, etc). There is also a troubleshooter option to provide error explanations and recommended actions.
Limited Grooming capability. The application requires Storage Migrator component for advanced features. Pre and post job scripted commands are difficult to implement into job. Synthetic backups allow for quick client backups restore from a single backup image. This is essentially the process of combining multiple incremental/differential backups into one image.
Robust backup / restore performance with the use of streams and multiplexing. Up to 32 streams per drive supported. Disk to tape staging for increased backup performance. Inline tape copy is also supported (write to multiple media simultaneously). Restarting a backup job can be from the point of failure is accomplished with the Checkpoint feature. Log purge subsequent to a SQL full recovery backup can be performed NetBackup can also invoke RMAN for Oracle on-line backups.
Open File Option (Veritas Snapshot Provider) is included with product. Windows 2003 Server backups use Microsoft Volume Shadow Copy Service. Fully supports VMWare ESX/GSX Virtual Server host / instance backups.The application requires Bare Metal Recovery component for OS and System State recovery. This is an additional cost item.
Comprehensive reporting which includes: Media=ServerResource report Server=Media needed for recovery report Vaulting tasks can be set up to automatically duplicate data, create reports, and eject tapes for archiving. Master server implementation in a clustered configuration provides fault tolerance. 4.2Option # 2: Legato Networker Option Table # 2: Ease of management/administration has been added through the incorporation of the Networker Management Console user interface version 7.1. The application also includes enhancement of Media Management through the Networker Management Console version 7.1.
The application can simultaneously erase, move and export Multiple media De-centralized Management Structure. Use of Networker Administration Console, Networker Management Console, and Networker User interfaces to manage operations. Does not show real-time rate, percentage complete, or current file/directory being backed up in activity monitor. There is no ability to Browse when setting up backup or restore jobs. No built in reports for: Media=ServerResource report or Server=Media needed for recovery report.
We evaluated Visual Storage Resource Migrator for this additional functionality and this type of report was still not included. Networker agent cannot be pushed to remote clients. Clients have to be visited to locally install agent. Checkpointing provides ability to restart/resume jobs.
Re-runs only the save sets that failed from the point at which they failed without having to create new separate backup jobs. Save Set Consolidation combines multiple incremental backups into one full backup image. Backups using Save Set Consolidation consume less network bandwidth and decrease the impact on the application host. With the use of streams and parallelism, more rapid backup performance can be achieved.Cannot write to multiple media simultaneously (In-line tape copy). Requires Open File Manager for open file backups.
This is an additional cost component. Uses ASR recovery for Windows 2003 Server Disaster Recovery. Uses SMTP to send logs and alerts vial e-mail. Uses Volume Shadow Copy Services for Window 2003 Snapshots. Fully supports VMWare ESX/GSX Virtual Server host/instance backups.Grooming cannot be performed to meet our requirements with the base Networker Product. As a result, EMC provided Visual Storage Resource Migrator at no additional cost.
While this product can do certain types of grooming, NetWorker still does not provide the type of grooming we require. In order to groom data-based on modified and accessed dates, NetWorker must first move them to an alternate data directory. While this does not seem like a large issue at first, we must think about the potential volume of the data to be groomed (sometimes upwards of 1 TB) and the additional storage that will need to be purchased as a result. Inability to purge SQL transaction logs subsequent to full backup.
Vaulting tasks can be set up to automatically, duplicate data, create reports, and eject tapes for offsite storage using AlphaStor. This product was added by EMC at no additional cost. NetBackup is a very intuitive tool that provides a great deal of additional functionality with respect to tape lifecycle management. Master Server can be clustered for fault tolerance Can leverage with existing Legato Networker implementation in the UNIX environment. 4.3Option #3: Commvault Galaxy The Web management console appears and acts the same as the Media Server management console. This allows for same functionality in both places.
(Java based) .Difficult to monitor jobs. Does not show real-time rate, percentage complete, or current file/directory being backed up in activity monitor Difficult media management. Can only erase one tape at a time. Non-intuitive GUI. Duplication of options at many levels makes job management difficult Fast backup performance with the use of Streams and Multiplexing. Up to 32 streams per drive can be configured.
Synthetic backups allow for quick client backups restore from a single backup image. This is essentially the process of combining multiple incremental/differential backups into one image. Agent is pushed from CD. Requires separate agents for every application (SQL, Oracle, Sybase, etc). Cannot write to multiple media simultaneously (In-line tape copy).
Inability to perform SQL transaction log purge subsequent to full database backup. Checkpoint feature. Able to restart from point of backup failure rather than re-running entire job. Uses SMTP to send alerts and errors via e-mail.Requires quick recovery option for OS/System State restore. Can be clustered for fault toleranceLimited reporting capabilities.
No reports for: Media=ServerResource Server=Media needed for recovery 4.4Enterprise Backup Solution – Evaluation Analysis IT To what does “it” refer? If a pronoun is used without first identifying for what it stands, the reader might be confused. (28) System/Technology Analysis System or technology list (Blue) Analysis Requirements (Yellow)Veritas NetBackupLegato NetworkerCommvault Galaxy Hardware/Software/Installation 1OS requirementsWindows 2000/2003Windows 2000/2003Windows 2000/2003 2Leverage existing hardwareYes; However, will require processor and memory upgradesYes; However, will require processor and memory upgradesYes; However, will require processor and memory upgrades 3Multi-Vendor SupportYes, STK, BrocadeYes, STK, BrocadeYes, STK, Brocade 4SQL / InstallationN/AN/AYes 5Automatic Device DiscoveryYesYesYes 6Media discoveryStraight ForwardStraight ForwardStraight Forward 7Master Server setupStraight ForwardStraight ForwardStraight Forward 8Media server setupStraight ForwardStraight ForwardStraight Forward 9Master server failure / recoveryCluster awareCluster awareCluster aware 10Media server failure / recoveryStraight ForwardStraight ForwardStraight Forward Job Management 1Centralized Management ConsoleYes, MMC StyleNo, Uses Networker Administrative console and Networker Management ConsoleYes, Java-based 2Job CreationStraight ForwardMostly Straight ForwardMostly Straight Forward 3Policy setupStraight ForwardMostly Straight ForwardMostly Straight Forward 4Remote system discoveryYes NoNo 5Remote system agent installationYesNoYes 6Remote system resource selectionYesNoNo 7Ability to browse network resources when creating a backup or restore taskYesNoNo 8Redirection of files during restoreStraight ForwardDifficultDifficult 9Alignment with policy / scheduleStraight ForwardStraight ForwardDifficult 10Viewing of scheduled tasksStraight ForwardMostly Straight ForwardDifficult 11Viewing of active tasksStraight ForwardMostly Straight ForwardDifficult 12Viewing of completed tasksStraight ForwardMostly Straight ForwardDifficult 13Manual start of scheduled tasksStraight ForwardStraight ForwardDifficult 14One time run of a taskStraight ForwardStraight ForwardDifficult 15Grooming of a serverYes, Can be scripted using BPARCHIVE command in base product.Not in base product. Limited in Visual SRM. Must first move data to additional folder before deleting.No 16Pause / Resume of JobYesYesYes Media Management 1Viewing of available mediaStraight ForwardStraight ForwardDifficult 2Viewing of used mediaStraight ForwardStraight ForwardDifficult 3Viewing of offsite mediaStraight ForwardStraight ForwardDifficult 4Viewing of retired mediaStraight ForwardStraight ForwardDifficult 5Manual recycling of mediaStraight ForwardMostly Straight ForwardDifficult 6Cataloging of mediaStraight ForwardMostly Straight ForwardDifficult 7Setup of media sets / poolsStraight ForwardStraight ForwardStraight Forward 8Retention for mediaStraight ForwardStraight ForwardStraight Forward 9Move data between media sets / poolsStraight ForwardStraight ForwardStraight Forward Alert management 1Viewing of active alertsStraight ForwardStraight ForwardDifficult 2Clearing of active alertsStraight ForwardStraight ForwardDifficult 3Viewing of alert historyStraight ForwardStraight ForwardDifficult Remote agent installation / use 1SQL 7 /2000Yes: 1 Agent for allYes: Separate AgentsYes: Separate Agents 2Oracle 7 / 8 / 9iYes: 1 Agent for allYes: Separate AgentsYes: Separate Agents 3Exchange 5.5Yes: 1 Agent for allYes: Separate AgentsYes: Separate Agents 4Exchange 2003Yes: 1 Agent for allYes: Separate AgentsYes: Separate Agents 5LinuxYes: 1 Agent for allYes: Separate AgentsYes: Separate Agents 6Windows NT4.0Yes: 1 Agent for allYes: Separate AgentsYes: Separate Agents 7Windows 2000Yes: 1 Agent for allYes: Separate AgentsYes: Separate Agents 8Windows 2003Yes: 1 Agent for allYes: Separate AgentsYes: Separate Agents Backup Scenarios 1Standard file backupStraight ForwardStraight ForwardStraight Forward 2OS backupStraight ForwardStraight ForwardStraight Forward 3System State backupStraight ForwardStraight ForwardStraight Forward 4SQL backupStraight ForwardStraight ForwardStraight Forward 5Oracle backupStraight ForwardStraight ForwardStraight Forward 6Exchange backupStraight ForwardStraight ForwardStraight Forward 7Open File backupYes: Included in base productNo – Requires St.
Bernard Open File ManagerNo – Requires Open File Option 8IDR backupNo – Requires Bare Metal Recovery OptionNo – Requires Network Recovery ManagerNo – Requires Quick Recovery Option 9Backup – to – DiskYesYesYes 10Disk – to – Tape stagingYesYesYes 11Inline Tape Copy (Write to two media simultaneously)YesNoNo 12Synthetic Backups/Save Set ConsolidationYesYesYes Recovery Scenarios 1Standard file recoveryYesYesYes 2OS recoveryNo – Requires Bare Metal Recovery OptionYes – LimitedNo – Requires Quick Recovery Option 3SQL recoveryYesYesYes 4Oracle recoveryYesYesYes 5Exchange recoveryYesYesYes 6IDR recoveryNo – Requires Bare Metal Recovery OptionNo – Requires Network Recovery ManagerNo – Requires Quick Recovery Option 7VMWare Host recoveryYesYesYes 8VM Server recoveryYesYesYes Reporting 1Job Success / FailureYesYesYes 2Media retentionYesYesYes 3Media vaultingYesYesYes 4Media = ServerresourceYesNoNo 5Server = Media needed for recoveryYesNoNo Other items to review 1CheckpointYesYesYes 2Device fail overYesYesYes 3Job fail overYesYesNo 4SQL Transaction log purge subsequent to full backupYesNoNo 5Read existing Backup Exec mediaYesNoNo 6Multiplexing/ParallelismYesYesYes 7Support for NAS/SANYes, EMC, HP, Netapp. NDMP capable.Yes, EMC, HP, Netapp. NDMP capable.Yes, EMC, HP, Netapp. NDMP capable. 8VaultingYes, vault option must be purchased at additional cost. It What is “it”? Avoid use of undefined pronouns.
(28) is a snap in and is fully integrated with base product.Not with base product. AlphaStor was provided by Legato at no additional cost. This is a separate product that is not integrated into base product.Yes, vault option must be purchased at additional cost. It is a snap in and is fully integrated with base product.
Support 1Technical Support (24 X 7)YesYesYes Training 1Training for ProductsYes, Certification availableYes, Certification availableYes 4.5Summary of options available Option 1: Implement Veritas NetBackup. Option 2: Implement Legato Networker. Option 3: Implement Commvault Galaxy. 4.6Updated analysis of Legato Networker subsequent to inclusion of Visual Storage Resource Migrator and Alphastor EMC has recently proposed to BI that AlphaStor and Visual SRM will both be delivered free of charge, along with the Legato NetWorker product. AlphaStor The inclusion of AlphaStor is needed on EMC’s part because vaulting type functionality is a requirement at BI.
AlphaStor is an EMC product that works with EMC NetWorker to provide a great deal of additional vaulting functionality that NetWorker lacks. Essentially, AlphaStor is a media management product that also functions as a device resource manager for shared tape device environments. Originally, it was designed to grant various backup products the ability to share devices. But now for the most part, all major backup vendors have their own media and device management capabilities.
Because AlphaStor is a separate product and not an option of NetWorker, it is installed, configured and managed separately. This results in increased system administration and hardware costs since AlphaStor would need to be installed on a separate server and would involve NetWorker administrators to be trained on the new product. Additionally, AlphaStor may be a point of contention between various NetWorker implementations as it would be another software layer loaded on top of the backup environment. Most importantly, because the AlphaStor server controls all the Networker servers it would present the possibility of disrupting all backup/restore services in the event it is down or unreachable. In contrast, a many of the functionality added by AlphaStor is already available from the NetBackup core product.
NetBackup’s “Shared Storage Option” (SSO) provides a centralized and efficient manner to share tape devices among media managers. Likewise, Veritas’ Vault option provides a robust and easy to use way of managing media onsite as well as offsite. NetBackup offers flexible vaulting schedules, in-line tape copy/duplication, and comprehensive reporting of tape media. Additionally it can generate reports in the format acceptable to various vaulting vendors like Iron Mountain. NetBackup can also create reports for the dockworkers to pull tapes out of the tape library docks and put them into bins for offsite storage.
This is end-to-end media management, and integrated and centralized inside of the core NetBackup product. Below is a matrix with a side-by-side comparison of the functionality of both products. Installation and Configuration FeatureNetBackupAlphaStor and NetWorkerComments Installation of productNASeparateAlphaStor is installed as a separate product from NetWorker ConfigurationSimple, Wizard-based ComplexNetBackup provides wizards for device, media configurations. AlphaStor lists a total of 15 steps to configure itself. There are additional steps needed to configure NetWorker to work with AlphaStor.
AdministrationSingle GUI-based consoleSeparateAlphaStor and NetWorker use different GUIs for each product. In addition NetWorker uses different GUIs for different platforms like Windows and UNIX Shared Storage OptionPart of Media manager (Option)Part of AlphaStorNetBackup SSO is a licensable option VaultOptionPart of AlphaStorVault is a licensable option of NetBackup Media Configuration StepsOnceTwiceThe media is configured twice. Once in AlphaStor and once in NetWorker. The products are not integrated properly Usability FeatureNetBackupAlphaStor and NetWorkerComments Separate ServerNoYesBecause AlphaStor uses a separate server to store the database and manage media, it can be an added point of failure. If the AlphaStor server or services are unreachable, the whole backup/restore service is DOWN! GUIJava-basedWeb-based, UNIX and/or WindowsAlphaStor uses a web-based GUI.
But NetWorker uses a platform-based GUI. All three are inconsistent with each other Administration conflictsNonePossibleBecause NetBackup uses its own media management software, the administrator can make good choices about media and devices. Because AlphaStor admin is usually separate, s/he may be a point of contention for NetWorker admins. Database SynchronizationNAMUSTAlphaStor and NetWorker databases need to sync’ed. If they are not in sync, backups/restores may fail ReportingExtensiveLimitedNetBackup allows extensive reports about media not only when using Vault option but many valuable reports can be obtained within core product itself.
NetBackup’s reporting capability is unmatched in the industry Media Management When AlphaStor is installed and configured, NetWorker has to be configured again to work with AlphaStor FeatureNetBackupAlphaStor and NetWorkerComments Onsite and OffsiteYesYesAlphaStor takes care of the offsite media management. NetWorker does not keep track of the location of tapes Adding MediaOnceTwiceThe media is added twice. Once into AlphaStor and once into NetWorker. Managing media poolOnceTwiceBoth AlphaStor and NetWorker must manage media pools independently. The media pool if deleted from AlphaStor has to be deleted from NetWorker again.
Robot management and inventoryCore ProductAlphaStorNetBackup core product can do the robot configuration and inventory. Rotation scheduleYesYesAlphaStor uses a counter to reset a rotation of volume. When this counter reaches a certain value the media is rotated In Line duplicationYesNoNetBackup allows for making more than 1 copy of the backup stream (upto 4), so as to reduce extraneous vaulting cycles. But vaulting can happen anytime desired by the admin Device Resource Management When AlphaStor is configured into NetWorker environments, two distinct configurations need to be performed. AlphaStor controls the actual devices while presenting NetWorker with the “virtual jukeboxes” to backup on.
However, while AlphaStor controls the device and media to which the backup would go, it is the NetWorker product, which ultimately has the control over type of media to use for the backup. In all instances, it is assumed that AlphaStor and NetBackup databases are in-sync. AlphaStor allows the administrator to divide the backup device and media infrastructure into resource queues. It then assigns the actual drives to the resource queues.
AlphaStor administrator also defines mount class for the devices. The NetWorker administrator uses these predefined resources to make backup requests. The NetWorker administrator has no control over which resource is used for the operation. If a resource is busy, the NetWorker administrator cannot assign the job to another resource queue without the help from the AlphaStor administrator. If the same individual performs these roles, it requires the user to manage two applications and user interfaces to accomplish this simple task. NetBackup takes this complexity away.
Using SSO option, the NetBackup administrator has complete control over devices. Devices are shared among various NetBackup media managers. SSO is configured using the usual device configuration wizard. NetBackup also allows for special directives to be used on media managers.
These directives allow the administrator to reserve a drive only for restores, for example. If specified, one drive is always kept available for restores. Even if backup jobs are pending, restores can start using this drive. Along with backup restart capability of the NetBackup core product, this facility makes sure that restores are never held up due to backups taking place. FeatureNetBackupAlphaStor and NetWorkerComments Complexity of configurationLowHighAlphaStor is a complex product to implement. Along with NetWorker, the limitations of the products may make configuring them painful.
Special DirectivesYesYesNetBackup allows special directives like local drive only, or reserve for restore etc Core product functionality–NetBackup offers many reports, administrative capabilities within the core product. EMC NetWorker does not provide much of it and pushes for AlphaStor Alternate interface for sharing storageYesNoNetBackup allows for separate interfaces to be used for SSO. NetWorker does not offer this functionality Visual SRM The inclusion of Visual SRM (VSRM) was required on EMC’s part to meet BI Production Services-Server Technologies archive and deletion requirements. Visual SRM software is designed to provide centralized storage resource management (SRM) for multi-vendor, mid-tier storage environments; ensuring capacity is available when and where it is needed by actively managing the storage resources with powerful visualization tools.
With Visual SRM, the operator can manage utilization according to thresholds set and deploy active policies to meet the demands of the critical business applications. Some of the strengths include: Increase capacity utilization, improve availability and automate management processes. Reduce or eliminate server outages due to out-of-control disk space consumption. Eliminate time-consuming processes and reduce costsfor a lower TCO. Shorten backup windows so more work can be done in less time.
Improve capacity planning and charge back capabilities. Focus on core business rather than storage administrative tasks. While this is an extremely powerful product with respect to file system analysis and reporting we still do not feel like this free product will get BI-Production Services-Server Technologies entirely where it needs to go. From the Enterprise Backup project perspective, we are predominantly concerned with the ability to select data efficiently, back data up, and delete data-based on last time accessed/modified and/or data ranges ( referred to as grooming). This particular functionality is not included in the base Networker product. As a result, EMC has offered VSRM to help meet this requirement.
This product does an extremely good job of locating data-based on modified and accessed dates however, it does not have the ability to groom a file system at the level we require it too. In order to groom a file system VSRM requires that the data first be moved to an alternate location, after which a Networker command can be invoked to backup and ultimately delete the data. This would not be an option for us as it will require the purchase of substantial amount of additional storage to accommodate (at times we may have to groom upwards of 500 gigabytes of information). With our current backup software, Veritas BackupExec we are able to groom without having to move the data and as such we would like to continue to operate this way.
To this end, VERITAS NetBackup will allow BI to use a command known as bp_archive to help backup data and delete it from primary storage without first moving it to alternate location. A file list, based on whatever characteristics defined, can be generated then bp_archive can be engaged to meet BI’s needs. Of additional importance, this bp_archive command is part of the base VERITAS NetBackup offering and does not require the implementation of an additional product to accommodate this task. 5Recommendation While the inclusion of the AlphaStor and Visual SRM products does put NetWorker a good deal closer to meeting our Vaulting and Grooming requirements it still does not provide “like” functionality with VERITAS NetBackup and will still present many issues for our IT environment. As such, the recommendation for the primary backup software of choice would still be to implement Veritas NetBackup. In summary, this software offers a centralized solution with a wide range of functionality, ease of use/management, and exemplary performance as is outlined in the above documentation.
The recommendation for the secondary backup software of choice goes to Legato Networker. This software also offers a wide variety of features and functions with almost all the capabilities of Veritas NetBackup. However, it is marred by a non-user friendly graphical interface that is less intuitive for performing everyday operations as well as some inherent shortcomings
