On Demand backups allow content to be specified as an external input at the time of initiating a backup. Whereas traditional backups are performed using subclients, which contain fixed content configured prior to performing the operation, On Demand backups allow you to specify content each time you perform a backup.
Content for On Demand backups is defined through two entities:
Once these entities are defined, an On Demand Backup Set is then created. Backups run from this Backup Set will provide the facility to select the Content and Directive Files to be included.
Content File entries should be in the following format with no filters, wildcards, or regular expressions included:
\\client1\shares\ondemand_content\test1.txt
/usr/datafile
/usr/textfile
/etc/docfile
Similarly, Directive File entries should be in the following format with no filters, wildcards, regular expressions, or blank lines:
/usr/ContentFile1
If the path or the filename contains Unicode characters, the Content File must be converted to a format that can be used by the data protection operation. The Unicode Conversion utility must be used to convert the Content File to a format that can be provided as input.
cvconvertunicode <source file> <destination file>
Where:
<source file> is the full path and name of the file created in Step 1.
<destination file> is the full path and name of the destination file. The file will automatically be created by the utility.
For example, consider a Content File that lists the following entries:
/usr/
/usr/textfile
In this scenario, a backup operation will back up the contents of all data residing in the textfile folder twice as the Content File already has the entry for the parent folder to be backed up.
It is recommended that Content Files do not include such duplicate entries. If you are not able to avoid duplicate entries, use the following steps to prevent the duplication of data.
|
By default, the content of the Default Subclient contains
the entire file system. When you create a user-defined Subclient, the contents of the user-defined Subclient will be excluded from the Default Subclient. |
You can create a user-defined subclient to manage and backup specific data files.
|
A symbolic link is a file that points to another file. By default, the symbolic link file will be included in the subclient content. However, use the following procedure to expand and backup the path in the symbolic link.
|
Backup of content pointed by the symbolic links can be enabled at the subclient level.
Use the following steps to follow the symbolic links under a subclient and include the content pointed by these links for backup:
|
Symbolic links are backed up by default when they are part of subclient content. In addition to symbolic links, you can enable back up of data pointed by symbolic links that are present under the subclient content path but reside outside the content path.
For example, consider a subclient with content as /home/user having symbolic links under this directory:
/home/user/lib->/usr/lib/
/home/user/commonProfile.rc->/etc/commonProfile.rc
When you enable the option, symbolic links as well as the data they are pointing to will be backed up, i.e., the data content of the directories, /user/lib and /etc/commonProfile.rc is backed up.
Note that data will be backed up unless there is another subclient with content covering the path the symbolic link is pointing to; if the other subclient is not scheduled for backup, loss of data due to user error will occur.
Use the following steps to enable backup of data pointed by symbolic links:
|
|
|
|
|
Use the following steps to backup the Apple Double formatted Macintosh files as a single file:
|
To backup and restore files containing non-ASCII (international) characters appropriate locale has to be configured in the server. Once configured, these settings enable you to:
The following steps use the example of KOI-8R character encoding scheme to store the files with Russian names.
1. | Logon to the client as root and stop the Services. | Calypso stop |
2. | Run the locale command (with no options) to determine which locale is currently set on the server. A sample output is shown in the example. |
Example: LANG=en_US.iso885915 LC_CTYPE="en_US.iso885915" LC_NUMERIC="en_US.iso885915" LC_TIME="en_US.iso885915" LC_COLLATE="en_US.iso885915" LC_MONETARY="en_US.iso885915" LC_MESSAGES="en_US.iso885915" LC_ALL= This output shows that the en_US.iso885915 locale for the LANG environment variable is currently set. |
3. | Use the LC_CTYPE environment variable to set the desired locale. |
Example: LC_CTYPE=ru.koi8-r |
4. | Export the locale. | export LC_CTYPE |
5. | Run the locale command. A sample output is shown in the example. |
Example: LANG= en_US.iso885915 LC_CTYPE="ru.koi8-r" LC_NUMERIC="ru.koi8-r" LC_TIME="ru.koi8-r" LC_COLLATE="ru.koi8-r" LC_MONETARY="ru.koi8-r" LC_MESSAGES="ru.koi8-r" LC_ALL= |
6. | Start the Services | Calypso start |
A properly configured system will have the correct locale set in one of the operating system startup scripts (e.g., /etc/profile). In case you do not want to change the locale for the entire system, you may make the changes to the Calypso startup scripts by editing the /opt/calypso/galaxy_vm file
Example:
LC_CTYPE=ru.koi8-r
export LC_CTYPE
To update the CRC consistency checking, include the following command as root from the Base directory:
/updatecrc32 galaxy/Base/Galaxy
Restart the server to allow the iDataAgent to start with the correct locale settings.
By default, the following file systems are automatically skipped during backups:
By default, the default subclient includes all the data in the client. However, the above mentioned file systems are not included in the backups. Use the following procedure to include the skipped file systems in the default subclient.
|
|
You can set filters to prevent specific data from being backed up. Typically, you can use filters to exclude certain system-related files and database application files which consistently fail during a backup operation.
Subclient-level backup filters are available for the File System iDataAgent to exclude specified directories and files from being backed up. Follow the steps given below to configure filters on a subclient:
|
Once you set the filters, you can also provide exceptions for the filters. The files or folders added to the exception list will be included in the backup operations. For example, if you want to exclude from your back up operation all the files in the /Ops directory except the Maintenance file. You can add a subclient filter to exclude the /Ops directory from being backed up and also provide an exception to allow the Maintenance file to be backed up.
|
|
By default Classic File Scan is selected as the method for scanning files to determine which files have changed and/or have been backed up. However, you can also select Data Classification Enabler as the preferred method of scanning files. If you want to use Data Classification Enabler , see Data Classification.
Classic File Scan is always used when files or file level wildcards are used in the subclient content. |
|
The File System iDataAgent uses the operating system's kernel resources, such as shared memory, semaphores, etc., to perform data protection and recovery operations. If you are using an earlier version of the operating system, you can optimize the usage of these resources by setting the kernel parameter values.
The following table displays the possible range of values for each parameter:
If "*" appears
after the parameter name, this indicates that you can increment the
value of the parameter based on the number of desired streams by using
the formula parameter value = 64 * number of desired streams as long as the "high-end" value of the range for the parameter is not exceeded. |
Parameters | Description | Possible Range of Values |
SEMMNI* | Defines the maximum number of semaphore sets in the entire system. | 1 – 65535 |
SEMMAP | Defines the maximum number of semaphore map entries. | 1 – 65535 (SEMMNI + 2) |
SEMMNS* | Defines the maximum semaphores in the system | 1 – 2147483647 [MAXINT] (Default value 128 is too low.) |
SEMVMX | Defines the maximum value of a semaphore | 32768 |
SHMMNI* | Defines the maximum number of shared memory segments in the entire system | 1 – 2147483647 [MAXINT] |
SHMMAX | Defines the maximum allowable size of one shared memory segment | 0 – 4294967295 (Available physical memory); recommended value is 2147483648 |
SHMSEG* | Defines the maximum number of shared memory segments that one process can attach | 0 - 32767 |
SEMMNU | Defines the maximum number of System V IPC system-wide processes that can have "undo" operations pending at any given time. | 1 - (nproc-4) [256]; preferred value: 1024 |
Use the following steps to modify the kernel parameters with System Administrator Menu (SAM) for HP-UX File System:
1. | From the unix prompt, enter the command to open the System Administrator Menu (SAM). | #sam |
2. | In the SAM utility window, double-click the Kernel Configuration icon. | |
3. | Double-click the Configurable Parameters icon. SAM will display a screen containing a list of configurable parameters, including current and pending values. | |
4. | Double-click on the parameter you wish to change. | |
5. | Click New Formula/Value option and type the recommended value. | |
6. | Click OK. | |
7. | Restart the computer to allow the changes to take effect. |
System Management Homepage (SMH) is the new tool introduced to manage HP-UX. Use the following steps to modify the kernel parameters using System Management Homepage (SMH) since the System Administration Manager (SAM) is deprecated in the current releases of HP-UX:
1. | From the unix prompt, enter the command to open the System Management Homepage (SMH) window. |
#smh |
2. | In the SMH Text User Interface, select k -Kernel Configuration and press Enter. |
DISPLAY variable is not set. Starting the Text User Interface. Please wait...HP-UX System Management Homepage (Text User Interface) SMH ---------------------------------------------------------- a - Auditing and Security c - Auditing and Security Attributes Configuration(new) d - Peripheral Devices e - Resource Management f - Disks and File Systems g - Display k - Kernel Configuration l - Printers and Plotters(new) m - Event Monitoring Service n - Networking and Communications p - Printers and Plotters s - Software Management u - Accounts for Users and Groups ---------------------------------------------------------- x-Exit smh w-WebLaunch 1-Help ENTER-Launch Functional Area v-SAM Log Viewer |
3. | Select the t - Tunables to view a list of configurable parameters, including current and pending values and press Enter. |
SMH->Kernel Configuration ---------------------------------------------------------- t - Tunables View or modify kernel tunables m - Modules View or modify kernel modules and drivers a - Alarms View or modify alarms for kernel tunables l - Log Viewer View the changes made to kernel tunables or modules u - Usage View usage of kernel tunables c - Manage Configuration View the options available to manage configuration b - Restore Previous Boot Values Restores Previous Boot Values for Tunable <-----------------------------------------------------------------------> x-Exit smh ENTER-Select ESC-Back 1-Help |
4. | Select the parameter you wish to change and press Enter. For Example, select semmni parameter. |
SMH->Kernel Configuration->Tunables (All) ---------------------------------------------------------------------------- Tunable Tuning Current Next Boot Default Usage Module Capability Value Value Value ===================================================================== semaem Static 16384 16384 16384 - pm_usync semmni Static 2048 2048 2048 1.4% pm_usync semmns Static 4096 4096 4096 3.7% pm_usync semmnu Static 256 256 256 - pm_usync semmsl Dynamic 2048 2048 2048 - pm_usync semume Static 100 100 100 - pm_usync semvmx Static 32767 32767 32767 - pm_usync shmmax Dynamic 1073741824 1073741824 1073741824 3.1% vm_asi shmmni Dynamic 400 400 400 2.2% vm_asi shmseg Dynamic 300 300 300 - vm_asi --------------------------------------------------------------------- x-Exit smh ESC-Back p-Pending b-Restore Previous Boot Values 2-kctune Manpage /-Search ENTER-Details m-Modify d-Dynamic 1-Help 3-Tunable Manpage |
5 |
Press m to modify the selected parameter.
Use the following formula to calculate the value for the parameter: parameter value = current value + (64 * number of desired streams)
|
SMH->Kernel Configuration->Tunables (All)->Details Details : semmni --------------------------------------------------------------------------------- Tunable semmni ============================================================================== Description Maximum number of semaphore sets on the system Dynamic no Subsystem pm_usync Default Value 2048 Current Value 2048 Planned Value 2048 Last Boot Value 2048 Constraints semmni >= 2 Constraints semmni <= 32767 Constraints semmni <= semmns Auto Tuning Not Supported Current Usage 28 ----------------------------------------------------------------------------------x-Exit smh m-Modify ESC-Back 1-Tunable Help |
6. |
|
SMH->Kernel Configuration->Tunables (All)->Details->Modify ------------------------------------------------------------------------ Tunable semmni Description Maximum number of semaphore sets on the system Module pm_usync Current Value 2048 [Default] Value at Next Boot 2048 [Default] Value at Last Boot 2048 Default Value 2048 Constraints semmni >= 2 semmni <= 32767 semmni <= semmns Can Change At Next Boot Only NOTE: If the new Value is specified as Default, the next boot value will be default value for the tunable as reccomended by HP. However, if the tunable is being autotuned then the value assigned will be determined dynamically by kernel during run-time. New setting[Expression/Value]: ___________________ New setting (evaluated): ___________________ [ Recalculate ] Back up the current configuration before applying change: (X) Yes ( ) No Reason for change : _______________________________________ [ Modify ] [ Preview ] [ Cancel ] ------------------------------------------------------------------------ |
7. | A Confirmation window will be displayed warning you that the requested changes have been saved and will take effect at next boot. Press Enter to continue. |
SMH->Kernel Configuration->Tunables (All)->Details->Modify ---------------------------------------------------------------------------------- mount: ignoring incomplete/incorrect entry for /dev/dsk/c0t0d0 in /etc/fstab NOTE: The requested changes could not be applied to the currently running system, for the following reasons: - The tunable 'semmni' cannot be changed without a reboot. * The requested changes have been saved, and will take effect at next boot. Tunable Value Expression semmni (now) 2048 Default (next boot) 2048 2048 mount: ignoring incomplete/incorrect entry for /dev/dsk/c0t0d0 in /etc/fstab Command Successful press Enter Key to continue |
8. | Restart the computer. |
Note that, you do not have to enable multi-streaming if you have multiple mount points pointing to the same physical drive. Do not use multiple streams if you have added UNC paths to the subclient content.
Before enabling multi streaming, ensure that you can use multi-streaming when you restore the data and create an auxiliary copy.
Follow the steps given below to configure multi-streaming.
|
This option accelerates Full or On Demand backups and is enabled by default. Subsequently, when you perform a browse and restore operation, the default browse displays data up to the most recent full backup. To browse and restore older data you have to use the options to browse before or between specific dates.
When disabled, Full or On Demand backups may be slower. However, the default browse displays all data in the entire retention period; not just one full backup cycle.
Use the following steps to configure this option for all subclients. This option can also be set for the individual backups when initiating the job.
|
|
Incremental and differential backups can be configured depending on the changed time. The changed time can include ctime (changes in the file properties) or mtime (changes to the data in the file). You can use ctime to include the files with their properties changed since last backup/last full backup. Similarly, you can use mtime to include the files with their data changed since last backup/last full backup.
The ctime and mtime will be applicable only for the volumes which are scanned by the Classic File Scan. When the Data Classification is used for scanning the volumes, ctime and mtime will not be taken into account.
Follow the steps given below to configure an incremental backup using ctime and mtime options.
|
A Save As Script file can also be run as a pre/post process, if you include the absolute path of the associated input file in the script file.
The first line of the script must execute a command that is designed to call in the pre/post program. Ensure that you have included the appropriate command in the first line of the script.
The following is an example of a typical pre/post script:
#!/bin/bash base='basename $0' echo $0, 'date' > /extra/aah/RESULTS/$base.out exit 0
|
Use the following steps to run a post process even if the scan or backup operation did not complete successfully. For example, this may be useful to bring a database online or release a snapshot.
|
The sparse files are restored by default as flat files, wherein the holes are restored as data. This will increase the disk usage. Use the following steps to restore the holes as genuine holes which will considerably reduce the disk usage.
|
You can add, modify or delete several configurable properties for the File System iDataAgent from command line.
Command line configuration enables you to:
The following sections describe the available command line configurations:
To run command line operations you must first login to the CommServe as follows:
qlogin -cs <commserve name> -u <user name>
qlogin -cs server1 -u user1
qoperation execute -af create_subclient_template.xml -appName 'File System' -clientName xxxxx -backupsetName xxxxx -subclientName xxxxx -contentOperationType ADD -content/path 'xxxxx'
qoperation execute -af get_subclient_properties_template.xml -appName 'File System' -clientName xxxxx -backupsetName xxxxx -subclientName xxxxx
qoperation execute -af update_subclient_add_template.xml -appName 'File System' -clientName xxxxx -backupsetName xxxxx -subclientName xxxxx -contentOperationType xxxxx -content/path 'xxxxx'
qoperation execute -af update_subclient_add_template.xml -appName 'File System' -clientName xxxxx -backupSetName xxxxx -subclientName xxxxx -newName xxxxx
qoperation execute -af delete_subclient_template.xml -appName 'File System' -clientName xxxxx -backupsetName xxxxx -subclientName xxxxx
The following table displays all the parameters you can use with the commands mentioned in the above sections. To add a parameter to your command, use the following syntax: (Some examples are provided at the end of the table.)
qoperation execute -af <template XML file> -<parameter name> <value>
Parameter | Description of Parameter values |
clientName | Name of the client computer. |
backupsetname | Name of the backup set. If the backup set name is not specified in the command query, the default backup set is used by default. |
appName | Name of the application. In this case it would be 'File System'. |
subclientname | Name of the subclient. |
newName | New name of the subclient. |
enableBackup | Option to enable/disable backup. Valid values are True/False. |
encryptionFlag | Option to set the encryption points during
backups. Valid values are:
|
networkAgents | Number of Network Agents. |
softwareCompression | Option to enable compression on the
Client or MediaAgent computer. Valid values are:
|
throttleNetworkBandwidth | Enhancing backup performance by reducing network
bandwidth overhead. Valid values are 0/1. |
enableDeduplication | Option to enable deduplication on subclient. Valid values are True/False. |
generateSignature | A component of deduplication performed on the
client or MediaAgent computer. Valid values are:
|
storagePolicyName | Name of the Storage Policy to be associated for backup. |
useGlobalFilters | Option to enable the use of global filters. Valid values are:
|
useVSS | Option to enable/disable VSS for backing up the
file system
data. Valid values are True/False. |
useVSSForSystemState | Option to enable/disable VSS for backing up the
system state. Valid values are True/False. |
backupSystemState | Option to enable/disable back up of the system
state. Valid values are True/False. |
postBackupCommand | Path to the post process script that will be run after the backup. |
postScanCommand | Path to the post process script that will be run after the scan phase |
preBackupCommand | Path to the pre process script that will be run before the backup. |
preScanCommand | Path to the pre process script that will be run before the scan phase |
runAs | Option to specify the user name who has permissions to run the pre/post
process scripts. Valid values are:
|
content/path | Location of the content to be backed up. This
parameter must be used along with the contentOperationType parameter, for example: -contentOperationType <value> -content/path '<path value>' |
content/excludepath | Location of the content to be excluded from
backup. This parameter must be used along with the contentOperationType
parameter, for example: -contentOperationType <value> -content/excludepath '<path value>' |
content/includepath | Location of the content to be included
in the backup from the excluded list. This parameter must be used
along with the contentOperationType parameter, for example: -contentOperationType <value> -content/includepath '<path value>' |
contentOperationType | Modification type. Valid values are
|
The following examples show how to add a parameter for a command:
Adding Content |
To update the location for the subclient content, add the 'path'
parameter to the following command: qoperation execute -af update_subclient_add_template.xml -appName 'File System' -clientName client1 -backupSetName backupset1 -subclientName subclient1 -contentOperationType ADD -content/path '/etc' |
Setting a Storage Policy |
To assign a storage policy to a subclient, add the 'storagePolicyName'
parameter to the following command: qoperation execute -af update_subclient_add_template.xml -appName 'File System' -clientName client1 -backupSetName backupset1 -subclientName subclient1 -storagePolicyName sp1 |
For detailed information on the Subclient parameters see Subclient Properties.
qoperation execute –af sched_policy_association_template.xml –taskName mypolicy
Parameter | Description of Parameter Values |
taskName | Name of the Schedule Policy to be associated. |
The following table describes the properties that can be configured from the agent, backup set and subclient levels.
Option | Description | Related topics |
Preserving the File Access Time |
This option allows you to prevent the file access
time from being changed as a result of running data protection
operations on the client. When this option is selected, the file access
time will be preserved.
|
|
Change Storage Policies |
You can modify the storage policies in any of the following situations.
You can change the storage policies from the subclient level.
|
Refer to Storage Policies. |
Rename a Backup Set or Subclient |
You can rename backup sets and subclients. Renaming BackupSet:
Renaming subclient:
|
|
Data Transfer Options |
You can efficiently configure the available resources for transferring data secured
by data protection operations from the subclient level. This includes the following:
You can configure the data transfer options.
|
Refer to Data Compression and Network Bandwidth Throttling. |
View Data Paths |
You can view the data paths associated with the primary
storage policy copy of the selected storage policy or incremental storage
policy. You can also modify the data paths including their priority from
the subclient level.
|
|
Configure Activity Control |
You can enable backup and restore operations from the agent and subclient level.
However, you can enable restore operations only from the agent level.
|
Refer to Activity Control. |
Configure User Security |
You can configure user security from the agent or subclient
level.
You can perform the following functions:
|
Refer to User Administration and Security. |
Enable/Disable Data Encryption |
You can enable data encryption from the subclient level. Encryption must be enabled at the client level prior to configuring any
instances residing on that client.
|
Refer to Data Encryption. |
View Software Version and Installed Updates |
The Version tab, at the Agent level displays the
software version and post-release service packs and updates installed for
the component.
|
|
CommCell Configuration Report |
The CommCell Configuration Report provides the properties of the
CommServe, MediaAgents, clients, agents, SRM agents, subclients, and
storage policies within the CommCell based on the selected filter
criteria.
|
Refer to CommCell Configuration. |
When you delete an instance or backupset, the associated data is logically deleted and you can no longer access the corresponding data from CommCell Console for recovery purposes. Refer to the troubleshooting article on Recovering Data Associated with Deleted Clients and Storage Policies for information on how to recover data if you accidentally delete an entity. |
You need to uninstall or DeConfigure the agent software from the client computer before deleting from CommCell Browser. After you delete the client software, you can either leave the corresponding data intact for appropriate action or you can remove the data immediately. If you choose to remove the data immediately, you must delete the agent from the CommCell Browser. If you delete the agent, all of the agent's data is irretrievably lost.
This operation will permanently delete the data backed up from this level and it cannot be restored.
Consider the following before deleting a Backup Set:
Click No to cancel the deletion and retain the Backupset, or click Yes to continue the deletion.
Consider the following before deleting a subclient:
Click No to cancel the deletion and retain the subclient, or click Yes to continue the deletion.
Apple Double Encoded Support, Classic Scan, Ctime, Hard Links, Hole, Locale for Non-ASCII character, Locked File, NFS Mount, mount point, Mtime, Raw device, Sparse File, Symbolic Link