This repository is a collection of scripts aimed at automating storage functions with Pure Storage FlashArray and SAP HANA.
The following functionality can be achieved with the latest versions of these scripts :
- Create application consistent storage snapshots for SAP HANA systems on FlashArray
- Create crash consistent storage snapshots for SAP HANA systems on FlashArray
- Recover from application consistent data snapshots for SAP HANA Scale Up systems on FlashArray
- Automate the application of best practices for SAP HANA deployments on Red Hat Enterprise Linux and SUSE Enterprise Linux
SAP HANA systems deployed on VMware , using virtual volumes (vVols) can have application consistent storage snapshots created (Scale Up and Scale Out) and recovered(Scale Up only) with both Powershell and Python scripts.
If a user other than root is specified to be used for connections to the operating system , then the following needs to be added using visudo - ALL=NOPASSWD: /sbin/fsfreeze,/usr/bin/rescan-scsi-bus.sh
To create a storage snapshot a user needs to be present in the SystemDB with the correct permissions. All connectivity to SAP HANA is done by communicating with the SystemDB on port 30013. Additional information on the required roles can be found in Authorizations for backup and Recovery.
The Python scripts for SAP HANA have now been built into standalone packages using pyinstaller and then further built into an rpm , known as the Pure Storage SAP HANA Toolkit for easy distribution for multiple SAP HANA deployments. For further information on how to use the package and its contents see Using the Pure Storage SAP HANA Toolkit.
Create an application consistent storage snapshot for Scale Up systems
A volume snapshot is only created for the SAP HANA data volume. Log backups are used to roll the database forward during the recovery process.
Location - Powershell/Snapshot Creation/New-ScaleUpStorageSnapshot.ps1
New-StorageSnapshot -HostAddress <IP address of host> -InstanceNumber <InstanceNumber (00)> -DatabaseName <Database Name (HN1)> -DatabaseUser <DBUser> -OperatingSystemUser <OS-User> -PureFlashArrayAddress <Pure FlashArray IP or hostname> -PureFlashArrayUser <pure FA User> -DatabasePort <Port>
Create a crash consistent storage snapshot for Scale Up systems
A volume snapshot is created for both the data and log volumes for the SAP HANA Scale Up system.
Location - Powershell/Snapshot Creation/New-ScaleUpStorageSnapshot.ps1
New-StorageSnapshot -HostAddress <IP address of host> -InstanceNumber <Instance Number (00)> -DatabaseName <Database Name (HN1)> -DatabaseUser <DBUser> -OperatingSystemUser <OS-User> -PureFlashArrayAddress <Pure FlashArray IP or hostname> -PureFlashArrayUser <pure FA User> -DatabasePort <Port> -CrashConsistentSnapshot
Create an application consistent storage snapshot for Scale Up systems on VMware with vVols
A volume snapshot is only created for the SAP HANA data volume. Log backups are used to roll the database forward during the recovery process. See blog post for more details.
Location - Powershell/Snapshot Creation/New-ScaleUpStorageSnapshot.ps1
New-StorageSnapshot -HostAddress <IP address of host> -InstanceNumber <InstanceNumber (00)> -DatabaseName <Database Name (HN1)> -DatabaseUser <DBUser> -OperatingSystemUser <OS-User> -PureFlashArrayAddress <Pure FlashArray IP or hostname> -PureFlashArrayUser <pure FA User> -DatabasePort <Port> -vCenterAddress <vCenter hostname or IP> -vCenterUser <vCenter User> -vCenterPassword <vCenter users password>
Create an application consistent storage snapshot for Scale Out systems
A volume snapshot is only created for the SAP HANA data volume on each worker host. Log backups are used to roll the database forward during the recovery process. See blog post for more details.
Location - Powershell/Snapshot Creation/New-ScaleUpStorageSnapshot.ps1
New-StorageSnapshot -HostAddress <IP address of host> -InstanceNumber <Instance Number (00)> -DatabaseName <Database Name (HN1)> -DatabaseUser <DBUser> -OperatingSystemUser <OS-User> -PureFlashArrayAddress <Pure FlashArray IP or hostname> -PureFlashArrayUser <pure FA User> -DatabasePort <Port> -DomainName <Name of domain in FQDN>
Create a crash consistent storage snapshot for Scale Out systems
A volume snapshot is created for both the data and log volumes on each worker for the SAP HANA Scale Out system.
Location - Powershell/Snapshot Creation/New-ScaleOutStorageSnapshot.ps1
New-StorageSnapshot -HostAddress <IP address of host> -InstanceNumber <Instance Number (00)> -DatabaseName <Database Name (HN1)> -DatabaseUser <DBUser> -OperatingSystemUser <OS-User> -PureFlashArrayAddress <Pure FlashArray IP or hostname> -PureFlashArrayUser <pure FA User> -DatabasePort <Port> -DomainName <Name of domain in FQDN> -crashconsistent
Recover from an application consistent storage snapshot for Scale Up systems (copy to new volume)
Running this script with the arguments will bring up an interactive ASCII menu , allowing for a specific point in time data snapshot to be rolled back to. The script will also check that the data snapshot is still present on the array. This script assumes the snapshot is on the same array as the running SAP HANA data volumes. This will also copy the snapshot to an entirely new volume.
Location - Powershell/Snapshot Creation/Restore-ScaleUpStorageSnapshot.ps1
Restore-StorageSnapshot -HostAddress <IP address of host> -InstanceNumber <InstanceNumber (00)> -DatabaseName <Database Name (HN1)> -DatabaseUser <DBUser> -OperatingSystemUser <OS-User> -PureFlashArrayAddress <Pure FlashArray IP or hostname> -PureFlashArrayUser <pure FA User> -DatabasePort <Port>
Recover from an application consistent storage snapshot for Scale Up systems (overwriting existing volume)
Running this script with the arguments will bring up an interactive ASCII menu , allowing for a specific point in time data snapshot to be rolled back to. The script will also check that the data snapshot is still present on the array. This script assumes the snapshot is on the same array as the running SAP HANA data volumes.This will overwrite the existing volume with the snapshot.
Location - Powershell/Snapshot Creation/Restore-ScaleUpStorageSnapshot.ps1
Restore-StorageSnapshot -HostAddress <IP address of host> -InstanceNumber <InstanceNumber (00)> -DatabaseName <Database Name (HN1)> -DatabaseUser <DBUser> -OperatingSystemUser <OS-User> -PureFlashArrayAddress <Pure FlashArray IP or hostname> -PureFlashArrayUser <pure FA User> -DatabasePort <Port> -OverwriteVolume
Recover from an application consistent storage snapshot for Scale Up systems on VMware using vVols (overwriting existing volume)
Running this script with the arguments will bring up an interactive ASCII menu , allowing for a specific point in time data snapshot to be rolled back to. The script will also check that the data snapshot is still present on the array. This script assumes the snapshot is on the same array as the running SAP HANA data volumes.This will overwrite the existing volume with the snapshot.
Location - Powershell/Snapshot Creation/Restore-ScaleUpStorageSnapshot.ps1
Restore-StorageSnapshot -HostAddress <IP address of host> -InstanceNumber <InstanceNumber (00)> -DatabaseName <Database Name (HN1)> -DatabaseUser <DBUser> -OperatingSystemUser <OS-User> -PureFlashArrayAddress <Pure FlashArray IP or hostname> -PureFlashArrayUser <pure FA User> -DatabasePort <Port> -vCenterAddress <vCenter hostname or IP> -vCenterUser <vCenter User> -vCenterPassword
All scripts are created to support Python 3.6 and later. The following packages are required for the scripts :
- argparse
- paramkio
- regex
- Datetime
- json
- io
- pyVmomi
- urllib3
- requests
The SAP HANA Python library also needs to be installed. This process is a good reference to use for the installation of the HANA client and the python library.
It is possible to exclude any password field from the argument list. If a password is excluded a prompt will be shown for it.
Create an application consistent storage snapshot for Scale Up systems (Bare metal deployments)
A volume snapshot is only created for the SAP HANA data volume. Log backups are used to roll the database forward during the recovery process. See blog post for more details.
Location - Python/Snapshot Creation/create_scaleup_snapshot.py
saphana_create_snapshot.py --hostaddress<Host Address of SAP HANA system> --instancenumber <instancenumber> --databaseuser <systemdb user with permissions to create storage snapshot> --databasepassword <password of databaseuser> --operatingsystemuser <user with permissions to freeze and unfreeze filesystems and query device information> --operatingsystempassword <password of operatingsystemuser> --flasharray <flasharray IP or FQDN of the SAP HANA block storage provider> --flasharrayuser <flasharrayuser> --flasharraypassword <flasharraypassword>
Create a crash consistent storage snapshot for Scale Up systems (Bare metal deployments)
A volume snapshot is created for both the data and log volumes for the SAP HANA Scale Up system. The snapshot is created for volumes in a protection group.
Location - Python/Snapshot Creation/create_scaleup_snapshot.py
saphana_create_snapshot.py --hostaddress<Host Address of SAP HANA system> --instancenumber <instancenumber> ---databaseuser <systemdb user with permissions to create storage snapshot> --databasepassword <password of databaseuser> --operatingsystemuser <user with permissions to freeze and unfreeze filesystems and query device information> --operatingsystempassword <password of operatingsystemuser> --flasharray <flasharray IP or FQDN of the SAP HANA block storage provider> --flasharrayuser <flasharrayuser> --flasharraypassword <flasharraypassword> --crashconsistent
Create an application consistent storage snapshot for Scale Up systems (VMware vVol deployments)
A volume snapshot is only created for the SAP HANA data volume. Log backups are used to roll the database forward during the recovery process. See blog post for more details. The vCenter server will be connected to and the virtual disk matched to a block storage volume on FlashArray.
Location - Python/Snapshot Creation/create_scaleup_snapshot.py
saphana_create_snapshot.py --hostaddress<Host Address of SAP HANA system> --instancenumber <instancenumber> --databaseuser <systemdb user with permissions to create storage snapshot> --databasepassword <password of databaseuser> --operatingsystemuser <user with permissions to freeze and unfreeze filesystems and query device information> --operatingsystempassword <password of operatingsystemuser> --flasharray <flasharray IP or FQDN of the SAP HANA block storage provider> --flasharrayuser <flasharrayuser> --flasharraypassword <flasharraypassword> --vcenteraddress --vcenteruser <a user with access to the vCenter server> --vcenterpassword <password of the vcenter user>
Create a crash consistent storage snapshot for Scale Up systems (VMware vVol deployments)
A volume snapshot is created for both the data and log volumes for the SAP HANA Scale Up system. The snapshot is created for volumes in a protection group. The vCenter server will be connected to and the virtual disk matched to a block storage volume on FlashArray.
Location - Python/Snapshot Creation/create_scaleup_snapshot.py
saphana_create_snapshot.py --hostaddress<Host Address of SAP HANA system> --instancenumber <instancenumber> --databaseuser <systemdb user with permissions to create storage snapshot> --databasepassword <password of databaseuser> --operatingsystemuser <user with permissions to freeze and unfreeze filesystems and query device information> --operatingsystempassword <password of operatingsystemuser> --flasharray <flasharray IP or FQDN of the SAP HANA block storage provider> --flasharrayuser <flasharrayuser> --flasharraypassword <flasharraypassword> --crashconsistent --vcenteraddress --vcenteruser <a user with access to the vCenter server> --vcenterpassword <password of the vcenter user>
Create an application consistent storage snapshot for Scale Out systems (Bare metal deployments)
A volume snapshot is only created for the SAP HANA data volume on each worker host. Log backups are used to roll the database forward during the recovery process. See blog post for more details.
Location - Python/Snapshot Creation/create_scaleout_snapshot.py
saphana_create_snapshot.py --hostaddress<Host Address of a worker node in the SAP HANA system> --instancenumber <instancenumber> --databaseuser <systemdb user with permissions to create storage snapshot> --databasepassword <password of databaseuser> --operatingsystemuser <user with permissions to freeze and unfreeze filesystems and query device information> --operatingsystempassword <password of operatingsystemuser> --flasharray <flasharray IP or FQDN of the SAP HANA block storage provider> --flasharrayuser <flasharrayuser> --flasharraypassword <flasharraypassword>
Create an application consistent storage snapshot for Scale Out systems (VMware vVol deployments)
A volume snapshot is only created for the SAP HANA data volume on each worker host. Log backups are used to roll the database forward during the recovery process. See blog post for more details.The vCenter server will be connected to and the virtual disk matched to a block storage volume on FlashArray.
Location - Python/Snapshot Creation/create_scaleout_snapshot.py
saphana_create_snapshot.py --hostaddress<Host Address of a worker node in the SAP HANA system> --instancenumber <instancenumber> --databaseuser <systemdb user with permissions to create storage snapshot> --databasepassword <password of databaseuser> --operatingsystemuser <user with permissions to freeze and unfreeze filesystems and query device information> --operatingsystempassword <password of operatingsystemuser> --flasharray <flasharray IP or FQDN of the SAP HANA block storage provider> --flasharrayuser <flasharrayuser> --flasharraypassword <flasharraypassword> --vcenteraddress --vcenteruser <a user with access to the vCenter server> --vcenterpassword <password of the vcenter user>
Create a crash consistent storage snapshot for Scale Out systems (Bare metal deployments)
A volume snapshot is created for both the data and log volumes on each worker for the SAP HANA Scale Out system. The snapshot is created for volumes in a protection group.
Location - Python/Snapshot Creation/create_scaleout_snapshot.py
saphana_create_snapshot.py --hostaddress<Host Address of a worker node in the SAP HANA system> --instancenumber <instancenumber> --databaseuser <systemdb user with permissions to create storage snapshot> --databasepassword <password of databaseuser> --operatingsystemuser <user with permissions to freeze and unfreeze filesystems and query device information> --operatingsystempassword <password of operatingsystemuser> --flasharray <flasharray IP or FQDN of the SAP HANA block storage provider> --flasharrayuser <flasharrayuser> --flasharraypassword <flasharraypassword> --crashconsistent
Create a crash consistent storage snapshot for Scale Out systems (VMware vVol deployments)
A volume snapshot is created for both the data and log volumes on each worker for the SAP HANA Scale Out system. The snapshot is created for volumes in a protection group. The vCenter server will be connected to and the virtual disk matched to a block storage volume on FlashArray.
Location - Python/Snapshot Creation/create_scaleout_snapshot.py
saphana_create_snapshot.py --hostaddress<Host Address of a worker node in the SAP HANA system> --instancenumber <instancenumber>--databaseuser <systemdb user with permissions to create storage snapshot> --databasepassword <password of databaseuser> --operatingsystemuser <user with permissions to freeze and unfreeze filesystems and query device information> --operatingsystempassword <password of operatingsystemuser> --flasharray <flasharray IP or FQDN of the SAP HANA block storage provider> --flasharrayuser <flasharrayuser> --flasharraypassword <flasharraypassword> --crashconsistent --vcenteraddress --vcenteruser <a user with access to the vCenter server> --vcenterpassword <password of the vcenter user>
Recover from an application consistent storage snapshot for Scale Up systems (copy to new volume) (Bare metal deployments)
Running this script with the arguments will bring up an interactive ASCII menu , allowing for a specific point in time data snapshot to be rolled back to. The script will also check that the data snapshot is still present on the array. This script assumes the snapshot is on the same array as the running SAP HANA data volumes. This will also copy the snapshot to an entirely new volume.
Location - Python/Snapshot Creation/recover_scaleup_snapshot.py
saphana_recoverfrom_snapshot.py --hostaddress<Host Address of SAP HANA system> --instancenumber <instancenumber> --databasename <databasename> --port<last two digits of the SAP HANA port> --databaseuser <systemdb user with permissions to create storage snapshot> --databasepassword <password of databaseuser> --operatingsystemuser <user with permissions to freeze and unfreeze filesystems and query device information> --operatingsystempassword <password of operatingsystemuser> --flasharray <flasharray IP or FQDN of the SAP HANA block storage provider> --flasharrayuser <flasharrayuser> --flasharraypassword <flasharraypassword>
Recover from an application consistent storage snapshot for Scale Up systems (overwrite existing volume) (Bare metal deployments)
Running this script with the arguments will bring up an interactive ASCII menu , allowing for a specific point in time data snapshot to be rolled back to. The script will also check that the data snapshot is still present on the array. This script assumes the snapshot is on the same array as the running SAP HANA data volumes. This will also overwrite the original SAP HANA Data Volume with the storage snapshot.
Location - Python/Snapshot Creation/recover_scaleup_snapshot.py
saphana_recoverfrom_snapshot.py --hostaddress<Host Address of SAP HANA system> --instancenumber <instancenumber> --databaseuser <systemdb user with permissions to create storage snapshot> --databasepassword <password of databaseuser> --operatingsystemuser <user with permissions to freeze and unfreeze filesystems and query device information> --operatingsystempassword <password of operatingsystemuser> --flasharray <flasharray IP or FQDN of the SAP HANA block storage provider> --flasharrayuser <flasharrayuser> --flasharraypassword <flasharraypassword> --overwritevolume
Recover from an application consistent storage snapshot for Scale Up systems (VMware vVol deployments)
Running this script with the arguments will bring up an interactive ASCII menu , allowing for a specific point in time data snapshot to be rolled back to. The script will also check that the data snapshot is still present on the array. This script assumes the snapshot is on the same array as the running SAP HANA data volumes. This will also overwrite the original SAP HANA Data Volume with the storage snapshot. The vCenter server will be connected to and the virtual disk matched to a block storage volume on FlashArray. All recovery scenarios with vVols must overwrite the existing volume with the storage snapshot.
Location - Python/Snapshot Creation/recover_scaleup_snapshot.py
saphana_recoverfrom_snapshot.py --hostaddress<Host Address of SAP HANA system> --instancenumber <instancenumber> --databaseuser <systemdb user with permissions to create storage snapshot> --databasepassword <password of databaseuser> --operatingsystemuser <user with permissions to freeze and unfreeze filesystems and query device information> --operatingsystempassword <password of operatingsystemuser> --flasharray <flasharray IP or FQDN of the SAP HANA block storage provider> --flasharrayuser <flasharrayuser> --flasharraypassword <flasharraypassword> --overwritevolume --vcenteraddress --vcenteruser <a user with access to the vCenter server> --vcenterpassword <password of the vcenter user>
- (PowerShell) POSH-SSH returns issues with Renci.SshNet - use the workaround proposed in the comment - darkoperator/Posh-SSH#284 (comment)