New Ranks & Badges For The Community!
Notice something different? The ranks and associated badges have gone "Star Fleet". See what they all mean HERE

Cloud (Azure) Gateway support for Data Protector 10.10, running on RHEL 7.x.

Idea ID 1681644

Cloud (Azure) Gateway support for Data Protector 10.10, running on RHEL 7.x.

Hello,

We have been using the Cloud (Azure) gateway to perform backups directly to Azure storage.  It seems to be working quite well for smaller backups, but every now and then, for large backups, we see an error that appears to be a communication interruption with Azure.  The exact error details are:

[Warning] From: BMA-NDMP@ucwdpbs001.wilm.ppdi.com "DP_Azure_Cloud_gw1 [GW 5233:0:541170802490011539]" Time: 1/14/2019 1:06:03 PM

Error in communication with cloud [UNKNOWN EXCEPTION], retrying.

It looks like data is still being sent to Azure as the 'counters' keep increasing, ie. Done - 245GB and counting, or Done (%) - 36%...37%...38%...etc.

After a while though, if this error occurs again, one or two more times, we then see the following errors:

[Major] From: BMA-NDMP@ucwdpbs001.wilm.ppdi.com "DP_Azure_NixOracle_Full_Clou_gw1 [GW 8923:2:541170802490011539]" Time: 1/13/2019 4:27:22 PM

[90:51] \\dpcloudtier.blob.core.windows.net\dp-nixoracle-full-backups/b9b411ac_5c3abdb5_7880_3323

 

Cannot write to device (Invalid arguments.)

 

[Major] From: BMA-NDMP@ucwdpbs001.wilm.ppdi.com "DP_Azure_NixOracle_Full_Clou_gw1 [GW 8923:2:541170802490011539]" Time: 1/13/2019 4:27:22 PM

[90:64] Cannot unload exchanger medium (Invalid arguments.)

After which the Media Agent is aborted, the medium is unloaded from the slot and the job stops, as "Completed/Failures".  Again, smaller backup jobs do not seem to have an issue and complete successfully.

I opened a case with tech. support and the first thing they stated was that the Platform Support Matrix shows that our installation (Cell Manager, DP 10.10 on RHEL 7.4) does not support the "Cloud (Azure) Device" support matrix.

I'm trying to request full support of the "Cloud (Azure) Device" for DP 10.10 running on RHEL 7.x).

Thanks,

Sven

13 Comments
Cadet 1st Class
Cadet 1st Class

Hi,

Thanks for submitting your request. I am checking on the supportability of this configuration, will revert back shortly.

-Sheetal

Micro Focus Expert
Micro Focus Expert

Hi Sven.

     While the support situation is sorted out, you can attempt to increase the number of retries that DP makes in case of errors. To do so, set this omnirc variable  OB2_CLOUDDEV_MAXRETRIES - to a high value on the gateway host. The default value is 5, so you could try 15-20, and tune it higher or lower based on your test results.

Regards,

Shishir

Cadet 1st Class
Cadet 1st Class
Status changed to: Waiting for Votes
 
Micro Focus Expert
Micro Focus Expert
Status changed to: Delivered

@Sven Wells 

Azure Gateway support on RHEL 7.x is available in current DP 10.x versions. See DocOps.

Cadet 3rd Class
Cadet 3rd Class

we are facing the same issue when backing up large object that exceed azure blob size of 75 GB, is this solved on later versions? we are on 10.40.

 

This is not related to the azure device support as for us is happening on windows 2012 also.

Micro Focus Expert
Micro Focus Expert

Hi @Protera.

     There haven't been specific changes to DP's Azure support in recent releases. The size of Azure blobs shouldn't directly affect the backup, apart from longer time duration of the transfer. A longer transfer of course increases the probability of hitting a network issue, and setting OB2_CLOUDDEV_MAXRETRIES to value higher than 5 might help in such cases.

Thanks,

Shishir

Cadet 3rd Class
Cadet 3rd Class

but there are not retries, backup is failing at almost on the end and when i see the blob on azure is hitting the limit of 75 GB, surprised that no one else is seeing this issue.

Cadet 3rd Class
Cadet 3rd Class

we have backups that are longer running achieving more compression per object that run without issues, but when reaching the 75 GB it fails.

always the same error.

[Critical]
[90:56]  Cannot close device (Invalid arguments.)

[Major]
[90:64] Cannot unload exchanger medium (Invalid arguments.)

Micro Focus Expert
Micro Focus Expert
Hello.

We'd tested backups larger than single blobs and hadn't run into problems at the time. Perhaps it might be worth checking this again. You can also consider raising a support ticket, after generating debugs using circular logging to control disk usage.

Thanks,

Shishir


Cadet 3rd Class
Cadet 3rd Class

yes i have a ticket running, the problem is for every test you have to wait some hours.

 

i will try to enable the debug and check again.

The opinions expressed above are the personal opinions of the authors, not of Micro Focus. By using this site, you accept the Terms of Use and Rules of Participation. Certain versions of content ("Material") accessible here may contain branding from Hewlett-Packard Company (now HP Inc.) and Hewlett Packard Enterprise Company. As of September 1, 2017, the Material is now offered by Micro Focus, a separately owned and operated company. Any reference to the HP and Hewlett Packard Enterprise/HPE marks is historical in nature, and the HP and Hewlett Packard Enterprise/HPE marks are the property of their respective owners.