DP9: [61:1002] Inactivity timeout on CONFIGURATION object

We do currently face some problems on different jobs where we are running a backup of the complete machine (see the error below):

If I unselect the CONFIGURATION object the job runs without any error. If I create an additional job with ONLY the CONFIGURATION object this one also completes without error. As soon as it is within one job we see the following error:

[Major] From: BSM@xxx.yyy.zzz "XXX" Time: 28.09.2016 03:20:36
[61:1002] The BMA named "XXX [GW 3836:1:4014134147542123963]" on host xxx.yyy.zzz
reached its inactivity timeout of 8400 seconds.
The agent on host will be shutdown.

[Major] From: BSM@xxx.yyy.zzz "XXX" Time: 28.09.2016 03:21:15
[61:1002] The BMA named "XXX [GW 3836:2:4014134147542123963]" on host xxx.yyy.zzz
reached its inactivity timeout of 8400 seconds.
The agent on host will be shutdown.

We're currently running DP 9.07_110, but we did see this already in earlier DP9 versions.

Any suggestions?

Parents
  • Hi,

    There is multiple reasons why this could happen. Please provide entire session output and your backup specification.

    There are omnirc variables that can be modified and BSM will wait longer for BMA to react, but I would suggest that we track down what is the reason behind this.

    Did you check VSS snapshot setting creation on your APP host. Or maybe there is something that can be done with concurrency…

     Regards AlesKol

Reply
  • Hi,

    There is multiple reasons why this could happen. Please provide entire session output and your backup specification.

    There are omnirc variables that can be modified and BSM will wait longer for BMA to react, but I would suggest that we track down what is the reason behind this.

    Did you check VSS snapshot setting creation on your APP host. Or maybe there is something that can be done with concurrency…

     Regards AlesKol

Children
  • Here is the complete output of the session and below the configuration of the job:

    [Normal] From: BSM@CellManagerNAME "xxxJOBNAME"  Time: 28.09.2016 01:00:07
     Backup session 2016/09/28-6 started.

    [Normal] From: BMA@CellManagerNAME "xxxGATEWAY [GW 3836:2:4014134147542123963]"  Time: 28.09.2016 01:00:13
     STARTING Media Agent "xxxGATEWAY [GW 3836:2:4014134147542123963]"

    [Normal] From: BMA@CellManagerNAME "xxxGATEWAY [GW 3836:0:4014134147542123963]"  Time: 28.09.2016 01:00:13
     STARTING Media Agent "xxxGATEWAY [GW 3836:0:4014134147542123963]"

    [Normal] From: BMA@CellManagerNAME "xxxGATEWAY [GW 3836:1:4014134147542123963]"  Time: 28.09.2016 01:00:13
     STARTING Media Agent "xxxGATEWAY [GW 3836:1:4014134147542123963]"

    [Normal] From: BMA@CellManagerNAME "xxxGATEWAY [GW 3836:2:4014134147542123963]"  Time: 28.09.2016 01:00:14
     Loading medium from slot \\99.99.99.99\StoreNAME\aa80c40a_57eaf9fd_10b0_179b to device xxxGATEWAY [GW 3836:2:4014134147542123963]

    [Normal] From: BMA@CellManagerNAME "xxxGATEWAY [GW 3836:0:4014134147542123963]"  Time: 28.09.2016 01:00:14
     Loading medium from slot \\99.99.99.99\StoreNAME\aa80c40a_57eaf9fd_10b0_179c to device xxxGATEWAY [GW 3836:0:4014134147542123963]

    [Normal] From: BMA@CellManagerNAME "xxxGATEWAY [GW 3836:1:4014134147542123963]"  Time: 28.09.2016 01:00:14
     Loading medium from slot \\99.99.99.99\StoreNAME\aa80c40a_57eaf9fd_10b0_179d to device xxxGATEWAY [GW 3836:1:4014134147542123963]

    [Normal] From: BMA@CellManagerNAME "xxxGATEWAY [GW 3836:2:4014134147542123963]"  Time: 28.09.2016 01:00:15
     Using interface path: \\99.99.99.99\StoreNAME\aa80c40a_57eaf9fd_10b0_179b

    [Normal] From: BMA@CellManagerNAME "xxxGATEWAY [GW 3836:0:4014134147542123963]"  Time: 28.09.2016 01:00:15
     Using interface path: \\99.99.99.99\StoreNAME\aa80c40a_57eaf9fd_10b0_179c

    [Normal] From: BMA@CellManagerNAME "xxxGATEWAY [GW 3836:1:4014134147542123963]"  Time: 28.09.2016 01:00:15
     Using interface path: \\99.99.99.99\StoreNAME\aa80c40a_57eaf9fd_10b0_179d

    [Normal] From: VBDA@ClientNAME "ClientNAME [/E]"  Time: 28.09.2016 01:00:20
     STARTING Disk Agent for ClientNAME:/E "ClientNAME [/E]".

    [Normal] From: VBDA@ClientNAME "ClientNAME [/C]"  Time: 28.09.2016 01:00:20
     STARTING Disk Agent for ClientNAME:/C "ClientNAME [/C]".

    [Normal] From: VBDA@ClientNAME "ClientNAME [/CONFIGURATION]"  Time: 28.09.2016 01:00:21
     STARTING Disk Agent for ClientNAME:/CONFIGURATION "ClientNAME [/CONFIGURATION]".

    [Normal] From: VBDA@ClientNAME "ClientNAME [/E]"  Time: 28.09.2016 01:01:46
     VSS Writer 'System Writer':Component 'System Files' successfully added in the snapshot.

    [Normal] From: VBDA@ClientNAME "ClientNAME [/E]"  Time: 28.09.2016 01:01:46
     VSS option was specified. Attempting to create snapshot.

    [Normal] From: VBDA@ClientNAME "ClientNAME [/E]"  Time: 28.09.2016 01:04:29
     Clearing archive flags is not applicable with Volume Shadow Copy backup.

    [Normal] From: VBDA@ClientNAME "ClientNAME [/C]"  Time: 28.09.2016 01:04:45
     VSS Writer 'Task Scheduler Writer':Component 'TasksStore' successfully added in the snapshot.

    [Normal] From: VBDA@ClientNAME "ClientNAME [/C]"  Time: 28.09.2016 01:04:45
     VSS Writer 'VSS Metadata Store Writer':Component 'WriterMetadataStore' successfully added in the snapshot.

    [Normal] From: VBDA@ClientNAME "ClientNAME [/C]"  Time: 28.09.2016 01:04:45
     VSS Writer 'Performance Counters Writer':Component 'PerformanceCounters' successfully added in the snapshot.

    [Normal] From: VBDA@ClientNAME "ClientNAME [/C]"  Time: 28.09.2016 01:04:45
     VSS Writer 'System Writer':Component 'System Files' successfully added in the snapshot.

    [Normal] From: VBDA@ClientNAME "ClientNAME [/C]"  Time: 28.09.2016 01:04:45
     VSS Writer 'IIS Config Writer':Component 'IISCONFIG' successfully added in the snapshot.

    [Normal] From: VBDA@ClientNAME "ClientNAME [/C]"  Time: 28.09.2016 01:04:45
     VSS Writer 'IIS Metabase Writer':Component 'IISMETABASE' successfully added in the snapshot.

    [Normal] From: VBDA@ClientNAME "ClientNAME [/C]"  Time: 28.09.2016 01:04:45
     VSS Writer 'ASR Writer':Component 'BCD' successfully added in the snapshot.

    [Normal] From: VBDA@ClientNAME "ClientNAME [/C]"  Time: 28.09.2016 01:04:45
     VSS Writer 'WMI Writer':Component 'WMI' successfully added in the snapshot.

    [Normal] From: VBDA@ClientNAME "ClientNAME [/C]"  Time: 28.09.2016 01:04:45
     VSS Writer 'Registry Writer':Component 'Registry' successfully added in the snapshot.

    [Normal] From: VBDA@ClientNAME "ClientNAME [/C]"  Time: 28.09.2016 01:04:45
     VSS Writer 'COM REGDB Writer':Component 'COM REGDB' successfully added in the snapshot.

    [Normal] From: VBDA@ClientNAME "ClientNAME [/C]"  Time: 28.09.2016 01:04:45
     VSS option was specified. Attempting to create snapshot.

    [Normal] From: VBDA@ClientNAME "ClientNAME [/C]"  Time: 28.09.2016 01:07:23
     Clearing archive flags is not applicable with Volume Shadow Copy backup.

    [Normal] From: VBDA@ClientNAME "ClientNAME [/CONFIGURATION]"  Time: 28.09.2016 01:11:53
     Successfully collected system recovery data.

    [Normal] From: VBDA@ClientNAME "ClientNAME [/CONFIGURATION]"  Time: 28.09.2016 01:11:58
     Analyzing system storage.

    [Normal] From: VBDA@ClientNAME "ClientNAME [/CONFIGURATION]"  Time: 28.09.2016 01:12:04
     Analyzing system hardware.

    [Normal] From: VBDA@ClientNAME "ClientNAME [/CONFIGURATION]"  Time: 28.09.2016 01:13:07
     Analyzing network configuration.

    [Normal] From: VBDA@ClientNAME "ClientNAME [/CONFIGURATION]"  Time: 28.09.2016 01:13:07
     Initiating the creation of the Recovery Set archive.

    [Normal] From: VBDA@ClientNAME "ClientNAME [/CONFIGURATION]"  Time: 28.09.2016 01:13:07
     Storing ASR/BCD configuration data into the Recovery Set archive.

    [Normal] From: VBDA@ClientNAME "ClientNAME [/CONFIGURATION]"  Time: 28.09.2016 01:15:59
     Storing system license data into the Recovery Set archive.

    [Normal] From: VBDA@ClientNAME "ClientNAME [/CONFIGURATION]"  Time: 28.09.2016 01:15:59
     Storing network support files into the Recovery Set archive.

    [Normal] From: VBDA@ClientNAME "ClientNAME [/CONFIGURATION]"  Time: 28.09.2016 01:16:02
     Storing additional VSS writer data into the Recovery Set archive.

    [Normal] From: VBDA@ClientNAME "ClientNAME [/CONFIGURATION]"  Time: 28.09.2016 01:18:36
     Storing driver installations into the Recovery Set archive.

    [Normal] From: VBDA@ClientNAME "ClientNAME [/CONFIGURATION]"  Time: 28.09.2016 01:18:39
     Verifying/Storing system partitions.

    [Normal] From: VBDA@ClientNAME "ClientNAME [/CONFIGURATION]"  Time: 28.09.2016 01:18:39
     Storing Recovery Info data into the Recovery Set archive.

    [Normal] From: VBDA@ClientNAME "ClientNAME [/CONFIGURATION]"  Time: 28.09.2016 01:18:47
     Storing hardware info into the Recovery Set archive.

    [Normal] From: VBDA@ClientNAME "ClientNAME [/CONFIGURATION]"  Time: 28.09.2016 01:18:47
     Storing network info into the Recovery Set archive.

    [Normal] From: VBDA@ClientNAME "ClientNAME [/CONFIGURATION]"  Time: 28.09.2016 01:18:47
     Storing phase 0 log file into the Recovery Set archive.

    [Normal] From: VBDA@ClientNAME "ClientNAME [/CONFIGURATION]"  Time: 28.09.2016 01:18:47
     Starting the verification of the Recovery Set archive.

    [Normal] From: VBDA@ClientNAME "ClientNAME [/CONFIGURATION]"  Time: 28.09.2016 01:18:50
     Successfully collected Automatic DR data.

    [Normal] From: BSM@CellManagerNAME "xxxJOBNAME"  Time: 28.09.2016 01:18:53

     Server-side Deduplication Statistics for ClientNAME:/CONFIGURATION "ClientNAME [/CONFIGURATION]".
     Using device: "xxxGATEWAY [GW 3836:0:4014134147542123963]@CellManagerNAME":
      Mbytes Total: .................       891 MB
      Mbytes Written to Disk: .......        10 MB
      Deduplication Ratio: ..........      89.1 : 1

    [Normal] From: VBDA@ClientNAME "ClientNAME [/CONFIGURATION]"  Time: 28.09.2016 01:18:55
     Backup Profile:

      Run Time ........... 0:08:45
      Backup Speed ....... 1,67 MB/s

    [Normal] From: VBDA@ClientNAME "ClientNAME [/CONFIGURATION]"  Time: 28.09.2016 01:18:55
     Filesystem Statistics:

      Directories ........      1057
      Regular files ......      2789
      ------------------------------
      Objects Total ......      3846
      Total Size ......... 874,67 MB

    [Normal] From: VBDA@ClientNAME "ClientNAME [/CONFIGURATION]"  Time: 28.09.2016 01:19:18
     COMPLETED Disk Agent for ClientNAME:/CONFIGURATION "ClientNAME [/CONFIGURATION]".

    [Normal] From: BMA@CellManagerNAME "xxxGATEWAY [GW 3836:0:4014134147542123963]"  Time: 28.09.2016 01:19:21
     Unloading medium to slot \\99.99.99.99\StoreNAME\aa80c40a_57eaf9fd_10b0_179c from device xxxGATEWAY [GW 3836:0:4014134147542123963]

    [Normal] From: BMA@CellManagerNAME "xxxGATEWAY [GW 3836:0:4014134147542123963]"  Time: 28.09.2016 01:19:21
     COMPLETED Media Agent "xxxGATEWAY [GW 3836:0:4014134147542123963]"

    [Major] From: BSM@CellManagerNAME "xxxJOBNAME"  Time: 28.09.2016 03:20:36
    [61:1002]   The BMA named "xxxGATEWAY [GW 3836:1:4014134147542123963]" on host CellManagerNAME
     reached its inactivity timeout of 8400 seconds.
     The agent on host will be shutdown.

    [Major] From: BSM@CellManagerNAME "xxxJOBNAME"  Time: 28.09.2016 03:21:15
    [61:1002]   The BMA named "xxxGATEWAY [GW 3836:2:4014134147542123963]" on host CellManagerNAME
     reached its inactivity timeout of 8400 seconds.
     The agent on host will be shutdown.

    [Normal] From: VBDA@ClientNAME "ClientNAME [/E]"  Time: 28.09.2016 03:21:28
     Filesystem Statistics:

      Directories ........     22500
      Regular files ......         0
      ------------------------------
      Objects Total ......         0
      Total Size .........   0,00 KB

    [Normal] From: VBDA@ClientNAME "ClientNAME [/E]"  Time: 28.09.2016 03:21:46
     ABORTED Disk Agent for ClientNAME:/E "ClientNAME [/E]".

    [Major] From: BSM@CellManagerNAME "xxxJOBNAME"  Time: 28.09.2016 03:31:19
    [61:1002]   The VBDA named "ClientNAME [/C]" on host ClientNAME
     reached its inactivity timeout of 600 seconds.
     The agent on host will be shutdown.

    [Normal] From: BSM@CellManagerNAME "xxxJOBNAME"  Time: 28.09.2016 03:31:52

     Backup Statistics:
             
      Session Queuing Time (hours)         0,00       
      -------------------------------------------     
      Completed Disk Agents ........          1         
      Failed Disk Agents ...........          2         
      Aborted Disk Agents ..........          0         
      -------------------------------------------     
      Disk Agents Total  ...........          3         
      ===========================================     
      Completed Media Agents .......          1         
      Failed Media Agents ..........          2         
      Aborted Media Agents .........          0         
      -------------------------------------------     
      Media Agents Total  ..........          3         
      ===========================================     
      Throttled Gateways ...........          0         
      Gateways Total ...............          1         
      ===========================================     
      Overall Deduplication Ratio ..     89.1 : 1           
      ===========================================     
      Mbytes Total .................     891 MB       
      Used Media Total .............          1         
      Disk Agent Errors Total ......          0   

     


     

    DATALIST "xxxJOBNAME"
    DYNAMIC 1 5
    DEFAULTS
    {
     FILESYSTEM
     {
      -profile
      -storedrim
      -vss  fallback
      -no_async

     }  -protect weeks 4
     RAWDISK
     {

     }
    }

    DEVICE "xxxGATEWAY"
    {
     -pool "xxxMediaPool"
    }

    HOST "ClientNAME" ClientNAME
    {
     -nthlink
    }

    Let me know if you need any further information.

  • Verified Answer

    Hi,

    From session output we can see  that BMA did not connect to BSM in specified period of time.  Now this can be resolved multiple ways.

     * If these backup are NOT meant to be used for DR, then omnirc OB2NOTREEWALK can be used. This will decrease initial time for BMA to connect to SM, at certain cost -> please reed description.

     * SmMaIdleTimeout is global option than will force BSM to wait longer for BMA activity.

     

    May I ask, how long does the “only C and E drive” backup take, maybe you are already on the edge of 8400 seconds, and configuration backup just tips it over the edge. As said, there are multiple solutions, depending on what would you like to achieve with backup.

    Regards AlesKol

  • maybe look to reduce concurrency or move the order of CONFIGURATION object to the top of the spec. See how that goes...

  • maybe look to reduce concurrency or move the order of CONFIGURATION object to the top of the spec. See how that goes...

  • Make sure to untick Statistic Information in the backup spec (in addition to disabling other tree walk with OB2NOTREEWALK=1 in omnirc).

    Please use the Accept Solution button next to my post and assign a KUDO (thumbs up icon) if this works for you.

    Regards,
    Sebastian Koehler