00000074.0065d07d 2434af59 Wed Sep 25 2019 15:35:09 -06:00 [kern_mgwd:info:2284] 0x81d1ea100: 86ffff0000000035: WARNING: job_manager::job_store: run:src/job_store_support.cc:568 Job Mgr: rdb_transaction history: OK/0 OK/297 OK/597 00000074.0065d0e4 2434d277 Wed Sep 25 2019 15:50:08 -06:00 [kern_mgwd:info:2284] 0x81d1ea100: 86ffff0000000035: WARNING: job_manager::job_store: run:src/job_store_support.cc:568 Job Mgr: rdb_transaction history: OK/0 OK/296 OK/596 Timeout/599 00000074.0065d138 2434f599 Wed Sep 25 2019 16:05:07 -06:00 [kern_mgwd:info:2284] 0x81d1ea100: 86ffff0000000035: WARNING: job_manager::job_store: run:src/job_store_support.cc:568 Job Mgr: rdb_transaction history: OK/0 Timeout/295 OK/595 Timeout/599 00000074.0065d177 24350a21 Wed Sep 25 2019 16:13:53 -06:00 [kern_mgwd:info:2284] 0x81d1e5100: 8603e80000296b04: WARNING: job_manager::job_sched: modify_schedule:src/job_sched.cc:800 job_manager::job_sched::modify_schedule: Calling set_scheduler on the record: Current schedule = 0x81c0eb740; New schedule = 0x81c0e4360 00000074.0065d1af 24351331 Wed Sep 25 2019 16:17:45 -06:00 [kern_mgwd:info:2284] ASUP_CLUSTER_INFO: Cache update complete. Next timeout is 86400 seconds 00000074.0065d1b3 243518ef Wed Sep 25 2019 16:20:12 -06:00 [kern_mgwd:info:2284] 0x81d1ea100: 86ffff0000000035: WARNING: job_manager::job_store: run:src/job_store_support.cc:568 Job Mgr: rdb_transaction history: Timeout/0 OK/300 OK/379 OK/600 Timeout/605 00000074.0065d22d 24353c17 Wed Sep 25 2019 16:35:12 -06:00 [kern_mgwd:info:2284] 0x81d1ea100: 86ffff0000000035: WARNING: job_manager::job_store: run:src/job_store_support.cc:568 Job Mgr: rdb_transaction history: Timeout/0 OK/300 OK/600 00000074.0065d284 24355f3f Wed Sep 25 2019 16:50:12 -06:00 [kern_mgwd:info:2284] 0x81d1ea100: 86ffff0000000035: WARNING: job_manager::job_store: run:src/job_store_support.cc:568 Job Mgr: rdb_transaction history: Timeout/0 OK/300 OK/600 00000074.0065d2e9 24358253 Wed Sep 25 2019 17:05:10 -06:00 [kern_mgwd:info:2284] 0x81d1ea100: 86ffff0000000035: WARNING: job_manager::job_store: run:src/job_store_support.cc:568 Job Mgr: rdb_transaction history: Timeout/0 OK/300 Timeout/598 00000074.0065d325 24358ded Wed Sep 25 2019 17:10:07 -06:00 [kern_mgwd:info:2284] 0x81d1e5100: 86ffff0000000025: WARNING: job_manager::job_store: claim_job_tx:src/job_rec_int.cc:581 claim_job: Attempted to claim a job that was already owned: 489d5bff-b80c-11e7-964b-00a098573067 owner: 339f7bf8-b7a1-11e7-964b-00a098573067 00000074.0065d326 24358ded Wed Sep 25 2019 17:10:07 -06:00 [kern_mgwd:info:2284] 0x81d1e5100: 86ffff0000000025: WARNING: job_manager::job_sched: _check_claimable:src/job_sched.cc:2225 UIID:19 UUID:489d5bff-b80c-11e7-964b-00a098573067 name:Network Recovery Job - 5min rc:3 _check_claimable: failed to claim jobs: 12 00000074.0065d329 243596cb Wed Sep 25 2019 17:13:54 -06:00 [kern_mgwd:info:2284] 0x81d1e6000: 86ffff0000000028: WARNING: job_manager::job_store: claim_job_tx:src/job_rec_int.cc:581 claim_job: Attempted to claim a job that was already owned: 179bd90b-b79e-11e7-9b07-00a09857ee8f owner: 339f7bf8-b7a1-11e7-964b-00a098573067 00000074.0065d32a 243596cb Wed Sep 25 2019 17:13:54 -06:00 [kern_mgwd:info:2284] 0x81d1e6000: 86ffff0000000028: WARNING: job_manager::job_sched: _check_claimable:src/job_sched.cc:2225 UIID:14 UUID:179bd90b-b79e-11e7-9b07-00a09857ee8f name:Vol Reaper rc:3 _check_claimable: failed to claim jobs: 12 00000074.0065d366 2435a58f Wed Sep 25 2019 17:20:12 -06:00 [kern_mgwd:info:2284] 0x81d1ea100: 86ffff0000000035: WARNING: job_manager::job_store: run:src/job_store_support.cc:568 Job Mgr: rdb_transaction history: OK/0 OK/300 Timeout/302 Timeout/602 00000074.0065d3d2 2435c8b7 Wed Sep 25 2019 17:35:12 -06:00 [kern_mgwd:info:2284] 0x81d1ea100: 86ffff0000000035: WARNING: job_manager::job_store: run:src/job_store_support.cc:568 Job Mgr: rdb_transaction history: OK/0 OK/300 OK/600 00000074.0065d426 2435ebdf Wed Sep 25 2019 17:50:12 -06:00 [kern_mgwd:info:2284] 0x81d1ea100: 86ffff0000000035: WARNING: job_manager::job_store: run:src/job_store_support.cc:568 Job Mgr: rdb_transaction history: OK/0 OK/300 Timeout/301 OK/601 00000074.0065d4b8 24360ef3 Wed Sep 25 2019 18:05:10 -06:00 [kern_mgwd:info:2284] 0x81d1ea100: 86ffff0000000035: WARNING: job_manager::job_store: run:src/job_store_support.cc:568 Job Mgr: rdb_transaction history: Timeout/0 Timeout/300 OK/600 00000074.0065d4f6 24362375 Wed Sep 25 2019 18:13:55 -06:00 [kern_mgwd:info:2284] 0x81d1e6000: 86ffff0000000028: WARNING: job_manager::job_store: claim_job_tx:src/job_rec_int.cc:581 claim_job: Attempted to claim a job that was already owned: 179bd90b-b79e-11e7-9b07-00a09857ee8f owner: 339f7bf8-b7a1-11e7-964b-00a098573067 00000074.0065d4f7 24362375 Wed Sep 25 2019 18:13:55 -06:00 [kern_mgwd:info:2284] 0x81d1e6000: 86ffff0000000028: WARNING: job_manager::job_sched: _check_claimable:src/job_sched.cc:2225 UIID:14 UUID:179bd90b-b79e-11e7-9b07-00a09857ee8f name:Vol Reaper rc:3 _check_claimable: failed to claim jobs: 12 00000074.0065d4f8 24362763 Wed Sep 25 2019 18:15:35 -06:00 [kern_mgwd:info:2284] 0x81d1e3d00: 8603e80000296c65: WARNING: job_manager::job_sched: process_modify:src/job_sched.cc:487 UIID:8845 UUID:b1db9f67-dff2-11e9-93b8-00a09857ee8f name:Local backup job rc:1 Doing nothing in modify callback for job, since it's pending cleanup 00000074.0065d518 24362d4d Wed Sep 25 2019 18:18:07 -06:00 [kern_mgwd:info:2284] 0x81d1e6a00: 8603e80000296c7e: WARNING: FileReplication: Starting subscription (download) request for package nmg-fas8040-02.8hour.2019-09-25.18_15_07.7z:latest with old API extract target '/mroot/etc/backups/.tmp/.tmp.bk.nmg-fas8040.8hour.7.1569456907/nmg-fas8040-02'. 00000074.0065d51a 24362d71 Wed Sep 25 2019 18:18:10 -06:00 [kern_mgwd:info:2284] 0x81d1e6000: 8603e80000296c7f: WARNING: FileReplication: Starting subscription (download) request for package nmg-fas8040-01.8hour.2019-09-25.18_15_07.7z:latest with old API extract target '/mroot/etc/backups/.tmp/.tmp.bk.nmg-fas8040.8hour.7.1569456907/nmg-fas8040-01'. 00000074.0065d51b 24362d7b Wed Sep 25 2019 18:18:11 -06:00 [kern_mgwd:info:2284] 0x81d1e7400: 8603e80000296c46: WARNING: FileReplication: Initiating unpublish request of nmg-fas8040-02.8hour.2019-09-25.18_15_07.7z on the cluster. 00000074.0065d51c 24362d7b Wed Sep 25 2019 18:18:11 -06:00 [kern_mgwd:info:2284] 0x81d1e7400: 8603e80000296c46: WARNING: FileReplication: Initiating unpublish request of nmg-fas8040-01.8hour.2019-09-25.18_15_07.7z on the cluster. 00000074.0065d524 24362e5c Wed Sep 25 2019 18:18:33 -06:00 [kern_mgwd:info:2284] Info: smf-net: failed due to no more data or timeout. timeout=0 sec, fd=694, numFdReady=0, bytesRcvd=0, FD_ISSET=false, buflength=512 00000074.0065d526 24362e6c Wed Sep 25 2019 18:18:35 -06:00 [kern_mgwd:info:2284] 0x81da82500: 0: WARNING: FileReplication: The file replication service successfully distributed package nmg-fas8040.8hour.2019-09-25.18_15_07.7z:0 to 169.254.5.219. 00000074.0065d52e 24362f7d Wed Sep 25 2019 18:19:03 -06:00 [kern_mgwd:info:2284] 0x81d1e7400: 8603e80000296c46: WARNING: FileReplication: Initiating unpublish request of nmg-fas8040.8hour.2019-09-25.18_15_07.7z on the cluster. 00000074.0065d52f 24362f7d Wed Sep 25 2019 18:19:03 -06:00 [kern_mgwd:info:2284] 0x81d1ea100: 86ffff0000000035: WARNING: job_manager::job_store: run:src/job_store_support.cc:568 Job Mgr: rdb_transaction history: OK/0 OK/89 OK/208 OK/231 Timeout/234 OK/534 00000074.0065d579 24364977 Wed Sep 25 2019 18:30:08 -06:00 [kern_mgwd:info:2284] 0x81d1ea100: 86ffff0000000035: WARNING: job_manager::job_store: run:src/job_store_support.cc:568 Job Mgr: rdb_transaction history: Timeout/0 OK/300 OK/596 00000074.0065d5b9 243660dd Wed Sep 25 2019 18:40:07 -06:00 [kern_mgwd:info:2284] 0x81d1ea100: 86ffff0000000035: WARNING: job_manager::job_store: run:src/job_store_support.cc:568 Job Mgr: rdb_transaction history: OK/0 OK/295 OK/595 00000074.0065d632 24368437 Wed Sep 25 2019 18:55:12 -06:00 [kern_mgwd:info:2284] 0x81d1ea100: 86ffff0000000035: WARNING: job_manager::job_store: run:src/job_store_support.cc:568 Job Mgr: rdb_transaction history: Timeout/0 OK/300 OK/600 Timeout/605 00000074.0065d68d 2436a71c Wed Sep 25 2019 19:10:05 -06:00 [kern_mgwd:info:2284] 0x81d1ea100: 86ffff0000000035: WARNING: job_manager::job_store: run:src/job_store_support.cc:568 Job Mgr: rdb_transaction history: OK/0 Timeout/297 OK/597 00000074.0065d6b0 2436b01f Wed Sep 25 2019 19:13:56 -06:00 [kern_mgwd:info:2284] 0x81d1e7400: 86ffff000000002c: WARNING: job_manager::job_store: claim_job_tx:src/job_rec_int.cc:581 claim_job: Attempted to claim a job that was already owned: 179bd90b-b79e-11e7-9b07-00a09857ee8f owner: 339f7bf8-b7a1-11e7-964b-00a098573067 00000074.0065d6b1 2436b01f Wed Sep 25 2019 19:13:56 -06:00 [kern_mgwd:info:2284] 0x81d1e7400: 86ffff000000002c: WARNING: job_manager::job_sched: _check_claimable:src/job_sched.cc:2225 UIID:14 UUID:179bd90b-b79e-11e7-9b07-00a09857ee8f name:Vol Reaper rc:3 _check_claimable: failed to claim jobs: 12 00000074.0065d6ef 2436ca87 Wed Sep 25 2019 19:25:12 -06:00 [kern_mgwd:info:2284] 0x81d1ea100: 86ffff0000000035: WARNING: job_manager::job_store: run:src/job_store_support.cc:568 Job Mgr: rdb_transaction history: Timeout/0 OK/300 OK/600 Timeout/607 00000074.0065d76a 2436edaf Wed Sep 25 2019 19:40:12 -06:00 [kern_mgwd:info:2284] 0x81d1ea100: 86ffff0000000035: WARNING: job_manager::job_store: run:src/job_store_support.cc:568 Job Mgr: rdb_transaction history: OK/0 OK/300 OK/600 00000074.0065d7d8 243710e1 Wed Sep 25 2019 19:55:12 -06:00 [kern_mgwd:info:2284] 0x81d1ea100: 86ffff0000000035: WARNING: job_manager::job_store: run:src/job_store_support.cc:568 Job Mgr: rdb_transaction history: OK/0 OK/300 OK/600 00000074.0065d82d 243733cd Wed Sep 25 2019 20:10:07 -06:00 [kern_mgwd:info:2284] 0x81d1ea100: 86ffff0000000035: WARNING: job_manager::job_store: run:src/job_store_support.cc:568 Job Mgr: rdb_transaction history: Timeout/0 Timeout/300 OK/600 00000074.0065d87f 24374b65 Wed Sep 25 2019 20:20:11 -06:00 [kern_mgwd:info:2284] 0x81d1ea100: 86ffff0000000035: WARNING: job_manager::job_store: run:src/job_store_support.cc:568 Job Mgr: rdb_transaction history: Timeout/0 OK/300 OK/599 00000074.0065d8d0 243762cb Wed Sep 25 2019 20:30:10 -06:00 [kern_mgwd:info:2284] 0x81d1ea100: 86ffff0000000035: WARNING: job_manager::job_store: run:src/job_store_support.cc:568 Job Mgr: rdb_transaction history: OK/0 OK/298 OK/598 00000074.0065d926 243785e9 Wed Sep 25 2019 20:45:09 -06:00 [kern_mgwd:info:2284] 0x81d1ea100: 86ffff0000000035: WARNING: job_manager::job_store: run:src/job_store_support.cc:568 Job Mgr: rdb_transaction history: OK/0 OK/297 OK/597 Timeout/599 00000074.0065d995 2437a907 Wed Sep 25 2019 21:00:08 -06:00 [kern_mgwd:info:2284] 0x81d1ea100: 86ffff0000000035: WARNING: job_manager::job_store: run:src/job_store_support.cc:568 Job Mgr: rdb_transaction history: OK/0 OK/296 OK/596 Timeout/599 00000074.0065da0f 2437cc25 Wed Sep 25 2019 21:15:07 -06:00 [kern_mgwd:info:2284] 0x81d1ea100: 86ffff0000000035: WARNING: job_manager::job_store: run:src/job_store_support.cc:568 Job Mgr: rdb_transaction history: OK/0 OK/300 OK/596 Timeout/599 00000074.0065da6e 2437ef60 Wed Sep 25 2019 21:30:09 -06:00 [kern_mgwd:info:2284] 0x81d1ea100: 86ffff0000000035: WARNING: job_manager::job_store: run:src/job_store_support.cc:568 Job Mgr: rdb_transaction history: OK/0 OK/297 Timeout/301 OK/601 Timeout/602 00000074.0065daca 24381293 Wed Sep 25 2019 21:45:10 -06:00 [kern_mgwd:info:2284] 0x81d1ea100: 86ffff0000000035: WARNING: job_manager::job_store: run:src/job_store_support.cc:568 Job Mgr: rdb_transaction history: Timeout/0 OK/300 OK/598 Timeout/601 00000074.0065db1f 24381e4b Wed Sep 25 2019 21:50:08 -06:00 [kern_mgwd:info:2284] Starting a backup of the var filesystem. 00000074.0065db39 24381f2c Wed Sep 25 2019 21:50:32 -06:00 [kern_mgwd:info:2284] 0x81b7b8200: 8503e800000027a4: NOTICE: TABLES::disk: Added 168 disk recs to the shared reference cache (size 84) 00000074.0065db68 24381f2c Wed Sep 25 2019 21:50:32 -06:00 [kern_mgwd:info:2284] A [src/rdb/HAM.cc 1233 (0x81b149b00)]: checkHASFOConfigVerbose: haConfigured: True, result HA_AGENT_CONFIGURED. 00000074.0065db69 24381f2c Wed Sep 25 2019 21:50:32 -06:00 [kern_mgwd:info:2284] 0x81b7b6900: 8503e800000027b0: INFO: MGWD::mdnsd_utils: start_mdnsd:src/tables/mdnsd_utils.cc:524 mdnsd process start. ref_cnt=0+1. 00000074.0065db6a 24381f2c Wed Sep 25 2019 21:50:32 -06:00 [kern_mgwd:info:2284] 0x81b7b6900: 8503e800000027b0: INFO: MGWD::mdnsd_utils: start_mdnsd:src/tables/mdnsd_utils.cc:531 Starting mdnsd process. 00000074.0065db6f 24381f2c Wed Sep 25 2019 21:50:32 -06:00 [kern_mgwd:info:2284] 0x81b7b6900: 8503e800000027b0: INFO: MGWD::mdnsd_utils: start_mdnsd:src/tables/mdnsd_utils.cc:534 Sleeping for 5 seconds for mdnsd process startup. 00000074.0065db82 24381fa7 Wed Sep 25 2019 21:50:42 -06:00 [kern_mgwd:info:2284] 0x81b7b6900: 8503e800000027b0: ERR: dsmfp: reload_mgwd_dsmfp_services:src/tables/dns_sd_dsmfp.cc:1737 Couldn't find any dsmfp services to resolve with error entry doesn't exist. 00000074.0065db83 24381fa7 Wed Sep 25 2019 21:50:42 -06:00 [kern_mgwd:info:2284] 0x81b7b6900: 8503e800000027b0: INFO: MGWD::mdnsd_utils: stop_mdnsd:src/tables/mdnsd_utils.cc:555 mdnsd process stop. ref_cnt=1-1. 00000074.0065db84 24381fa7 Wed Sep 25 2019 21:50:42 -06:00 [kern_mgwd:info:2284] 0x81b6afb00: 0: INFO: dsmfp_utils: handle_events:src/tables/dns_sd_utils.cc:362 select() loop exited per interrupter. 00000074.0065db85 24381fa7 Wed Sep 25 2019 21:50:42 -06:00 [kern_mgwd:info:2284] 0x81b7b6900: 8503e800000027b0: INFO: MGWD::mdnsd_utils: stop_mdnsd:src/tables/mdnsd_utils.cc:567 Stopping mdnsd process. 00000074.0065dbb9 24381fa7 Wed Sep 25 2019 21:50:44 -06:00 [kern_mgwd:info:2284] 0x81b7b4100: 8503e800000027c5: ERR: AggrEfficiency: src/tables/aggr_efficiency.cc:smdb_error aggr_efficiency_iterator::_getAggrDetails(const smdb_type_aggr_name &, smdb_type_Uuid &, smdb_type_filerid &):122 Failed to get aggregate information from VLDB for aggregate , Reason: entry doesn't exist 00000074.0065dbbc 24381fbc Wed Sep 25 2019 21:50:46 -06:00 [kern_mgwd:info:2284] A [src/rdb/HAM.cc 1233 (0x81b7b5500)]: checkHASFOConfigVerbose: haConfigured: True, result HA_AGENT_CONFIGURED. 00000074.0065dbef 2438233b Wed Sep 25 2019 21:52:16 -06:00 [kern_mgwd:info:2284] 0x81b7b6e00: 8503e800000027ea: NOTICE: TABLES::disk: Added 168 disk recs to the shared reference cache (size 84) 00000074.0065dc4d 243835cf Wed Sep 25 2019 22:00:12 -06:00 [kern_mgwd:info:2284] 0x81d1ea100: 86ffff0000000035: WARNING: job_manager::job_store: run:src/job_store_support.cc:568 Job Mgr: rdb_transaction history: Timeout/0 OK/300 Timeout/301 OK/601 Timeout/602 00000074.0065dc8d 24384d0d Wed Sep 25 2019 22:10:07 -06:00 [kern_mgwd:info:2284] 0x81d1e5b00: 86ffff0000000027: WARNING: job_manager::job_store: claim_job_tx:src/job_rec_int.cc:581 claim_job: Attempted to claim a job that was already owned: 489d5bff-b80c-11e7-964b-00a098573067 owner: 339f7bf8-b7a1-11e7-964b-00a098573067 00000074.0065dc8e 24384d0d Wed Sep 25 2019 22:10:07 -06:00 [kern_mgwd:info:2284] 0x81d1e5b00: 86ffff0000000027: WARNING: job_manager::job_sched: _check_claimable:src/job_sched.cc:2225 UIID:19 UUID:489d5bff-b80c-11e7-964b-00a098573067 name:Network Recovery Job - 5min rc:3 _check_claimable: failed to claim jobs: 12 00000074.0065dcb3 2438566e Wed Sep 25 2019 22:14:07 -06:00 [kern_mgwd:info:2284] 0x81d1e6500: 8603e80000296ef6: WARNING: job_manager::job_sched: modify_schedule:src/job_sched.cc:800 job_manager::job_sched::modify_schedule: Calling set_scheduler on the record: Current schedule = 0x81c0e57a0; New schedule = 0x81b219220 00000074.0065dcb4 2438566e Wed Sep 25 2019 22:14:07 -06:00 [kern_mgwd:info:2284] 0x81d1ea100: 86ffff0000000035: WARNING: job_manager::job_store: run:src/job_store_support.cc:568 Job Mgr: rdb_transaction history: OK/0 Timeout/237 OK/537 00000074.0065dd1d 24387066 Wed Sep 25 2019 22:25:12 -06:00 [kern_mgwd:info:2284] 0x81d1ea100: 86ffff0000000035: WARNING: job_manager::job_store: run:src/job_store_support.cc:568 Job Mgr: rdb_transaction history: OK/0 OK/300 OK/600 00000074.0065dd81 2438938e Wed Sep 25 2019 22:40:12 -06:00 [kern_mgwd:info:2284] 0x81d1ea100: 86ffff0000000035: WARNING: job_manager::job_store: run:src/job_store_support.cc:568 Job Mgr: rdb_transaction history: OK/0 OK/300 OK/600 00000074.0065ddd8 2438b695 Wed Sep 25 2019 22:55:08 -06:00 [kern_mgwd:info:2284] Starting a backup of the var filesystem. 00000074.0065ddd9 2438b6ac Wed Sep 25 2019 22:55:11 -06:00 [kern_mgwd:info:2284] 0x81d1ea100: 86ffff0000000035: WARNING: job_manager::job_store: run:src/job_store_support.cc:568 Job Mgr: rdb_transaction history: Timeout/0 OK/300 OK/599 00000074.0065de27 2438ce08 Wed Sep 25 2019 23:05:09 -06:00 [kern_mgwd:info:2284] 0x81d1ea100: 86ffff0000000035: WARNING: job_manager::job_store: run:src/job_store_support.cc:568 Job Mgr: rdb_transaction history: OK/0 Timeout/297 OK/597 00000074.0065de69 2438e316 Wed Sep 25 2019 23:14:08 -06:00 [kern_mgwd:info:2284] 0x81d1e6500: 8603e80000296f91: WARNING: job_manager::job_sched: modify_schedule:src/job_sched.cc:800 job_manager::job_sched::modify_schedule: Calling set_scheduler on the record: Current schedule = 0x81c0e73a0; New schedule = 0x81c0dd100 00000074.0065de93 2438f130 Wed Sep 25 2019 23:20:09 -06:00 [kern_mgwd:info:2284] 0x81d1ea100: 86ffff0000000035: WARNING: job_manager::job_store: run:src/job_store_support.cc:568 Job Mgr: rdb_transaction history: OK/0 OK/297 OK/361 Timeout/600 00000074.0065df0d 2439144e Wed Sep 25 2019 23:35:08 -06:00 [kern_mgwd:info:2284] 0x81d1ea100: 86ffff0000000035: WARNING: job_manager::job_store: run:src/job_store_support.cc:568 Job Mgr: rdb_transaction history: OK/0 OK/296 OK/596 Timeout/599 00000074.0065df70 2439376c Wed Sep 25 2019 23:50:07 -06:00 [kern_mgwd:info:2284] 0x81d1ea100: 86ffff0000000035: WARNING: job_manager::job_store: run:src/job_store_support.cc:568 Job Mgr: rdb_transaction history: OK/0 OK/295 OK/595 Timeout/599 00000074.0065dfc4 24394eb8 Thu Sep 26 2019 00:00:00 -06:00 [kern_mgwd:info:2284] 0x81b6aa600: 0: ERR: RPCServer: mgwd_xml_start_1_svc: Called for asup_pathname(/mroot/etc/log/autosupport/201909260000.0.files) 00000074.0065dfc5 24394eb8 Thu Sep 26 2019 00:00:00 -06:00 [kern_mgwd:info:2284] 0x81b6aa600: 0: ERR: RPCServer: mgwd_xml_start_1_svc: current_asup_xml exists. State: (2) 00000074.0065dfc6 24394eb8 Thu Sep 26 2019 00:00:00 -06:00 [kern_mgwd:info:2284] 0x81b6aa600: 0: ERR: RPCServer: mgwd_xml_start_1_svc: ASUP Started SUCCESS 00000074.0065dfd0 24394eb8 Thu Sep 26 2019 00:00:02 -06:00 [kern_mgwd:info:2284] Starting a backup of the var filesystem. 00000074.0065e006 24395a9e Thu Sep 26 2019 00:05:08 -06:00 [kern_mgwd:info:2284] 0x81d1ea100: 86ffff0000000035: WARNING: job_manager::job_store: run:src/job_store_support.cc:568 Job Mgr: rdb_transaction history: OK/0 OK/296 OK/301 OK/301 OK/596 Timeout/601 00000074.0065e042 2439675a Thu Sep 26 2019 00:10:34 -06:00 [kern_mgwd:info:2284] 0x81d1e3d00: 8603e80000297054: WARNING: job_manager::job_sched: process_modify:src/job_sched.cc:487 UIID:8848 UUID:488853ca-e024-11e9-8fa8-00a098573067 name:Local backup job rc:1 Doing nothing in modify callback for job, since it's pending cleanup 00000074.0065e043 24396d58 Thu Sep 26 2019 00:13:06 -06:00 [kern_mgwd:info:2284] Info: smf-net: failed due to no more data or timeout. timeout=0 sec, fd=685, numFdReady=0, bytesRcvd=0, FD_ISSET=false, buflength=512 00000074.0065e044 24396d58 Thu Sep 26 2019 00:13:07 -06:00 [kern_mgwd:info:2284] 0x81da82500: 0: WARNING: FileReplication: The file replication service successfully distributed package nmg-fas8040-01.daily.2019-09-26.00_10_05.7z:0 to 169.254.5.219. 00000074.0065e047 24396e57 Thu Sep 26 2019 00:13:32 -06:00 [kern_mgwd:info:2284] 0x81d1e4c00: 8603e80000297068: WARNING: FileReplication: Starting subscription (download) request for package nmg-fas8040.daily.2019-09-26.00_10_05.7z:latest with old API extract target '/mroot/etc/backups/.tmp/nmg-fas8040.daily.2019-09-26.00_10_05.7z'. 00000074.0065e048 24396e92 Thu Sep 26 2019 00:13:38 -06:00 [kern_mgwd:info:2284] 0x81d1e3d00: 8603e8000029706c: WARNING: job_manager::job_sched: process_modify:src/job_sched.cc:487 UIID:8849 UUID:c453ecbd-e024-11e9-8fa8-00a098573067 name:Receive backup job rc:1 Doing nothing in modify callback for job, since it's pending cleanup 00000074.0065e04a 24396fc3 Thu Sep 26 2019 00:14:09 -06:00 [kern_mgwd:info:2284] 0x81d1e5600: 86ffff0000000026: WARNING: job_manager::job_store: claim_job_tx:src/job_rec_int.cc:581 claim_job: Attempted to claim a job that was already owned: 179bd90b-b79e-11e7-9b07-00a09857ee8f owner: 339f7bf8-b7a1-11e7-964b-00a098573067 00000074.0065e04b 24396fc3 Thu Sep 26 2019 00:14:09 -06:00 [kern_mgwd:info:2284] 0x81d1e5600: 86ffff0000000026: WARNING: job_manager::job_sched: _check_claimable:src/job_sched.cc:2225 UIID:14 UUID:179bd90b-b79e-11e7-9b07-00a09857ee8f name:Vol Reaper rc:3 _check_claimable: failed to claim jobs: 12 00000074.0065e08c 24397ef2 Thu Sep 26 2019 00:20:38 -06:00 [kern_mgwd:info:2284] 0x81d1ea100: 86ffff0000000035: WARNING: job_manager::job_store: run:src/job_store_support.cc:568 Job Mgr: rdb_transaction history: Timeout/0 OK/301 OK/420 OK/485 OK/604 Timeout/630 00000074.0065e0ce 2439933b Thu Sep 26 2019 00:29:17 -06:00 [kern_mgwd:info:2284] 0x81b6aba00: 0: ERR: RPCServer: mgwd_xml_start_1_svc: Called for asup_pathname(/mroot/etc/log/autosupport/201909260029.0.files) 00000074.0065e0cf 2439933b Thu Sep 26 2019 00:29:17 -06:00 [kern_mgwd:info:2284] 0x81b6aba00: 0: ERR: RPCServer: mgwd_xml_start_1_svc: current_asup_xml exists. State: (2) 00000074.0065e0d0 2439933b Thu Sep 26 2019 00:29:17 -06:00 [kern_mgwd:info:2284] 0x81b6aba00: 0: ERR: RPCServer: mgwd_xml_start_1_svc: ASUP Started SUCCESS 00000074.0065e114 2439a116 Thu Sep 26 2019 00:35:12 -06:00 [kern_mgwd:info:2284] 0x81d1ea100: 86ffff0000000035: WARNING: job_manager::job_store: run:src/job_store_support.cc:568 Job Mgr: rdb_transaction history: Timeout/0 OK/300 OK/600 00000074.0065e166 2439c3f8 Thu Sep 26 2019 00:50:05 -06:00 [kern_mgwd:info:2284] 0x81d1ea100: 86ffff0000000035: WARNING: job_manager::job_store: run:src/job_store_support.cc:568 Job Mgr: rdb_transaction history: OK/0 OK/293 OK/593 00000074.0065e1d1 2439e734 Thu Sep 26 2019 01:05:07 -06:00 [kern_mgwd:info:2284] 0x81d1ea100: 86ffff0000000035: WARNING: job_manager::job_store: run:src/job_store_support.cc:568 Job Mgr: rdb_transaction history: OK/0 Timeout/295 OK/595 Timeout/602 00000074.0065e24a 243a0a8e Thu Sep 26 2019 01:20:12 -06:00 [kern_mgwd:info:2284] 0x81d1ea100: 86ffff0000000035: WARNING: job_manager::job_store: run:src/job_store_support.cc:568 Job Mgr: rdb_transaction history: Timeout/0 OK/300 Timeout/305 Timeout/605 00000074.0065e2b2 243a2dac Thu Sep 26 2019 01:35:11 -06:00 [kern_mgwd:info:2284] 0x81d1ea100: 86ffff0000000035: WARNING: job_manager::job_store: run:src/job_store_support.cc:568 Job Mgr: rdb_transaction history: Timeout/0 Timeout/300 OK/600 00000074.0065e303 243a4512 Thu Sep 26 2019 01:45:10 -06:00 [kern_mgwd:info:2284] 0x81d1ea100: 86ffff0000000035: WARNING: job_manager::job_store: run:src/job_store_support.cc:568 Job Mgr: rdb_transaction history: Timeout/0 OK/300 OK/598 00000074.0065e341 243a5c78 Thu Sep 26 2019 01:55:09 -06:00 [kern_mgwd:info:2284] 0x81d1ea100: 86ffff0000000035: WARNING: job_manager::job_store: run:src/job_store_support.cc:568 Job Mgr: rdb_transaction history: OK/0 OK/297 OK/597 00000074.0065e3a9 243a7f65 Thu Sep 26 2019 02:10:03 -06:00 [kern_mgwd:info:2284] 0x81d1e6a00: 86ffff000000002a: WARNING: job_manager::job_store: claim_job_tx:src/job_rec_int.cc:581 claim_job: Attempted to claim a job that was already owned: 489d5bff-b80c-11e7-964b-00a098573067 owner: 339f7bf8-b7a1-11e7-964b-00a098573067 00000074.0065e3aa 243a7f65 Thu Sep 26 2019 02:10:03 -06:00 [kern_mgwd:info:2284] 0x81d1e6a00: 86ffff000000002a: WARNING: job_manager::job_sched: _check_claimable:src/job_sched.cc:2225 UIID:19 UUID:489d5bff-b80c-11e7-964b-00a098573067 name:Network Recovery Job - 5min rc:3 _check_claimable: failed to claim jobs: 12 00000074.0065e3ad 243a7fc0 Thu Sep 26 2019 02:10:12 -06:00 [kern_mgwd:info:2284] 0x81d1ea100: 86ffff0000000035: WARNING: job_manager::job_store: run:src/job_store_support.cc:568 Job Mgr: rdb_transaction history: Timeout/0 Timeout/300 OK/600 Timeout/603 00000074.0065e3c1 243a890a Thu Sep 26 2019 02:14:10 -06:00 [kern_mgwd:info:2284] 0x81d1e5b00: 8603e80000297109: WARNING: job_manager::job_sched: modify_schedule:src/job_sched.cc:800 job_manager::job_sched::modify_schedule: Calling set_scheduler on the record: Current schedule = 0x81dcb4ba0; New schedule = 0x81c0dd0c0 00000074.0065e3c2 243a8b44 Thu Sep 26 2019 02:15:07 -06:00 [kern_mgwd:info:2284] 0x81d1e6a00: 86ffff000000002a: WARNING: job_manager::job_store: claim_job_tx:src/job_rec_int.cc:581 claim_job: Attempted to claim a job that was already owned: 489d5bff-b80c-11e7-964b-00a098573067 owner: 339f7bf8-b7a1-11e7-964b-00a098573067 00000074.0065e3c3 243a8b44 Thu Sep 26 2019 02:15:07 -06:00 [kern_mgwd:info:2284] 0x81d1e6a00: 86ffff000000002a: WARNING: job_manager::job_sched: _check_claimable:src/job_sched.cc:2225 UIID:19 UUID:489d5bff-b80c-11e7-964b-00a098573067 name:Network Recovery Job - 5min rc:3 _check_claimable: failed to claim jobs: 12 00000074.0065e3c4 243a8c69 Thu Sep 26 2019 02:15:36 -06:00 [kern_mgwd:info:2284] 0x81d1e3d00: 8603e800002971c8: WARNING: job_manager::job_sched: process_modify:src/job_sched.cc:487 UIID:8851 UUID:c007743f-e035-11e9-8fa8-00a098573067 name:Local backup job rc:1 Doing nothing in modify callback for job, since it's pending cleanup 00000074.0065e3e1 243a9264 Thu Sep 26 2019 02:18:08 -06:00 [kern_mgwd:info:2284] Info: smf-net: failed due to no more data or timeout. timeout=0 sec, fd=684, numFdReady=0, bytesRcvd=0, FD_ISSET=false, buflength=512 00000074.0065e3e2 243a9264 Thu Sep 26 2019 02:18:09 -06:00 [kern_mgwd:info:2284] 0x81da82500: 0: WARNING: FileReplication: The file replication service successfully distributed package nmg-fas8040-01.8hour.2019-09-26.02_15_07.7z:0 to 169.254.5.219. 00000074.0065e3eb 243a936f Thu Sep 26 2019 02:18:35 -06:00 [kern_mgwd:info:2284] 0x81d1e6a00: 8603e800002971da: WARNING: FileReplication: Starting subscription (download) request for package nmg-fas8040.8hour.2019-09-26.02_15_07.7z:latest with old API extract target '/mroot/etc/backups/.tmp/nmg-fas8040.8hour.2019-09-26.02_15_07.7z'. 00000074.0065e3ee 243a93a1 Thu Sep 26 2019 02:18:41 -06:00 [kern_mgwd:info:2284] 0x81d1e3d00: 8603e800002971dc: WARNING: job_manager::job_sched: process_modify:src/job_sched.cc:487 UIID:8852 UUID:3c0a1ce7-e036-11e9-8fa8-00a098573067 name:Receive backup job rc:1 Doing nothing in modify callback for job, since it's pending cleanup 00000074.0065e407 243aa2ba Thu Sep 26 2019 02:25:07 -06:00 [kern_mgwd:info:2284] 0x81d1ea100: 86ffff0000000035: WARNING: job_manager::job_store: run:src/job_store_support.cc:568 Job Mgr: rdb_transaction history: OK/0 OK/267 OK/386 OK/452 OK/571 OK/657 00000074.0065e442 243aae6c Thu Sep 26 2019 02:30:07 -06:00 [kern_mgwd:info:2284] 0x81d1e6f00: 86ffff000000002b: WARNING: job_manager::job_store: claim_job_tx:src/job_rec_int.cc:581 claim_job: Attempted to claim a job that was already owned: 489d5bff-b80c-11e7-964b-00a098573067 owner: 339f7bf8-b7a1-11e7-964b-00a098573067 00000074.0065e443 243aae6c Thu Sep 26 2019 02:30:07 -06:00 [kern_mgwd:info:2284] 0x81d1e6f00: 86ffff000000002b: WARNING: job_manager::job_sched: _check_claimable:src/job_sched.cc:2225 UIID:19 UUID:489d5bff-b80c-11e7-964b-00a098573067 name:Network Recovery Job - 5min rc:3 _check_claimable: failed to claim jobs: 12 00000074.0065e45c 243aba2b Thu Sep 26 2019 02:35:07 -06:00 [kern_mgwd:info:2284] 0x81d1e6000: 86ffff0000000028: WARNING: job_manager::job_store: claim_job_tx:src/job_rec_int.cc:581 claim_job: Attempted to claim a job that was already owned: 489d5bff-b80c-11e7-964b-00a098573067 owner: 339f7bf8-b7a1-11e7-964b-00a098573067 00000074.0065e45d 243aba2b Thu Sep 26 2019 02:35:07 -06:00 [kern_mgwd:info:2284] 0x81d1e6000: 86ffff0000000028: WARNING: job_manager::job_sched: _check_claimable:src/job_sched.cc:2225 UIID:19 UUID:489d5bff-b80c-11e7-964b-00a098573067 name:Network Recovery Job - 5min rc:3 _check_claimable: failed to claim jobs: 12 00000074.0065e485 243ac5dc Thu Sep 26 2019 02:40:07 -06:00 [kern_mgwd:info:2284] 0x81d1ea100: 86ffff0000000035: WARNING: job_manager::job_store: run:src/job_store_support.cc:568 Job Mgr: rdb_transaction history: Timeout/0 Timeout/300 Timeout/600 00000074.0065e4af 243ad19c Thu Sep 26 2019 02:45:07 -06:00 [kern_mgwd:info:2284] 0x81d1e9c00: 86ffff0000000034: WARNING: job_manager::job_store: claim_job_tx:src/job_rec_int.cc:581 claim_job: Attempted to claim a job that was already owned: 489d5bff-b80c-11e7-964b-00a098573067 owner: 339f7bf8-b7a1-11e7-964b-00a098573067 00000074.0065e4b0 243ad19c Thu Sep 26 2019 02:45:07 -06:00 [kern_mgwd:info:2284] 0x81d1e9c00: 86ffff0000000034: WARNING: job_manager::job_sched: _check_claimable:src/job_sched.cc:2225 UIID:19 UUID:489d5bff-b80c-11e7-964b-00a098573067 name:Network Recovery Job - 5min rc:3 _check_claimable: failed to claim jobs: 12 00000074.0065e4c5 243add4c Thu Sep 26 2019 02:50:07 -06:00 [kern_mgwd:info:2284] 0x81d1e9700: 86ffff0000000033: WARNING: job_manager::job_store: claim_job_tx:src/job_rec_int.cc:581 claim_job: Attempted to claim a job that was already owned: 489d5bff-b80c-11e7-964b-00a098573067 owner: 339f7bf8-b7a1-11e7-964b-00a098573067 00000074.0065e4c6 243add4c Thu Sep 26 2019 02:50:07 -06:00 [kern_mgwd:info:2284] 0x81d1e9700: 86ffff0000000033: WARNING: job_manager::job_sched: _check_claimable:src/job_sched.cc:2225 UIID:19 UUID:489d5bff-b80c-11e7-964b-00a098573067 name:Network Recovery Job - 5min rc:3 _check_claimable: failed to claim jobs: 12 00000074.0065e501 243ae8f0 Thu Sep 26 2019 02:55:05 -06:00 [kern_mgwd:info:2284] 0x81d1ea100: 86ffff0000000035: WARNING: job_manager::job_store: run:src/job_store_support.cc:568 Job Mgr: rdb_transaction history: OK/0 Timeout/298 Timeout/598 00000074.0065e507 243af4be Thu Sep 26 2019 03:00:07 -06:00 [kern_mgwd:info:2284] 0x81d1e8d00: 86ffff0000000031: WARNING: job_manager::job_store: claim_job_tx:src/job_rec_int.cc:581 claim_job: Attempted to claim a job that was already owned: 489d5bff-b80c-11e7-964b-00a098573067 owner: 339f7bf8-b7a1-11e7-964b-00a098573067 00000074.0065e508 243af4be Thu Sep 26 2019 03:00:07 -06:00 [kern_mgwd:info:2284] 0x81d1e8d00: 86ffff0000000031: WARNING: job_manager::job_sched: _check_claimable:src/job_sched.cc:2225 UIID:19 UUID:489d5bff-b80c-11e7-964b-00a098573067 name:Network Recovery Job - 5min rc:3 _check_claimable: failed to claim jobs: 12 00000074.0065e55b 243b0c18 Thu Sep 26 2019 03:10:05 -06:00 [kern_mgwd:info:2284] 0x81d1ea100: 86ffff0000000035: WARNING: job_manager::job_store: run:src/job_store_support.cc:568 Job Mgr: rdb_transaction history: Timeout/0 OK/300 Timeout/600 00000074.0065e581 243b15b3 Thu Sep 26 2019 03:14:11 -06:00 [kern_mgwd:info:2284] 0x81d1e4700: 8603e80000297269: WARNING: job_manager::job_sched: modify_schedule:src/job_sched.cc:800 job_manager::job_sched::modify_schedule: Calling set_scheduler on the record: Current schedule = 0x81c447d80; New schedule = 0x81c0dd0c0 00000074.0065e582 243b17e3 Thu Sep 26 2019 03:15:07 -06:00 [kern_mgwd:info:2284] 0x81d1e6500: 86ffff0000000029: WARNING: job_manager::job_store: claim_job_tx:src/job_rec_int.cc:581 claim_job: Attempted to claim a job that was already owned: 489d5bff-b80c-11e7-964b-00a098573067 owner: 339f7bf8-b7a1-11e7-964b-00a098573067 00000074.0065e583 243b17e3 Thu Sep 26 2019 03:15:07 -06:00 [kern_mgwd:info:2284] 0x81d1e6500: 86ffff0000000029: WARNING: job_manager::job_sched: _check_claimable:src/job_sched.cc:2225 UIID:19 UUID:489d5bff-b80c-11e7-964b-00a098573067 name:Network Recovery Job - 5min rc:3 _check_claimable: failed to claim jobs: 12 00000074.0065e5af 243b239f Thu Sep 26 2019 03:20:07 -06:00 [kern_mgwd:info:2284] 0x81d1e6f00: 86ffff000000002b: WARNING: job_manager::job_store: claim_job_tx:src/job_rec_int.cc:581 claim_job: Attempted to claim a job that was already owned: 489d5bff-b80c-11e7-964b-00a098573067 owner: 339f7bf8-b7a1-11e7-964b-00a098573067 00000074.0065e5b0 243b239f Thu Sep 26 2019 03:20:07 -06:00 [kern_mgwd:info:2284] 0x81d1e6f00: 86ffff000000002b: WARNING: job_manager::job_sched: _check_claimable:src/job_sched.cc:2225 UIID:19 UUID:489d5bff-b80c-11e7-964b-00a098573067 name:Network Recovery Job - 5min rc:3 _check_claimable: failed to claim jobs: 12 00000074.0065e5c3 243b2d24 Thu Sep 26 2019 03:24:11 -06:00 [kern_mgwd:info:2284] 0x81d1ea100: 86ffff0000000035: WARNING: job_manager::job_store: run:src/job_store_support.cc:568 Job Mgr: rdb_transaction history: Timeout/0 Timeout/300 OK/600 00000074.0065e600 243b3b0c Thu Sep 26 2019 03:30:07 -06:00 [kern_mgwd:info:2284] 0x81d1e9c00: 86ffff0000000034: WARNING: job_manager::job_store: claim_job_tx:src/job_rec_int.cc:581 claim_job: Attempted to claim a job that was already owned: 489d5bff-b80c-11e7-964b-00a098573067 owner: 339f7bf8-b7a1-11e7-964b-00a098573067 00000074.0065e601 243b3b0c Thu Sep 26 2019 03:30:07 -06:00 [kern_mgwd:info:2284] 0x81d1e9c00: 86ffff0000000034: WARNING: job_manager::job_sched: _check_claimable:src/job_sched.cc:2225 UIID:19 UUID:489d5bff-b80c-11e7-964b-00a098573067 name:Network Recovery Job - 5min rc:3 _check_claimable: failed to claim jobs: 12 00000074.0065e60a 243b46c3 Thu Sep 26 2019 03:35:07 -06:00 [kern_mgwd:info:2284] 0x81d1e9700: 86ffff0000000033: WARNING: job_manager::job_store: claim_job_tx:src/job_rec_int.cc:581 claim_job: Attempted to claim a job that was already owned: 489d5bff-b80c-11e7-964b-00a098573067 owner: 339f7bf8-b7a1-11e7-964b-00a098573067 00000074.0065e60b 243b46c3 Thu Sep 26 2019 03:35:07 -06:00 [kern_mgwd:info:2284] 0x81d1e9700: 86ffff0000000033: WARNING: job_manager::job_sched: _check_claimable:src/job_sched.cc:2225 UIID:19 UUID:489d5bff-b80c-11e7-964b-00a098573067 name:Network Recovery Job - 5min rc:3 _check_claimable: failed to claim jobs: 12 00000074.0065e643 243b504c Thu Sep 26 2019 03:39:11 -06:00 [kern_mgwd:info:2284] 0x81d1ea100: 86ffff0000000035: WARNING: job_manager::job_store: run:src/job_store_support.cc:568 Job Mgr: rdb_transaction history: Timeout/0 Timeout/300 Timeout/600 00000074.0065e65d 243b5e34 Thu Sep 26 2019 03:45:07 -06:00 [kern_mgwd:info:2284] 0x81d1e8300: 86ffff000000002f: WARNING: job_manager::job_store: claim_job_tx:src/job_rec_int.cc:581 claim_job: Attempted to claim a job that was already owned: 489d5bff-b80c-11e7-964b-00a098573067 owner: 339f7bf8-b7a1-11e7-964b-00a098573067 00000074.0065e65e 243b5e34 Thu Sep 26 2019 03:45:07 -06:00 [kern_mgwd:info:2284] 0x81d1e8300: 86ffff000000002f: WARNING: job_manager::job_sched: _check_claimable:src/job_sched.cc:2225 UIID:19 UUID:489d5bff-b80c-11e7-964b-00a098573067 name:Network Recovery Job - 5min rc:3 _check_claimable: failed to claim jobs: 12 00000074.0065e683 243b69ec Thu Sep 26 2019 03:50:07 -06:00 [kern_mgwd:info:2284] 0x81d1e9200: 86ffff0000000032: WARNING: job_manager::job_store: claim_job_tx:src/job_rec_int.cc:581 claim_job: Attempted to claim a job that was already owned: 489d5bff-b80c-11e7-964b-00a098573067 owner: 339f7bf8-b7a1-11e7-964b-00a098573067 00000074.0065e684 243b69ec Thu Sep 26 2019 03:50:07 -06:00 [kern_mgwd:info:2284] 0x81d1e9200: 86ffff0000000032: WARNING: job_manager::job_sched: _check_claimable:src/job_sched.cc:2225 UIID:19 UUID:489d5bff-b80c-11e7-964b-00a098573067 name:Network Recovery Job - 5min rc:3 _check_claimable: failed to claim jobs: 12 00000074.0065e6a3 243b7374 Thu Sep 26 2019 03:54:11 -06:00 [kern_mgwd:info:2284] 0x81d1ea100: 86ffff0000000035: WARNING: job_manager::job_store: run:src/job_store_support.cc:568 Job Mgr: rdb_transaction history: Timeout/0 Timeout/300 Timeout/600 00000074.0065e6ee 243b8990 Thu Sep 26 2019 04:03:37 -06:00 [kern_mgwd:info:2284] dsmdb_create_imp_1() on kern_shelf_backend_table_create failed: 169.254.5.219{ffffffff|ffffffff} prog=536873508 server=kernel: RPC: Timed out; netid=tcp fd=702 TO=25.0s TT=25.001s O=308b I=0b CN=4857813/17 VSID=-3 169.254.5.219:918 00000074.0065e6f6 243b8a92 Thu Sep 26 2019 04:04:02 -06:00 [kern_mgwd:info:2284] dsmdb_create_imp_1() on kern_shelf_backend_table_create failed: 169.254.5.219{ffffffff|ffffffff} prog=536873508 server=kernel: RPC: Timed out; netid=tcp fd=697 TO=25.0s TT=25.000s O=308b I=0b CN=4857817/3 VSID=-3 169.254.5.219:918 00000074.0065e6fe 243b8b84 Thu Sep 26 2019 04:04:27 -06:00 [kern_mgwd:info:2284] dsmdb_create_imp_1() on kern_shelf_backend_table_create failed: 169.254.5.219{ffffffff|ffffffff} prog=536873508 server=kernel: RPC: Timed out; netid=tcp fd=684 TO=25.0s TT=25.000s O=308b I=0b CN=4857819/3 VSID=-3 169.254.5.219:918 00000074.0065e706 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] W [src/rdb/tmrpc.cc 784 (0x81d1ea100)]: f_coord_commit_1 rpc to 1001 failed: 5: f_coord_commit_1: RPC: Timed out; netid=tcp fd=630 TO=30.0s TT=30.000s O=3680b I=0b CN=4857822/3 VSID=-3 169.254.8.83:7818 00000074.0065e707 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] f_coord_commit_1: RPC: Timed out; netid=tcp fd=630 TO=30.0s TT=30.000s O=3680b I=0b CN=4857822/3 VSID=-3 169.254.8.83:7818 00000074.0065e708 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] W [src/rdb/TM.cc 2774 (0x81d1ea100)]: TM 1000: Attempted commit of TID <5,981472,981472> 'job_manager job tx loop' failed: RPC_FAILURE (f_coord_commit_1: RPC: Timed out; netid=tcp fd=630 TO=30.0s TT=30.000s O=3680b I=0b CN=4857822/3 VSID=-3 169.254.8.83:7818). 00000074.0065e709 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] A [src/rdb/cluster_events.cc 78 (0x81d1ea100)]: Cluster event: node-event, epoch 5, site 1000 [could not commit transaction: RPC failure (f_coord_commit_1: RPC: Timed out; netid=tcp fd=630 TO=30.0s TT=30.000s O=3680b I=0b ]. 00000074.0065e70a 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] A [src/rdb/TM.cc 1918 (0x81d1ea100)]: _localSiteHasFailed: set IS_FAILED epoch 5 00000074.0065e70b 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] A [src/rdb/quorum/quorumimpl.cc 941 (0x81d1ea100)]: Declare secondary failed in epoch: 5, state: WS_QuorumMember (transaction manager) fastPath 0 isFastPathDefault 1. 00000074.0065e70c 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] A [src/rdb/quorum/qm_states/qm_in_secondary.cc 303 (0x81d1ea100)]: secondaryFailed: FastPathDefault 1, Membership terminated by secondaryFailed call at 60788231s, _failedTillTime 60788234s 00000074.0065e70d 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] A [src/rdb/quorum/qm_states/qm_in_quorum_member.cc 64 (0x81d1ea100)]: QuorumMemberState::state2: WS_QuorumMember -> WS_Failed 00000074.0065e70e 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] A [src/rdb/quorum/qm_states/qm_in_secondary.cc 323 (0x81d1ea100)]: SecondaryState::stateUp2Secondary: WS_QuorumMember -> WS_Failed 00000074.0065e70f 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] A [src/rdb/quorum/qm_states/qm_state.cc 306 (0x81d1ea100)]: qmsPreferredCandidate_set till: 60788236s who: 1001. 00000074.0065e710 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] A [src/rdb/quorum/qm_states/qm_in_in_quorum.cc 49 (0x81d1ea100)]: InQuorumState::stateUp2InQuorum: WS_QuorumMember -> WS_Failed 00000074.0065e711 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] A [src/rdb/quorum/quorumimpl.cc 1833 (0x81d1ea100)]: local_offlineUpcall QM Upcall status: Secondary ==> Offline Epoch: 5 => 5 isFastPath 1 isFastPathOverride 0 membershipDisabled: 0 00000074.0065e712 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] A [src/rdb/quorum/qm_states/qm_state.cc 552 (0x81d1ea100)]: stateTrans: WS_QuorumMember -> WS_Failed at: 60788231s 00000074.0065e713 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] ******* OOQ mtrace dump BEGIN ********* 00000074.0065e714 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:10:15 2019:src/rdb/TM.cc:2080 (thr_id:0x81b146e00) TM 1000: Local commit for TID <5,981334,981334> label 'job_manager job tx loop' : time: 1 msec; result: SUCCESS. 00000074.0065e715 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:10:15 2019:src/rdb/TM.cc:2964 (thr_id:0x81b146e00) TM 1000: secondary committed txn TID <5,981334,981334> (from <5,981333>). 00000074.0065e716 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:11:49 2019:src/rdb/TM.cc:2661 (thr_id:0x81b244c00) TM 1000: app commit: TID <5,981336,981336>. 00000074.0065e717 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:11:49 2019:src/rdb/TM.cc:2920 (thr_id:0x81b146900) TM 1000: receives propagation of TID <5,981336,981336> (from <5,981334>). 00000074.0065e718 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:11:49 2019:src/rdb/TM.cc:2001 (thr_id:0x81b146900) TM 1000: Begin commit for TID <5,981336,981336> labelOnly false label 'SP: rdb-info-update lock' 00000074.0065e719 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:11:49 2019:src/rdb/TM.cc:2012 (thr_id:0x81b146900) TM 1000: _localCommit: before beginUpdate 00000074.0065e71a 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:11:49 2019:src/rdb/TM.cc:2018 (thr_id:0x81b146900) TM 1000: _localCommit: after beginUpdate 00000074.0065e71b 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:11:49 2019:src/rdb/TM.cc:2026 (thr_id:0x81b146900) TM 1000: _localCommit: after saveTxnChanges (dbId=145), st=SUCCESS 00000074.0065e71c 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:11:49 2019:src/rdb/TM.cc:2030 (thr_id:0x81b146900) TM 1000: _localCommit: before LocalUnit::commit 00000074.0065e71d 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:11:49 2019:src/rdb/TM.cc:2045 (thr_id:0x81b146900) TM 1000: _localCommit: after LocalUnit::commit, st=SUCCESS 00000074.0065e71e 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:11:49 2019:src/rdb/TM.cc:2053 (thr_id:0x81b146900) TM 1000: _localCommit: after _refreshUnitInfo, st=SUCCESS 00000074.0065e71f 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:11:49 2019:src/rdb/TM.cc:2080 (thr_id:0x81b146900) TM 1000: Local commit for TID <5,981336,981336> label 'SP: rdb-info-update lock' : time: 2 msec; result: SUCCESS. 00000074.0065e720 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:11:49 2019:src/rdb/TM.cc:2964 (thr_id:0x81b146900) TM 1000: secondary committed txn TID <5,981336,981336> (from <5,981334>). 00000074.0065e721 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:14:10 2019:src/rdb/TM.cc:2661 (thr_id:0x81d1ea100) TM 1000: app commit: TID <5,981337,981337>. 00000074.0065e722 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:14:10 2019:src/rdb/TM.cc:2920 (thr_id:0x81b146e00) TM 1000: receives propagation of TID <5,981337,981337> (from <5,981336>). 00000074.0065e723 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:14:10 2019:src/rdb/TM.cc:2001 (thr_id:0x81b146e00) TM 1000: Begin commit for TID <5,981337,981337> labelOnly false label 'job_manager job tx loop' 00000074.0065e724 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:14:10 2019:src/rdb/TM.cc:2012 (thr_id:0x81b146e00) TM 1000: _localCommit: before beginUpdate 00000074.0065e725 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:14:10 2019:src/rdb/TM.cc:2018 (thr_id:0x81b146e00) TM 1000: _localCommit: after beginUpdate 00000074.0065e726 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:14:10 2019:src/rdb/TM.cc:2026 (thr_id:0x81b146e00) TM 1000: _localCommit: after saveTxnChanges (dbId=484), st=SUCCESS 00000074.0065e727 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:14:10 2019:src/rdb/TM.cc:2030 (thr_id:0x81b146e00) TM 1000: _localCommit: before LocalUnit::commit 00000074.0065e728 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:14:10 2019:src/rdb/TM.cc:2045 (thr_id:0x81b146e00) TM 1000: _localCommit: after LocalUnit::commit, st=SUCCESS 00000074.0065e729 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:14:10 2019:src/rdb/TM.cc:2053 (thr_id:0x81b146e00) TM 1000: _localCommit: after _refreshUnitInfo, st=SUCCESS 00000074.0065e72a 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:14:10 2019:src/rdb/TM.cc:2080 (thr_id:0x81b146e00) TM 1000: Local commit for TID <5,981337,981337> label 'job_manager job tx loop' : time: 2 msec; result: SUCCESS. 00000074.0065e72b 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:14:10 2019:src/rdb/TM.cc:2964 (thr_id:0x81b146e00) TM 1000: secondary committed txn TID <5,981337,981337> (from <5,981336>). 00000074.0065e72c 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:15:07 2019:src/rdb/TM.cc:2920 (thr_id:0x81b146e00) TM 1000: receives propagation of TID <5,981338,981338> (from <5,981337>). 00000074.0065e72d 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:15:07 2019:src/rdb/TM.cc:2001 (thr_id:0x81b146e00) TM 1000: Begin commit for TID <5,981338,981338> labelOnly false label 'job_manager job_sched check claimable' 00000074.0065e72e 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:15:07 2019:src/rdb/TM.cc:2012 (thr_id:0x81b146e00) TM 1000: _localCommit: before beginUpdate 00000074.0065e72f 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:15:07 2019:src/rdb/TM.cc:2018 (thr_id:0x81b146e00) TM 1000: _localCommit: after beginUpdate 00000074.0065e730 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:15:07 2019:src/rdb/TM.cc:2026 (thr_id:0x81b146e00) TM 1000: _localCommit: after saveTxnChanges (dbId=484), st=SUCCESS 00000074.0065e731 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:15:07 2019:src/rdb/TM.cc:2030 (thr_id:0x81b146e00) TM 1000: _localCommit: before LocalUnit::commit 00000074.0065e732 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:15:07 2019:src/rdb/TM.cc:2045 (thr_id:0x81b146e00) TM 1000: _localCommit: after LocalUnit::commit, st=SUCCESS 00000074.0065e733 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:15:07 2019:src/rdb/TM.cc:2053 (thr_id:0x81b146e00) TM 1000: _localCommit: after _refreshUnitInfo, st=SUCCESS 00000074.0065e734 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:15:07 2019:src/rdb/TM.cc:2080 (thr_id:0x81b146e00) TM 1000: Local commit for TID <5,981338,981338> label 'job_manager job_sched check claimable' : time: 2 msec; result: SUCCESS. 00000074.0065e735 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:15:07 2019:src/rdb/TM.cc:2964 (thr_id:0x81b146e00) TM 1000: secondary committed txn TID <5,981338,981338> (from <5,981337>). 00000074.0065e736 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:15:07 2019:src/rdb/TM.cc:2661 (thr_id:0x81d1e6a00) TM 1000: app commit: TID <5,981339,981339>. 00000074.0065e737 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:15:07 2019:src/rdb/TM.cc:2920 (thr_id:0x81b146e00) TM 1000: receives propagation of TID <5,981339,981339> (from <5,981338>). 00000074.0065e738 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:15:07 2019:src/rdb/TM.cc:2001 (thr_id:0x81b146e00) TM 1000: Begin commit for TID <5,981339,981339> labelOnly false label 'job_manager job_sched check claimable' 00000074.0065e739 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:15:07 2019:src/rdb/TM.cc:2012 (thr_id:0x81b146e00) TM 1000: _localCommit: before beginUpdate 00000074.0065e73a 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:15:07 2019:src/rdb/TM.cc:2018 (thr_id:0x81b146e00) TM 1000: _localCommit: after beginUpdate 00000074.0065e73b 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:15:07 2019:src/rdb/TM.cc:2026 (thr_id:0x81b146e00) TM 1000: _localCommit: after saveTxnChanges (dbId=484), st=SUCCESS 00000074.0065e73c 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:15:07 2019:src/rdb/TM.cc:2030 (thr_id:0x81b146e00) TM 1000: _localCommit: before LocalUnit::commit 00000074.0065e73d 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:15:07 2019:src/rdb/TM.cc:2045 (thr_id:0x81b146e00) TM 1000: _localCommit: after LocalUnit::commit, st=SUCCESS 00000074.0065e73e 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:15:07 2019:src/rdb/TM.cc:2053 (thr_id:0x81b146e00) TM 1000: _localCommit: after _refreshUnitInfo, st=SUCCESS 00000074.0065e73f 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:15:07 2019:src/rdb/TM.cc:2080 (thr_id:0x81b146e00) TM 1000: Local commit for TID <5,981339,981339> label 'job_manager job_sched check claimable' : time: 2 msec; result: SUCCESS. 00000074.0065e740 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:15:07 2019:src/rdb/TM.cc:2964 (thr_id:0x81b146e00) TM 1000: secondary committed txn TID <5,981339,981339> (from <5,981338>). 00000074.0065e741 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:15:07 2019:src/rdb/TM.cc:2920 (thr_id:0x81b146e00) TM 1000: receives propagation of TID <5,981340,981340> (from <5,981339>). 00000074.0065e742 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:15:07 2019:src/rdb/TM.cc:2001 (thr_id:0x81b146e00) TM 1000: Begin commit for TID <5,981340,981340> labelOnly false label 'job_manager job enqueue' 00000074.0065e743 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:15:07 2019:src/rdb/TM.cc:2012 (thr_id:0x81b146e00) TM 1000: _localCommit: before beginUpdate 00000074.0065e744 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:15:07 2019:src/rdb/TM.cc:2018 (thr_id:0x81b146e00) TM 1000: _localCommit: after beginUpdate 00000074.0065e745 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:15:07 2019:src/rdb/TM.cc:2026 (thr_id:0x81b146e00) TM 1000: _localCommit: after saveTxnChanges (dbId=481), st=SUCCESS 00000074.0065e746 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:15:07 2019:src/rdb/TM.cc:2026 (thr_id:0x81b146e00) TM 1000: _localCommit: after saveTxnChanges (dbId=484), st=SUCCESS 00000074.0065e747 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:15:07 2019:src/rdb/TM.cc:2030 (thr_id:0x81b146e00) TM 1000: _localCommit: before LocalUnit::commit 00000074.0065e748 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:15:07 2019:src/rdb/TM.cc:2045 (thr_id:0x81b146e00) TM 1000: _localCommit: after LocalUnit::commit, st=SUCCESS 00000074.0065e749 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:15:07 2019:src/rdb/TM.cc:2053 (thr_id:0x81b146e00) TM 1000: _localCommit: after _refreshUnitInfo, st=SUCCESS 00000074.0065e74a 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:15:07 2019:src/rdb/TM.cc:2080 (thr_id:0x81b146e00) TM 1000: Local commit for TID <5,981340,981340> label 'job_manager job enqueue' : time: 2 msec; result: SUCCESS. 00000074.0065e74b 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:15:07 2019:src/rdb/TM.cc:2964 (thr_id:0x81b146e00) TM 1000: secondary committed txn TID <5,981340,981340> (from <5,981339>). 00000074.0065e74c 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:15:07 2019:src/rdb/TM.cc:2920 (thr_id:0x81b146e00) TM 1000: receives propagation of TID <5,981341,981341> (from <5,981340>). 00000074.0065e74d 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:15:07 2019:src/rdb/TM.cc:2001 (thr_id:0x81b146e00) TM 1000: Begin commit for TID <5,981341,981341> labelOnly false label 'job_manager job enqueue' 00000074.0065e74e 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:15:07 2019:src/rdb/TM.cc:2012 (thr_id:0x81b146e00) TM 1000: _localCommit: before beginUpdate 00000074.0065e74f 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:15:07 2019:src/rdb/TM.cc:2018 (thr_id:0x81b146e00) TM 1000: _localCommit: after beginUpdate 00000074.0065e750 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:15:07 2019:src/rdb/TM.cc:2026 (thr_id:0x81b146e00) TM 1000: _localCommit: after saveTxnChanges (dbId=481), st=SUCCESS 00000074.0065e751 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:15:07 2019:src/rdb/TM.cc:2026 (thr_id:0x81b146e00) TM 1000: _localCommit: after saveTxnChanges (dbId=484), st=SUCCESS 00000074.0065e752 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:15:07 2019:src/rdb/TM.cc:2030 (thr_id:0x81b146e00) TM 1000: _localCommit: before LocalUnit::commit 00000074.0065e753 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:15:07 2019:src/rdb/TM.cc:2045 (thr_id:0x81b146e00) TM 1000: _localCommit: after LocalUnit::commit, st=SUCCESS 00000074.0065e754 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:15:07 2019:src/rdb/TM.cc:2053 (thr_id:0x81b146e00) TM 1000: _localCommit: after _refreshUnitInfo, st=SUCCESS 00000074.0065e755 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:15:07 2019:src/rdb/TM.cc:2080 (thr_id:0x81b146e00) TM 1000: Local commit for TID <5,981341,981341> label 'job_manager job enqueue' : time: 1 msec; result: SUCCESS. 00000074.0065e756 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:15:07 2019:src/rdb/TM.cc:2964 (thr_id:0x81b146e00) TM 1000: secondary committed txn TID <5,981341,981341> (from <5,981340>). 00000074.0065e757 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:15:12 2019:src/rdb/TM.cc:2920 (thr_id:0x81b146e00) TM 1000: receives propagation of TID <5,981342,981342> (from <5,981341>). 00000074.0065e758 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:15:12 2019:src/rdb/TM.cc:2001 (thr_id:0x81b146e00) TM 1000: Begin commit for TID <5,981342,981342> labelOnly false label 'job_manager job tx loop' 00000074.0065e759 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:15:12 2019:src/rdb/TM.cc:2012 (thr_id:0x81b146e00) TM 1000: _localCommit: before beginUpdate 00000074.0065e75a 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:15:12 2019:src/rdb/TM.cc:2018 (thr_id:0x81b146e00) TM 1000: _localCommit: after beginUpdate 00000074.0065e75b 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:15:12 2019:src/rdb/TM.cc:2026 (thr_id:0x81b146e00) TM 1000: _localCommit: after saveTxnChanges (dbId=484), st=SUCCESS 00000074.0065e75c 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:15:12 2019:src/rdb/TM.cc:2030 (thr_id:0x81b146e00) TM 1000: _localCommit: before LocalUnit::commit 00000074.0065e75d 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:15:12 2019:src/rdb/TM.cc:2045 (thr_id:0x81b146e00) TM 1000: _localCommit: after LocalUnit::commit, st=SUCCESS 00000074.0065e75e 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:15:12 2019:src/rdb/TM.cc:2053 (thr_id:0x81b146e00) TM 1000: _localCommit: after _refreshUnitInfo, st=SUCCESS 00000074.0065e75f 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:15:12 2019:src/rdb/TM.cc:2080 (thr_id:0x81b146e00) TM 1000: Local commit for TID <5,981342,981342> label 'job_manager job tx loop' : time: 2 msec; result: SUCCESS. 00000074.0065e760 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:15:12 2019:src/rdb/TM.cc:2964 (thr_id:0x81b146e00) TM 1000: secondary committed txn TID <5,981342,981342> (from <5,981341>). 00000074.0065e761 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:15:36 2019:src/rdb/TM.cc:2661 (thr_id:0x81d1e6a00) TM 1000: app commit: TID <5,981343,981343>. 00000074.0065e762 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:15:36 2019:src/rdb/TM.cc:2920 (thr_id:0x81b146e00) TM 1000: receives propagation of TID <5,981343,981343> (from <5,981342>). 00000074.0065e763 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:15:36 2019:src/rdb/TM.cc:2001 (thr_id:0x81b146e00) TM 1000: Begin commit for TID <5,981343,981343> labelOnly false label 'filerep_publish' 00000074.0065e764 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:15:36 2019:src/rdb/TM.cc:2012 (thr_id:0x81b146e00) TM 1000: _localCommit: before beginUpdate 00000074.0065e765 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:15:36 2019:src/rdb/TM.cc:2018 (thr_id:0x81b146e00) TM 1000: _localCommit: after beginUpdate 00000074.0065e766 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:15:36 2019:src/rdb/TM.cc:2026 (thr_id:0x81b146e00) TM 1000: _localCommit: after saveTxnChanges (dbId=25), st=SUCCESS 00000074.0065e767 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:15:36 2019:src/rdb/TM.cc:2026 (thr_id:0x81b146e00) TM 1000: _localCommit: after saveTxnChanges (dbId=487), st=SUCCESS 00000074.0065e768 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:15:36 2019:src/rdb/TM.cc:2030 (thr_id:0x81b146e00) TM 1000: _localCommit: before LocalUnit::commit 00000074.0065e769 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:15:36 2019:src/rdb/TM.cc:2045 (thr_id:0x81b146e00) TM 1000: _localCommit: after LocalUnit::commit, st=SUCCESS 00000074.0065e76a 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:15:36 2019:src/rdb/TM.cc:2053 (thr_id:0x81b146e00) TM 1000: _localCommit: after _refreshUnitInfo, st=SUCCESS 00000074.0065e76b 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:15:36 2019:src/rdb/TM.cc:2080 (thr_id:0x81b146e00) TM 1000: Local commit for TID <5,981343,981343> label 'filerep_publish' : time: 2 msec; result: SUCCESS. 00000074.0065e76c 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:15:36 2019:src/rdb/TM.cc:2964 (thr_id:0x81b146e00) TM 1000: secondary committed txn TID <5,981343,981343> (from <5,981342>). 00000074.0065e76d 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:15:36 2019:src/rdb/TM.cc:2661 (thr_id:0x81d1ea100) TM 1000: app commit: TID <5,981344,981344>. 00000074.0065e76e 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:15:36 2019:src/rdb/TM.cc:2920 (thr_id:0x81b146e00) TM 1000: receives propagation of TID <5,981344,981344> (from <5,981343>). 00000074.0065e76f 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:15:36 2019:src/rdb/TM.cc:2001 (thr_id:0x81b146e00) TM 1000: Begin commit for TID <5,981344,981344> labelOnly false label 'job_manager job tx loop' 00000074.0065e770 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:15:36 2019:src/rdb/TM.cc:2012 (thr_id:0x81b146e00) TM 1000: _localCommit: before beginUpdate 00000074.0065e771 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:15:36 2019:src/rdb/TM.cc:2018 (thr_id:0x81b146e00) TM 1000: _localCommit: after beginUpdate 00000074.0065e772 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:15:36 2019:src/rdb/TM.cc:2026 (thr_id:0x81b146e00) TM 1000: _localCommit: after saveTxnChanges (dbId=484), st=SUCCESS 00000074.0065e773 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:15:36 2019:src/rdb/TM.cc:2030 (thr_id:0x81b146e00) TM 1000: _localCommit: before LocalUnit::commit 00000074.0065e774 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:15:36 2019:src/rdb/TM.cc:2045 (thr_id:0x81b146e00) TM 1000: _localCommit: after LocalUnit::commit, st=SUCCESS 00000074.0065e775 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:15:36 2019:src/rdb/TM.cc:2053 (thr_id:0x81b146e00) TM 1000: _localCommit: after _refreshUnitInfo, st=SUCCESS 00000074.0065e776 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:15:36 2019:src/rdb/TM.cc:2080 (thr_id:0x81b146e00) TM 1000: Local commit for TID <5,981344,981344> label 'job_manager job tx loop' : time: 2 msec; result: SUCCESS. 00000074.0065e777 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:15:36 2019:src/rdb/TM.cc:2964 (thr_id:0x81b146e00) TM 1000: secondary committed txn TID <5,981344,981344> (from <5,981343>). 00000074.0065e778 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:16:48 2019:src/rdb/TM.cc:2920 (thr_id:0x81b146900) TM 1000: receives propagation of TID <5,981346,981346> (from <5,981344>). 00000074.0065e779 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:16:48 2019:src/rdb/TM.cc:2001 (thr_id:0x81b146900) TM 1000: Begin commit for TID <5,981346,981346> labelOnly false label 'SP: rdb-info-update lock' 00000074.0065e77a 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:16:48 2019:src/rdb/TM.cc:2012 (thr_id:0x81b146900) TM 1000: _localCommit: before beginUpdate 00000074.0065e77b 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:16:48 2019:src/rdb/TM.cc:2018 (thr_id:0x81b146900) TM 1000: _localCommit: after beginUpdate 00000074.0065e77c 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:16:48 2019:src/rdb/TM.cc:2026 (thr_id:0x81b146900) TM 1000: _localCommit: after saveTxnChanges (dbId=145), st=SUCCESS 00000074.0065e77d 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:16:48 2019:src/rdb/TM.cc:2030 (thr_id:0x81b146900) TM 1000: _localCommit: before LocalUnit::commit 00000074.0065e77e 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:16:48 2019:src/rdb/TM.cc:2045 (thr_id:0x81b146900) TM 1000: _localCommit: after LocalUnit::commit, st=SUCCESS 00000074.0065e77f 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:16:48 2019:src/rdb/TM.cc:2053 (thr_id:0x81b146900) TM 1000: _localCommit: after _refreshUnitInfo, st=SUCCESS 00000074.0065e780 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:16:48 2019:src/rdb/TM.cc:2080 (thr_id:0x81b146900) TM 1000: Local commit for TID <5,981346,981346> label 'SP: rdb-info-update lock' : time: 2 msec; result: SUCCESS. 00000074.0065e781 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:16:48 2019:src/rdb/TM.cc:2964 (thr_id:0x81b146900) TM 1000: secondary committed txn TID <5,981346,981346> (from <5,981344>). 00000074.0065e782 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:17:36 2019:src/rdb/TM.cc:2661 (thr_id:0x81d1ea100) TM 1000: app commit: TID <5,981347,981347>. 00000074.0065e783 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:17:36 2019:src/rdb/TM.cc:2920 (thr_id:0x81b146900) TM 1000: receives propagation of TID <5,981347,981347> (from <5,981346>). 00000074.0065e784 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:17:36 2019:src/rdb/TM.cc:2001 (thr_id:0x81b146900) TM 1000: Begin commit for TID <5,981347,981347> labelOnly false label 'job_manager job tx loop' 00000074.0065e785 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:17:36 2019:src/rdb/TM.cc:2012 (thr_id:0x81b146900) TM 1000: _localCommit: before beginUpdate 00000074.0065e786 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:17:36 2019:src/rdb/TM.cc:2018 (thr_id:0x81b146900) TM 1000: _localCommit: after beginUpdate 00000074.0065e787 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:17:36 2019:src/rdb/TM.cc:2026 (thr_id:0x81b146900) TM 1000: _localCommit: after saveTxnChanges (dbId=484), st=SUCCESS 00000074.0065e788 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:17:36 2019:src/rdb/TM.cc:2030 (thr_id:0x81b146900) TM 1000: _localCommit: before LocalUnit::commit 00000074.0065e789 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:17:36 2019:src/rdb/TM.cc:2045 (thr_id:0x81b146900) TM 1000: _localCommit: after LocalUnit::commit, st=SUCCESS 00000074.0065e78a 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:17:36 2019:src/rdb/TM.cc:2053 (thr_id:0x81b146900) TM 1000: _localCommit: after _refreshUnitInfo, st=SUCCESS 00000074.0065e78b 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:17:36 2019:src/rdb/TM.cc:2080 (thr_id:0x81b146900) TM 1000: Local commit for TID <5,981347,981347> label 'job_manager job tx loop' : time: 2 msec; result: SUCCESS. 00000074.0065e78c 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:17:36 2019:src/rdb/TM.cc:2964 (thr_id:0x81b146900) TM 1000: secondary committed txn TID <5,981347,981347> (from <5,981346>). 00000074.0065e78d 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:17:55 2019:src/rdb/TM.cc:2920 (thr_id:0x81b146900) TM 1000: receives propagation of TID <5,981348,981348> (from <5,981347>). 00000074.0065e78e 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:17:55 2019:src/rdb/TM.cc:2001 (thr_id:0x81b146900) TM 1000: Begin commit for TID <5,981348,981348> labelOnly false label 'filerep_publish' 00000074.0065e78f 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:17:55 2019:src/rdb/TM.cc:2012 (thr_id:0x81b146900) TM 1000: _localCommit: before beginUpdate 00000074.0065e790 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:17:55 2019:src/rdb/TM.cc:2018 (thr_id:0x81b146900) TM 1000: _localCommit: after beginUpdate 00000074.0065e791 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:17:55 2019:src/rdb/TM.cc:2026 (thr_id:0x81b146900) TM 1000: _localCommit: after saveTxnChanges (dbId=25), st=SUCCESS 00000074.0065e792 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:17:55 2019:src/rdb/TM.cc:2026 (thr_id:0x81b146900) TM 1000: _localCommit: after saveTxnChanges (dbId=487), st=SUCCESS 00000074.0065e793 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:17:55 2019:src/rdb/TM.cc:2030 (thr_id:0x81b146900) TM 1000: _localCommit: before LocalUnit::commit 00000074.0065e794 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:17:55 2019:src/rdb/TM.cc:2045 (thr_id:0x81b146900) TM 1000: _localCommit: after LocalUnit::commit, st=SUCCESS 00000074.0065e795 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:17:55 2019:src/rdb/TM.cc:2053 (thr_id:0x81b146900) TM 1000: _localCommit: after _refreshUnitInfo, st=SUCCESS 00000074.0065e796 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:17:55 2019:src/rdb/TM.cc:2080 (thr_id:0x81b146900) TM 1000: Local commit for TID <5,981348,981348> label 'filerep_publish' : time: 2 msec; result: SUCCESS. 00000074.0065e797 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:17:55 2019:src/rdb/TM.cc:2964 (thr_id:0x81b146900) TM 1000: secondary committed txn TID <5,981348,981348> (from <5,981347>). 00000074.0065e798 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:17:55 2019:src/rdb/TM.cc:2920 (thr_id:0x81b146900) TM 1000: receives propagation of TID <5,981349,981349> (from <5,981348>). 00000074.0065e799 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:17:55 2019:src/rdb/TM.cc:2001 (thr_id:0x81b146900) TM 1000: Begin commit for TID <5,981349,981349> labelOnly false label 'job_manager job tx loop' 00000074.0065e79a 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:17:55 2019:src/rdb/TM.cc:2012 (thr_id:0x81b146900) TM 1000: _localCommit: before beginUpdate 00000074.0065e79b 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:17:55 2019:src/rdb/TM.cc:2018 (thr_id:0x81b146900) TM 1000: _localCommit: after beginUpdate 00000074.0065e79c 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:17:55 2019:src/rdb/TM.cc:2026 (thr_id:0x81b146900) TM 1000: _localCommit: after saveTxnChanges (dbId=484), st=SUCCESS 00000074.0065e79d 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:17:55 2019:src/rdb/TM.cc:2030 (thr_id:0x81b146900) TM 1000: _localCommit: before LocalUnit::commit 00000074.0065e79e 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:17:56 2019:src/rdb/TM.cc:2045 (thr_id:0x81b146900) TM 1000: _localCommit: after LocalUnit::commit, st=SUCCESS 00000074.0065e79f 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:17:56 2019:src/rdb/TM.cc:2053 (thr_id:0x81b146900) TM 1000: _localCommit: after _refreshUnitInfo, st=SUCCESS 00000074.0065e7a0 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:17:56 2019:src/rdb/TM.cc:2080 (thr_id:0x81b146900) TM 1000: Local commit for TID <5,981349,981349> label 'job_manager job tx loop' : time: 1 msec; result: SUCCESS. 00000074.0065e7a1 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:17:56 2019:src/rdb/TM.cc:2964 (thr_id:0x81b146900) TM 1000: secondary committed txn TID <5,981349,981349> (from <5,981348>). 00000074.0065e7a2 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:18:09 2019:src/rdb/TM.cc:2661 (thr_id:0x81da82500) TM 1000: app commit: TID <5,981350,981350>. 00000074.0065e7a3 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:18:09 2019:src/rdb/TM.cc:2920 (thr_id:0x81b146900) TM 1000: receives propagation of TID <5,981350,981350> (from <5,981349>). 00000074.0065e7a4 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:18:09 2019:src/rdb/TM.cc:2001 (thr_id:0x81b146900) TM 1000: Begin commit for TID <5,981350,981350> labelOnly false label 'replication_package modify' 00000074.0065e7a5 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:18:09 2019:src/rdb/TM.cc:2012 (thr_id:0x81b146900) TM 1000: _localCommit: before beginUpdate 00000074.0065e7a6 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:18:09 2019:src/rdb/TM.cc:2018 (thr_id:0x81b146900) TM 1000: _localCommit: after beginUpdate 00000074.0065e7a7 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:18:09 2019:src/rdb/TM.cc:2026 (thr_id:0x81b146900) TM 1000: _localCommit: after saveTxnChanges (dbId=487), st=SUCCESS 00000074.0065e7a8 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:18:09 2019:src/rdb/TM.cc:2030 (thr_id:0x81b146900) TM 1000: _localCommit: before LocalUnit::commit 00000074.0065e7a9 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:18:09 2019:src/rdb/TM.cc:2045 (thr_id:0x81b146900) TM 1000: _localCommit: after LocalUnit::commit, st=SUCCESS 00000074.0065e7aa 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:18:09 2019:src/rdb/TM.cc:2053 (thr_id:0x81b146900) TM 1000: _localCommit: after _refreshUnitInfo, st=SUCCESS 00000074.0065e7ab 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:18:09 2019:src/rdb/TM.cc:2080 (thr_id:0x81b146900) TM 1000: Local commit for TID <5,981350,981350> label 'replication_package modify' : time: 1 msec; result: SUCCESS. 00000074.0065e7ac 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:18:09 2019:src/rdb/TM.cc:2964 (thr_id:0x81b146900) TM 1000: secondary committed txn TID <5,981350,981350> (from <5,981349>). 00000074.0065e7ad 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:18:09 2019:src/rdb/TM.cc:2920 (thr_id:0x81b146900) TM 1000: receives propagation of TID <5,981351,981351> (from <5,981350>). 00000074.0065e7ae 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:18:09 2019:src/rdb/TM.cc:2001 (thr_id:0x81b146900) TM 1000: Begin commit for TID <5,981351,981351> labelOnly false label 'replication_package create' 00000074.0065e7af 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:18:09 2019:src/rdb/TM.cc:2012 (thr_id:0x81b146900) TM 1000: _localCommit: before beginUpdate 00000074.0065e7b0 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:18:09 2019:src/rdb/TM.cc:2018 (thr_id:0x81b146900) TM 1000: _localCommit: after beginUpdate 00000074.0065e7b1 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:18:09 2019:src/rdb/TM.cc:2026 (thr_id:0x81b146900) TM 1000: _localCommit: after saveTxnChanges (dbId=487), st=SUCCESS 00000074.0065e7b2 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:18:09 2019:src/rdb/TM.cc:2030 (thr_id:0x81b146900) TM 1000: _localCommit: before LocalUnit::commit 00000074.0065e7b3 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:18:09 2019:src/rdb/TM.cc:2045 (thr_id:0x81b146900) TM 1000: _localCommit: after LocalUnit::commit, st=SUCCESS 00000074.0065e7b4 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:18:09 2019:src/rdb/TM.cc:2053 (thr_id:0x81b146900) TM 1000: _localCommit: after _refreshUnitInfo, st=SUCCESS 00000074.0065e7b5 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:18:09 2019:src/rdb/TM.cc:2080 (thr_id:0x81b146900) TM 1000: Local commit for TID <5,981351,981351> label 'replication_package create' : time: 1 msec; result: SUCCESS. 00000074.0065e7b6 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:18:09 2019:src/rdb/TM.cc:2964 (thr_id:0x81b146900) TM 1000: secondary committed txn TID <5,981351,981351> (from <5,981350>). 00000074.0065e7b7 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:18:10 2019:src/rdb/TM.cc:2920 (thr_id:0x81b146900) TM 1000: receives propagation of TID <5,981352,981352> (from <5,981351>). 00000074.0065e7b8 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:18:10 2019:src/rdb/TM.cc:2001 (thr_id:0x81b146900) TM 1000: Begin commit for TID <5,981352,981352> labelOnly false label 'replication_package remove' 00000074.0065e7b9 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:18:10 2019:src/rdb/TM.cc:2012 (thr_id:0x81b146900) TM 1000: _localCommit: before beginUpdate 00000074.0065e7ba 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:18:10 2019:src/rdb/TM.cc:2018 (thr_id:0x81b146900) TM 1000: _localCommit: after beginUpdate 00000074.0065e7bb 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:18:10 2019:src/rdb/TM.cc:2026 (thr_id:0x81b146900) TM 1000: _localCommit: after saveTxnChanges (dbId=487), st=SUCCESS 00000074.0065e7bc 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:18:10 2019:src/rdb/TM.cc:2030 (thr_id:0x81b146900) TM 1000: _localCommit: before LocalUnit::commit 00000074.0065e7bd 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:18:10 2019:src/rdb/TM.cc:2045 (thr_id:0x81b146900) TM 1000: _localCommit: after LocalUnit::commit, st=SUCCESS 00000074.0065e7be 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:18:10 2019:src/rdb/TM.cc:2053 (thr_id:0x81b146900) TM 1000: _localCommit: after _refreshUnitInfo, st=SUCCESS 00000074.0065e7bf 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:18:10 2019:src/rdb/TM.cc:2080 (thr_id:0x81b146900) TM 1000: Local commit for TID <5,981352,981352> label 'replication_package remove' : time: 2 msec; result: SUCCESS. 00000074.0065e7c0 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:18:10 2019:src/rdb/TM.cc:2964 (thr_id:0x81b146900) TM 1000: secondary committed txn TID <5,981352,981352> (from <5,981351>). 00000074.0065e7c1 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:18:10 2019:src/rdb/TM.cc:2920 (thr_id:0x81b146900) TM 1000: receives propagation of TID <5,981353,981353> (from <5,981352>). 00000074.0065e7c2 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:18:10 2019:src/rdb/TM.cc:2001 (thr_id:0x81b146900) TM 1000: Begin commit for TID <5,981353,981353> labelOnly false label 'replication_package remove' 00000074.0065e7c3 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:18:10 2019:src/rdb/TM.cc:2012 (thr_id:0x81b146900) TM 1000: _localCommit: before beginUpdate 00000074.0065e7c4 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:18:10 2019:src/rdb/TM.cc:2018 (thr_id:0x81b146900) TM 1000: _localCommit: after beginUpdate 00000074.0065e7c5 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:18:10 2019:src/rdb/TM.cc:2026 (thr_id:0x81b146900) TM 1000: _localCommit: after saveTxnChanges (dbId=487), st=SUCCESS 00000074.0065e7c6 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:18:10 2019:src/rdb/TM.cc:2030 (thr_id:0x81b146900) TM 1000: _localCommit: before LocalUnit::commit 00000074.0065e7c7 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:18:10 2019:src/rdb/TM.cc:2045 (thr_id:0x81b146900) TM 1000: _localCommit: after LocalUnit::commit, st=SUCCESS 00000074.0065e7c8 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:18:10 2019:src/rdb/TM.cc:2053 (thr_id:0x81b146900) TM 1000: _localCommit: after _refreshUnitInfo, st=SUCCESS 00000074.0065e7c9 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:18:10 2019:src/rdb/TM.cc:2080 (thr_id:0x81b146900) TM 1000: Local commit for TID <5,981353,981353> label 'replication_package remove' : time: 1 msec; result: SUCCESS. 00000074.0065e7ca 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:18:10 2019:src/rdb/TM.cc:2964 (thr_id:0x81b146900) TM 1000: secondary committed txn TID <5,981353,981353> (from <5,981352>). 00000074.0065e7cb 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:18:10 2019:src/rdb/TM.cc:2920 (thr_id:0x81b146900) TM 1000: receives propagation of TID <5,981354,981354> (from <5,981353>). 00000074.0065e7cc 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:18:10 2019:src/rdb/TM.cc:2001 (thr_id:0x81b146900) TM 1000: Begin commit for TID <5,981354,981354> labelOnly false label 'replication_package remove' 00000074.0065e7cd 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:18:10 2019:src/rdb/TM.cc:2012 (thr_id:0x81b146900) TM 1000: _localCommit: before beginUpdate 00000074.0065e7ce 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:18:10 2019:src/rdb/TM.cc:2018 (thr_id:0x81b146900) TM 1000: _localCommit: after beginUpdate 00000074.0065e7cf 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:18:10 2019:src/rdb/TM.cc:2026 (thr_id:0x81b146900) TM 1000: _localCommit: after saveTxnChanges (dbId=487), st=SUCCESS 00000074.0065e7d0 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:18:10 2019:src/rdb/TM.cc:2030 (thr_id:0x81b146900) TM 1000: _localCommit: before LocalUnit::commit 00000074.0065e7d1 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:18:10 2019:src/rdb/TM.cc:2045 (thr_id:0x81b146900) TM 1000: _localCommit: after LocalUnit::commit, st=SUCCESS 00000074.0065e7d2 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:18:10 2019:src/rdb/TM.cc:2053 (thr_id:0x81b146900) TM 1000: _localCommit: after _refreshUnitInfo, st=SUCCESS 00000074.0065e7d3 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:18:10 2019:src/rdb/TM.cc:2080 (thr_id:0x81b146900) TM 1000: Local commit for TID <5,981354,981354> label 'replication_package remove' : time: 2 msec; result: SUCCESS. 00000074.0065e7d4 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:18:10 2019:src/rdb/TM.cc:2964 (thr_id:0x81b146900) TM 1000: secondary committed txn TID <5,981354,981354> (from <5,981353>). 00000074.0065e7d5 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:18:35 2019:src/rdb/TM.cc:2920 (thr_id:0x81b146900) TM 1000: receives propagation of TID <5,981355,981355> (from <5,981354>). 00000074.0065e7d6 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:18:35 2019:src/rdb/TM.cc:2001 (thr_id:0x81b146900) TM 1000: Begin commit for TID <5,981355,981355> labelOnly false label 'filerep_publish' 00000074.0065e7d7 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:18:35 2019:src/rdb/TM.cc:2012 (thr_id:0x81b146900) TM 1000: _localCommit: before beginUpdate 00000074.0065e7d8 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:18:35 2019:src/rdb/TM.cc:2018 (thr_id:0x81b146900) TM 1000: _localCommit: after beginUpdate 00000074.0065e7d9 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:18:35 2019:src/rdb/TM.cc:2026 (thr_id:0x81b146900) TM 1000: _localCommit: after saveTxnChanges (dbId=25), st=SUCCESS 00000074.0065e7da 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:18:35 2019:src/rdb/TM.cc:2026 (thr_id:0x81b146900) TM 1000: _localCommit: after saveTxnChanges (dbId=487), st=SUCCESS 00000074.0065e7db 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:18:35 2019:src/rdb/TM.cc:2030 (thr_id:0x81b146900) TM 1000: _localCommit: before LocalUnit::commit 00000074.0065e7dc 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:18:35 2019:src/rdb/TM.cc:2045 (thr_id:0x81b146900) TM 1000: _localCommit: after LocalUnit::commit, st=SUCCESS 00000074.0065e7dd 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:18:35 2019:src/rdb/TM.cc:2053 (thr_id:0x81b146900) TM 1000: _localCommit: after _refreshUnitInfo, st=SUCCESS 00000074.0065e7de 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:18:35 2019:src/rdb/TM.cc:2080 (thr_id:0x81b146900) TM 1000: Local commit for TID <5,981355,981355> label 'filerep_publish' : time: 2 msec; result: SUCCESS. 00000074.0065e7df 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:18:35 2019:src/rdb/TM.cc:2964 (thr_id:0x81b146900) TM 1000: secondary committed txn TID <5,981355,981355> (from <5,981354>). 00000074.0065e7e0 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:18:35 2019:src/rdb/TM.cc:2920 (thr_id:0x81b146900) TM 1000: receives propagation of TID <5,981356,981356> (from <5,981355>). 00000074.0065e7e1 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:18:35 2019:src/rdb/TM.cc:2001 (thr_id:0x81b146900) TM 1000: Begin commit for TID <5,981356,981356> labelOnly false label 'job_manager job enqueue' 00000074.0065e7e2 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:18:35 2019:src/rdb/TM.cc:2012 (thr_id:0x81b146900) TM 1000: _localCommit: before beginUpdate 00000074.0065e7e3 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:18:35 2019:src/rdb/TM.cc:2018 (thr_id:0x81b146900) TM 1000: _localCommit: after beginUpdate 00000074.0065e7e4 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:18:35 2019:src/rdb/TM.cc:2026 (thr_id:0x81b146900) TM 1000: _localCommit: after saveTxnChanges (dbId=481), st=SUCCESS 00000074.0065e7e5 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:18:35 2019:src/rdb/TM.cc:2026 (thr_id:0x81b146900) TM 1000: _localCommit: after saveTxnChanges (dbId=484), st=SUCCESS 00000074.0065e7e6 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:18:35 2019:src/rdb/TM.cc:2030 (thr_id:0x81b146900) TM 1000: _localCommit: before LocalUnit::commit 00000074.0065e7e7 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:18:35 2019:src/rdb/TM.cc:2045 (thr_id:0x81b146900) TM 1000: _localCommit: after LocalUnit::commit, st=SUCCESS 00000074.0065e7e8 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:18:35 2019:src/rdb/TM.cc:2053 (thr_id:0x81b146900) TM 1000: _localCommit: after _refreshUnitInfo, st=SUCCESS 00000074.0065e7e9 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:18:35 2019:src/rdb/TM.cc:2080 (thr_id:0x81b146900) TM 1000: Local commit for TID <5,981356,981356> label 'job_manager job enqueue' : time: 2 msec; result: SUCCESS. 00000074.0065e7ea 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:18:35 2019:src/rdb/TM.cc:2964 (thr_id:0x81b146900) TM 1000: secondary committed txn TID <5,981356,981356> (from <5,981355>). 00000074.0065e7eb 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:18:37 2019:src/rdb/TM.cc:2920 (thr_id:0x81b146900) TM 1000: receives propagation of TID <5,981357,981357> (from <5,981356>). 00000074.0065e7ec 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:18:37 2019:src/rdb/TM.cc:2001 (thr_id:0x81b146900) TM 1000: Begin commit for TID <5,981357,981357> labelOnly false label 'replication_package modify' 00000074.0065e7ed 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:18:37 2019:src/rdb/TM.cc:2012 (thr_id:0x81b146900) TM 1000: _localCommit: before beginUpdate 00000074.0065e7ee 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:18:37 2019:src/rdb/TM.cc:2018 (thr_id:0x81b146900) TM 1000: _localCommit: after beginUpdate 00000074.0065e7ef 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:18:37 2019:src/rdb/TM.cc:2026 (thr_id:0x81b146900) TM 1000: _localCommit: after saveTxnChanges (dbId=487), st=SUCCESS 00000074.0065e7f0 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:18:37 2019:src/rdb/TM.cc:2030 (thr_id:0x81b146900) TM 1000: _localCommit: before LocalUnit::commit 00000074.0065e7f1 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:18:37 2019:src/rdb/TM.cc:2045 (thr_id:0x81b146900) TM 1000: _localCommit: after LocalUnit::commit, st=SUCCESS 00000074.0065e7f2 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:18:37 2019:src/rdb/TM.cc:2053 (thr_id:0x81b146900) TM 1000: _localCommit: after _refreshUnitInfo, st=SUCCESS 00000074.0065e7f3 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:18:37 2019:src/rdb/TM.cc:2080 (thr_id:0x81b146900) TM 1000: Local commit for TID <5,981357,981357> label 'replication_package modify' : time: 2 msec; result: SUCCESS. 00000074.0065e7f4 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:18:37 2019:src/rdb/TM.cc:2964 (thr_id:0x81b146900) TM 1000: secondary committed txn TID <5,981357,981357> (from <5,981356>). 00000074.0065e7f5 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:18:38 2019:src/rdb/TM.cc:2661 (thr_id:0x81d1e6a00) TM 1000: app commit: TID <5,981358,981358>. 00000074.0065e7f6 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:18:38 2019:src/rdb/TM.cc:2920 (thr_id:0x81b146900) TM 1000: receives propagation of TID <5,981358,981358> (from <5,981357>). 00000074.0065e7f7 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:18:38 2019:src/rdb/TM.cc:2001 (thr_id:0x81b146900) TM 1000: Begin commit for TID <5,981358,981358> labelOnly false label 'replication_package create' 00000074.0065e7f8 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:18:38 2019:src/rdb/TM.cc:2012 (thr_id:0x81b146900) TM 1000: _localCommit: before beginUpdate 00000074.0065e7f9 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:18:38 2019:src/rdb/TM.cc:2018 (thr_id:0x81b146900) TM 1000: _localCommit: after beginUpdate 00000074.0065e7fa 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:18:38 2019:src/rdb/TM.cc:2026 (thr_id:0x81b146900) TM 1000: _localCommit: after saveTxnChanges (dbId=487), st=SUCCESS 00000074.0065e7fb 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:18:38 2019:src/rdb/TM.cc:2030 (thr_id:0x81b146900) TM 1000: _localCommit: before LocalUnit::commit 00000074.0065e7fc 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:18:38 2019:src/rdb/TM.cc:2045 (thr_id:0x81b146900) TM 1000: _localCommit: after LocalUnit::commit, st=SUCCESS 00000074.0065e7fd 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:18:38 2019:src/rdb/TM.cc:2053 (thr_id:0x81b146900) TM 1000: _localCommit: after _refreshUnitInfo, st=SUCCESS 00000074.0065e7fe 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:18:38 2019:src/rdb/TM.cc:2080 (thr_id:0x81b146900) TM 1000: Local commit for TID <5,981358,981358> label 'replication_package create' : time: 1 msec; result: SUCCESS. 00000074.0065e7ff 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:18:38 2019:src/rdb/TM.cc:2964 (thr_id:0x81b146900) TM 1000: secondary committed txn TID <5,981358,981358> (from <5,981357>). 00000074.0065e800 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:18:41 2019:src/rdb/TM.cc:2661 (thr_id:0x81d1ea100) TM 1000: app commit: TID <5,981359,981359>. 00000074.0065e801 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:18:41 2019:src/rdb/TM.cc:2920 (thr_id:0x81b146900) TM 1000: receives propagation of TID <5,981359,981359> (from <5,981358>). 00000074.0065e802 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:18:41 2019:src/rdb/TM.cc:2001 (thr_id:0x81b146900) TM 1000: Begin commit for TID <5,981359,981359> labelOnly false label 'job_manager job tx loop' 00000074.0065e803 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:18:41 2019:src/rdb/TM.cc:2012 (thr_id:0x81b146900) TM 1000: _localCommit: before beginUpdate 00000074.0065e804 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:18:41 2019:src/rdb/TM.cc:2018 (thr_id:0x81b146900) TM 1000: _localCommit: after beginUpdate 00000074.0065e805 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:18:41 2019:src/rdb/TM.cc:2026 (thr_id:0x81b146900) TM 1000: _localCommit: after saveTxnChanges (dbId=484), st=SUCCESS 00000074.0065e806 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:18:41 2019:src/rdb/TM.cc:2030 (thr_id:0x81b146900) TM 1000: _localCommit: before LocalUnit::commit 00000074.0065e807 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:18:41 2019:src/rdb/TM.cc:2045 (thr_id:0x81b146900) TM 1000: _localCommit: after LocalUnit::commit, st=SUCCESS 00000074.0065e808 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:18:41 2019:src/rdb/TM.cc:2053 (thr_id:0x81b146900) TM 1000: _localCommit: after _refreshUnitInfo, st=SUCCESS 00000074.0065e809 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:18:41 2019:src/rdb/TM.cc:2080 (thr_id:0x81b146900) TM 1000: Local commit for TID <5,981359,981359> label 'job_manager job tx loop' : time: 2 msec; result: SUCCESS. 00000074.0065e80a 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:18:41 2019:src/rdb/TM.cc:2964 (thr_id:0x81b146900) TM 1000: secondary committed txn TID <5,981359,981359> (from <5,981358>). 00000074.0065e80b 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:19:05 2019:src/rdb/TM.cc:2920 (thr_id:0x81b146900) TM 1000: receives propagation of TID <5,981360,981360> (from <5,981359>). 00000074.0065e80c 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:19:05 2019:src/rdb/TM.cc:2001 (thr_id:0x81b146900) TM 1000: Begin commit for TID <5,981360,981360> labelOnly false label 'replication_package remove' 00000074.0065e80d 243b8c4d Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:19:05 2019:src/rdb/TM.cc:2012 (thr_id:0x81b146900) TM 1000: _localCommit: before beginUpdate 00000074.0065e80e 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:19:05 2019:src/rdb/TM.cc:2018 (thr_id:0x81b146900) TM 1000: _localCommit: after beginUpdate 00000074.0065e80f 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:19:05 2019:src/rdb/TM.cc:2026 (thr_id:0x81b146900) TM 1000: _localCommit: after saveTxnChanges (dbId=487), st=SUCCESS 00000074.0065e810 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:19:05 2019:src/rdb/TM.cc:2030 (thr_id:0x81b146900) TM 1000: _localCommit: before LocalUnit::commit 00000074.0065e811 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:19:05 2019:src/rdb/TM.cc:2045 (thr_id:0x81b146900) TM 1000: _localCommit: after LocalUnit::commit, st=SUCCESS 00000074.0065e812 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:19:05 2019:src/rdb/TM.cc:2053 (thr_id:0x81b146900) TM 1000: _localCommit: after _refreshUnitInfo, st=SUCCESS 00000074.0065e813 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:19:05 2019:src/rdb/TM.cc:2080 (thr_id:0x81b146900) TM 1000: Local commit for TID <5,981360,981360> label 'replication_package remove' : time: 2 msec; result: SUCCESS. 00000074.0065e814 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:19:05 2019:src/rdb/TM.cc:2964 (thr_id:0x81b146900) TM 1000: secondary committed txn TID <5,981360,981360> (from <5,981359>). 00000074.0065e815 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:19:05 2019:src/rdb/TM.cc:2920 (thr_id:0x81b146900) TM 1000: receives propagation of TID <5,981361,981361> (from <5,981360>). 00000074.0065e816 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:19:05 2019:src/rdb/TM.cc:2001 (thr_id:0x81b146900) TM 1000: Begin commit for TID <5,981361,981361> labelOnly false label 'replication_package remove' 00000074.0065e817 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:19:05 2019:src/rdb/TM.cc:2012 (thr_id:0x81b146900) TM 1000: _localCommit: before beginUpdate 00000074.0065e818 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:19:05 2019:src/rdb/TM.cc:2018 (thr_id:0x81b146900) TM 1000: _localCommit: after beginUpdate 00000074.0065e819 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:19:05 2019:src/rdb/TM.cc:2026 (thr_id:0x81b146900) TM 1000: _localCommit: after saveTxnChanges (dbId=487), st=SUCCESS 00000074.0065e81a 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:19:05 2019:src/rdb/TM.cc:2030 (thr_id:0x81b146900) TM 1000: _localCommit: before LocalUnit::commit 00000074.0065e81b 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:19:05 2019:src/rdb/TM.cc:2045 (thr_id:0x81b146900) TM 1000: _localCommit: after LocalUnit::commit, st=SUCCESS 00000074.0065e81c 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:19:05 2019:src/rdb/TM.cc:2053 (thr_id:0x81b146900) TM 1000: _localCommit: after _refreshUnitInfo, st=SUCCESS 00000074.0065e81d 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:19:05 2019:src/rdb/TM.cc:2080 (thr_id:0x81b146900) TM 1000: Local commit for TID <5,981361,981361> label 'replication_package remove' : time: 2 msec; result: SUCCESS. 00000074.0065e81e 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:19:05 2019:src/rdb/TM.cc:2964 (thr_id:0x81b146900) TM 1000: secondary committed txn TID <5,981361,981361> (from <5,981360>). 00000074.0065e81f 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:19:05 2019:src/rdb/TM.cc:2920 (thr_id:0x81b146900) TM 1000: receives propagation of TID <5,981362,981362> (from <5,981361>). 00000074.0065e820 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:19:05 2019:src/rdb/TM.cc:2001 (thr_id:0x81b146900) TM 1000: Begin commit for TID <5,981362,981362> labelOnly false label 'job_manager job tx loop' 00000074.0065e821 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:19:05 2019:src/rdb/TM.cc:2012 (thr_id:0x81b146900) TM 1000: _localCommit: before beginUpdate 00000074.0065e822 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:19:05 2019:src/rdb/TM.cc:2018 (thr_id:0x81b146900) TM 1000: _localCommit: after beginUpdate 00000074.0065e823 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:19:05 2019:src/rdb/TM.cc:2026 (thr_id:0x81b146900) TM 1000: _localCommit: after saveTxnChanges (dbId=484), st=SUCCESS 00000074.0065e824 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:19:05 2019:src/rdb/TM.cc:2030 (thr_id:0x81b146900) TM 1000: _localCommit: before LocalUnit::commit 00000074.0065e825 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:19:05 2019:src/rdb/TM.cc:2045 (thr_id:0x81b146900) TM 1000: _localCommit: after LocalUnit::commit, st=SUCCESS 00000074.0065e826 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:19:05 2019:src/rdb/TM.cc:2053 (thr_id:0x81b146900) TM 1000: _localCommit: after _refreshUnitInfo, st=SUCCESS 00000074.0065e827 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:19:05 2019:src/rdb/TM.cc:2080 (thr_id:0x81b146900) TM 1000: Local commit for TID <5,981362,981362> label 'job_manager job tx loop' : time: 2 msec; result: SUCCESS. 00000074.0065e828 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:19:05 2019:src/rdb/TM.cc:2964 (thr_id:0x81b146900) TM 1000: secondary committed txn TID <5,981362,981362> (from <5,981361>). 00000074.0065e829 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:19:55 2019:src/rdb/TM.cc:2920 (thr_id:0x81b146900) TM 1000: receives propagation of TID <5,981363,981363> (from <5,981362>). 00000074.0065e82a 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:19:55 2019:src/rdb/TM.cc:2001 (thr_id:0x81b146900) TM 1000: Begin commit for TID <5,981363,981363> labelOnly false label 'job_manager job tx loop' 00000074.0065e82b 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:19:55 2019:src/rdb/TM.cc:2012 (thr_id:0x81b146900) TM 1000: _localCommit: before beginUpdate 00000074.0065e82c 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:19:55 2019:src/rdb/TM.cc:2018 (thr_id:0x81b146900) TM 1000: _localCommit: after beginUpdate 00000074.0065e82d 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:19:55 2019:src/rdb/TM.cc:2026 (thr_id:0x81b146900) TM 1000: _localCommit: after saveTxnChanges (dbId=484), st=SUCCESS 00000074.0065e82e 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:19:55 2019:src/rdb/TM.cc:2030 (thr_id:0x81b146900) TM 1000: _localCommit: before LocalUnit::commit 00000074.0065e82f 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:19:55 2019:src/rdb/TM.cc:2045 (thr_id:0x81b146900) TM 1000: _localCommit: after LocalUnit::commit, st=SUCCESS 00000074.0065e830 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:19:55 2019:src/rdb/TM.cc:2053 (thr_id:0x81b146900) TM 1000: _localCommit: after _refreshUnitInfo, st=SUCCESS 00000074.0065e831 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:19:55 2019:src/rdb/TM.cc:2080 (thr_id:0x81b146900) TM 1000: Local commit for TID <5,981363,981363> label 'job_manager job tx loop' : time: 2 msec; result: SUCCESS. 00000074.0065e832 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:19:55 2019:src/rdb/TM.cc:2964 (thr_id:0x81b146900) TM 1000: secondary committed txn TID <5,981363,981363> (from <5,981362>). 00000074.0065e833 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:20:05 2019:src/rdb/TM.cc:2920 (thr_id:0x81b146900) TM 1000: receives propagation of TID <5,981364,981364> (from <5,981363>). 00000074.0065e834 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:20:05 2019:src/rdb/TM.cc:2001 (thr_id:0x81b146900) TM 1000: Begin commit for TID <5,981364,981364> labelOnly false label 'job_manager job_sched check claimable' 00000074.0065e835 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:20:05 2019:src/rdb/TM.cc:2012 (thr_id:0x81b146900) TM 1000: _localCommit: before beginUpdate 00000074.0065e836 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:20:05 2019:src/rdb/TM.cc:2018 (thr_id:0x81b146900) TM 1000: _localCommit: after beginUpdate 00000074.0065e837 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:20:05 2019:src/rdb/TM.cc:2026 (thr_id:0x81b146900) TM 1000: _localCommit: after saveTxnChanges (dbId=484), st=SUCCESS 00000074.0065e838 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:20:05 2019:src/rdb/TM.cc:2030 (thr_id:0x81b146900) TM 1000: _localCommit: before LocalUnit::commit 00000074.0065e839 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:20:05 2019:src/rdb/TM.cc:2045 (thr_id:0x81b146900) TM 1000: _localCommit: after LocalUnit::commit, st=SUCCESS 00000074.0065e83a 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:20:05 2019:src/rdb/TM.cc:2053 (thr_id:0x81b146900) TM 1000: _localCommit: after _refreshUnitInfo, st=SUCCESS 00000074.0065e83b 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:20:05 2019:src/rdb/TM.cc:2080 (thr_id:0x81b146900) TM 1000: Local commit for TID <5,981364,981364> label 'job_manager job_sched check claimable' : time: 2 msec; result: SUCCESS. 00000074.0065e83c 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:20:05 2019:src/rdb/TM.cc:2964 (thr_id:0x81b146900) TM 1000: secondary committed txn TID <5,981364,981364> (from <5,981363>). 00000074.0065e83d 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:20:10 2019:src/rdb/TM.cc:2920 (thr_id:0x81b146900) TM 1000: receives propagation of TID <5,981365,981365> (from <5,981364>). 00000074.0065e83e 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:20:10 2019:src/rdb/TM.cc:2001 (thr_id:0x81b146900) TM 1000: Begin commit for TID <5,981365,981365> labelOnly false label 'job_manager job tx loop' 00000074.0065e83f 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:20:10 2019:src/rdb/TM.cc:2012 (thr_id:0x81b146900) TM 1000: _localCommit: before beginUpdate 00000074.0065e840 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:20:10 2019:src/rdb/TM.cc:2018 (thr_id:0x81b146900) TM 1000: _localCommit: after beginUpdate 00000074.0065e841 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:20:10 2019:src/rdb/TM.cc:2026 (thr_id:0x81b146900) TM 1000: _localCommit: after saveTxnChanges (dbId=484), st=SUCCESS 00000074.0065e842 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:20:10 2019:src/rdb/TM.cc:2030 (thr_id:0x81b146900) TM 1000: _localCommit: before LocalUnit::commit 00000074.0065e843 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:20:10 2019:src/rdb/TM.cc:2045 (thr_id:0x81b146900) TM 1000: _localCommit: after LocalUnit::commit, st=SUCCESS 00000074.0065e844 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:20:10 2019:src/rdb/TM.cc:2053 (thr_id:0x81b146900) TM 1000: _localCommit: after _refreshUnitInfo, st=SUCCESS 00000074.0065e845 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:20:10 2019:src/rdb/TM.cc:2080 (thr_id:0x81b146900) TM 1000: Local commit for TID <5,981365,981365> label 'job_manager job tx loop' : time: 2 msec; result: SUCCESS. 00000074.0065e846 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:20:10 2019:src/rdb/TM.cc:2964 (thr_id:0x81b146900) TM 1000: secondary committed txn TID <5,981365,981365> (from <5,981364>). 00000074.0065e847 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:20:41 2019:src/rdb/TM.cc:2661 (thr_id:0x81d1ea100) TM 1000: app commit: TID <5,981366,981366>. 00000074.0065e848 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:20:41 2019:src/rdb/TM.cc:2920 (thr_id:0x81b146900) TM 1000: receives propagation of TID <5,981366,981366> (from <5,981365>). 00000074.0065e849 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:20:41 2019:src/rdb/TM.cc:2001 (thr_id:0x81b146900) TM 1000: Begin commit for TID <5,981366,981366> labelOnly false label 'job_manager job tx loop' 00000074.0065e84a 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:20:41 2019:src/rdb/TM.cc:2012 (thr_id:0x81b146900) TM 1000: _localCommit: before beginUpdate 00000074.0065e84b 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:20:41 2019:src/rdb/TM.cc:2018 (thr_id:0x81b146900) TM 1000: _localCommit: after beginUpdate 00000074.0065e84c 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:20:41 2019:src/rdb/TM.cc:2026 (thr_id:0x81b146900) TM 1000: _localCommit: after saveTxnChanges (dbId=484), st=SUCCESS 00000074.0065e84d 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:20:41 2019:src/rdb/TM.cc:2030 (thr_id:0x81b146900) TM 1000: _localCommit: before LocalUnit::commit 00000074.0065e84e 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:20:41 2019:src/rdb/TM.cc:2045 (thr_id:0x81b146900) TM 1000: _localCommit: after LocalUnit::commit, st=SUCCESS 00000074.0065e84f 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:20:41 2019:src/rdb/TM.cc:2053 (thr_id:0x81b146900) TM 1000: _localCommit: after _refreshUnitInfo, st=SUCCESS 00000074.0065e850 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:20:41 2019:src/rdb/TM.cc:2080 (thr_id:0x81b146900) TM 1000: Local commit for TID <5,981366,981366> label 'job_manager job tx loop' : time: 2 msec; result: SUCCESS. 00000074.0065e851 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:20:41 2019:src/rdb/TM.cc:2964 (thr_id:0x81b146900) TM 1000: secondary committed txn TID <5,981366,981366> (from <5,981365>). 00000074.0065e852 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:25:02 2019:src/rdb/TM.cc:2661 (thr_id:0x81d1e6500) TM 1000: app commit: TID <5,981367,981367>. 00000074.0065e853 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:25:02 2019:src/rdb/TM.cc:2920 (thr_id:0x81b146e00) TM 1000: receives propagation of TID <5,981367,981367> (from <5,981366>). 00000074.0065e854 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:25:02 2019:src/rdb/TM.cc:2001 (thr_id:0x81b146e00) TM 1000: Begin commit for TID <5,981367,981367> labelOnly false label 'job_manager job_sched check claimable' 00000074.0065e855 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:25:02 2019:src/rdb/TM.cc:2012 (thr_id:0x81b146e00) TM 1000: _localCommit: before beginUpdate 00000074.0065e856 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:25:02 2019:src/rdb/TM.cc:2018 (thr_id:0x81b146e00) TM 1000: _localCommit: after beginUpdate 00000074.0065e857 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:25:02 2019:src/rdb/TM.cc:2026 (thr_id:0x81b146e00) TM 1000: _localCommit: after saveTxnChanges (dbId=484), st=SUCCESS 00000074.0065e858 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:25:02 2019:src/rdb/TM.cc:2030 (thr_id:0x81b146e00) TM 1000: _localCommit: before LocalUnit::commit 00000074.0065e859 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:25:02 2019:src/rdb/TM.cc:2045 (thr_id:0x81b146e00) TM 1000: _localCommit: after LocalUnit::commit, st=SUCCESS 00000074.0065e85a 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:25:02 2019:src/rdb/TM.cc:2053 (thr_id:0x81b146e00) TM 1000: _localCommit: after _refreshUnitInfo, st=SUCCESS 00000074.0065e85b 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:25:02 2019:src/rdb/TM.cc:2080 (thr_id:0x81b146e00) TM 1000: Local commit for TID <5,981367,981367> label 'job_manager job_sched check claimable' : time: 2 msec; result: SUCCESS. 00000074.0065e85c 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:25:02 2019:src/rdb/TM.cc:2964 (thr_id:0x81b146e00) TM 1000: secondary committed txn TID <5,981367,981367> (from <5,981366>). 00000074.0065e85d 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:25:07 2019:src/rdb/TM.cc:2661 (thr_id:0x81d1ea100) TM 1000: app commit: TID <5,981368,981368>. 00000074.0065e85e 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:25:07 2019:src/rdb/TM.cc:2920 (thr_id:0x81b146e00) TM 1000: receives propagation of TID <5,981368,981368> (from <5,981367>). 00000074.0065e85f 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:25:07 2019:src/rdb/TM.cc:2001 (thr_id:0x81b146e00) TM 1000: Begin commit for TID <5,981368,981368> labelOnly false label 'job_manager job tx loop' 00000074.0065e860 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:25:07 2019:src/rdb/TM.cc:2012 (thr_id:0x81b146e00) TM 1000: _localCommit: before beginUpdate 00000074.0065e861 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:25:07 2019:src/rdb/TM.cc:2018 (thr_id:0x81b146e00) TM 1000: _localCommit: after beginUpdate 00000074.0065e862 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:25:07 2019:src/rdb/TM.cc:2026 (thr_id:0x81b146e00) TM 1000: _localCommit: after saveTxnChanges (dbId=484), st=SUCCESS 00000074.0065e863 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:25:07 2019:src/rdb/TM.cc:2030 (thr_id:0x81b146e00) TM 1000: _localCommit: before LocalUnit::commit 00000074.0065e864 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:25:07 2019:src/rdb/TM.cc:2045 (thr_id:0x81b146e00) TM 1000: _localCommit: after LocalUnit::commit, st=SUCCESS 00000074.0065e865 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:25:07 2019:src/rdb/TM.cc:2053 (thr_id:0x81b146e00) TM 1000: _localCommit: after _refreshUnitInfo, st=SUCCESS 00000074.0065e866 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:25:07 2019:src/rdb/TM.cc:2080 (thr_id:0x81b146e00) TM 1000: Local commit for TID <5,981368,981368> label 'job_manager job tx loop' : time: 2 msec; result: SUCCESS. 00000074.0065e867 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:25:07 2019:src/rdb/TM.cc:2964 (thr_id:0x81b146e00) TM 1000: secondary committed txn TID <5,981368,981368> (from <5,981367>). 00000074.0065e868 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:25:10 2019:src/rdb/TM.cc:2920 (thr_id:0x81b146e00) TM 1000: receives propagation of TID <5,981369,981369> (from <5,981368>). 00000074.0065e869 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:25:10 2019:src/rdb/TM.cc:2001 (thr_id:0x81b146e00) TM 1000: Begin commit for TID <5,981369,981369> labelOnly false label 'job_manager job tx loop' 00000074.0065e86a 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:25:10 2019:src/rdb/TM.cc:2012 (thr_id:0x81b146e00) TM 1000: _localCommit: before beginUpdate 00000074.0065e86b 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:25:10 2019:src/rdb/TM.cc:2018 (thr_id:0x81b146e00) TM 1000: _localCommit: after beginUpdate 00000074.0065e86c 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:25:10 2019:src/rdb/TM.cc:2026 (thr_id:0x81b146e00) TM 1000: _localCommit: after saveTxnChanges (dbId=484), st=SUCCESS 00000074.0065e86d 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:25:10 2019:src/rdb/TM.cc:2030 (thr_id:0x81b146e00) TM 1000: _localCommit: before LocalUnit::commit 00000074.0065e86e 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:25:10 2019:src/rdb/TM.cc:2045 (thr_id:0x81b146e00) TM 1000: _localCommit: after LocalUnit::commit, st=SUCCESS 00000074.0065e86f 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:25:10 2019:src/rdb/TM.cc:2053 (thr_id:0x81b146e00) TM 1000: _localCommit: after _refreshUnitInfo, st=SUCCESS 00000074.0065e870 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:25:10 2019:src/rdb/TM.cc:2080 (thr_id:0x81b146e00) TM 1000: Local commit for TID <5,981369,981369> label 'job_manager job tx loop' : time: 2 msec; result: SUCCESS. 00000074.0065e871 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:25:10 2019:src/rdb/TM.cc:2964 (thr_id:0x81b146e00) TM 1000: secondary committed txn TID <5,981369,981369> (from <5,981368>). 00000074.0065e872 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:26:49 2019:src/rdb/TM.cc:2661 (thr_id:0x81b244200) TM 1000: app commit: TID <5,981371,981371>. 00000074.0065e873 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:26:49 2019:src/rdb/TM.cc:2920 (thr_id:0x81b146900) TM 1000: receives propagation of TID <5,981371,981371> (from <5,981369>). 00000074.0065e874 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:26:49 2019:src/rdb/TM.cc:2001 (thr_id:0x81b146900) TM 1000: Begin commit for TID <5,981371,981371> labelOnly false label 'SP: rdb-info-update lock' 00000074.0065e875 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:26:49 2019:src/rdb/TM.cc:2012 (thr_id:0x81b146900) TM 1000: _localCommit: before beginUpdate 00000074.0065e876 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:26:49 2019:src/rdb/TM.cc:2018 (thr_id:0x81b146900) TM 1000: _localCommit: after beginUpdate 00000074.0065e877 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:26:49 2019:src/rdb/TM.cc:2026 (thr_id:0x81b146900) TM 1000: _localCommit: after saveTxnChanges (dbId=145), st=SUCCESS 00000074.0065e878 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:26:49 2019:src/rdb/TM.cc:2030 (thr_id:0x81b146900) TM 1000: _localCommit: before LocalUnit::commit 00000074.0065e879 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:26:49 2019:src/rdb/TM.cc:2045 (thr_id:0x81b146900) TM 1000: _localCommit: after LocalUnit::commit, st=SUCCESS 00000074.0065e87a 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:26:49 2019:src/rdb/TM.cc:2053 (thr_id:0x81b146900) TM 1000: _localCommit: after _refreshUnitInfo, st=SUCCESS 00000074.0065e87b 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:26:49 2019:src/rdb/TM.cc:2080 (thr_id:0x81b146900) TM 1000: Local commit for TID <5,981371,981371> label 'SP: rdb-info-update lock' : time: 2 msec; result: SUCCESS. 00000074.0065e87c 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:26:49 2019:src/rdb/TM.cc:2964 (thr_id:0x81b146900) TM 1000: secondary committed txn TID <5,981371,981371> (from <5,981369>). 00000074.0065e87d 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:30:07 2019:src/rdb/TM.cc:2920 (thr_id:0x81b146e00) TM 1000: receives propagation of TID <5,981372,981372> (from <5,981371>). 00000074.0065e87e 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:30:07 2019:src/rdb/TM.cc:2001 (thr_id:0x81b146e00) TM 1000: Begin commit for TID <5,981372,981372> labelOnly false label 'job_manager job_sched check claimable' 00000074.0065e87f 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:30:07 2019:src/rdb/TM.cc:2012 (thr_id:0x81b146e00) TM 1000: _localCommit: before beginUpdate 00000074.0065e880 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:30:07 2019:src/rdb/TM.cc:2018 (thr_id:0x81b146e00) TM 1000: _localCommit: after beginUpdate 00000074.0065e881 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:30:07 2019:src/rdb/TM.cc:2026 (thr_id:0x81b146e00) TM 1000: _localCommit: after saveTxnChanges (dbId=484), st=SUCCESS 00000074.0065e882 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:30:07 2019:src/rdb/TM.cc:2030 (thr_id:0x81b146e00) TM 1000: _localCommit: before LocalUnit::commit 00000074.0065e883 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:30:07 2019:src/rdb/TM.cc:2045 (thr_id:0x81b146e00) TM 1000: _localCommit: after LocalUnit::commit, st=SUCCESS 00000074.0065e884 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:30:07 2019:src/rdb/TM.cc:2053 (thr_id:0x81b146e00) TM 1000: _localCommit: after _refreshUnitInfo, st=SUCCESS 00000074.0065e885 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:30:07 2019:src/rdb/TM.cc:2080 (thr_id:0x81b146e00) TM 1000: Local commit for TID <5,981372,981372> label 'job_manager job_sched check claimable' : time: 2 msec; result: SUCCESS. 00000074.0065e886 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:30:07 2019:src/rdb/TM.cc:2964 (thr_id:0x81b146e00) TM 1000: secondary committed txn TID <5,981372,981372> (from <5,981371>). 00000074.0065e887 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:30:07 2019:src/rdb/TM.cc:2661 (thr_id:0x81d1ea100) TM 1000: app commit: TID <5,981373,981373>. 00000074.0065e888 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:30:07 2019:src/rdb/TM.cc:2920 (thr_id:0x81b146e00) TM 1000: receives propagation of TID <5,981373,981373> (from <5,981372>). 00000074.0065e889 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:30:07 2019:src/rdb/TM.cc:2001 (thr_id:0x81b146e00) TM 1000: Begin commit for TID <5,981373,981373> labelOnly false label 'job_manager job tx loop' 00000074.0065e88a 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:30:07 2019:src/rdb/TM.cc:2012 (thr_id:0x81b146e00) TM 1000: _localCommit: before beginUpdate 00000074.0065e88b 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:30:07 2019:src/rdb/TM.cc:2018 (thr_id:0x81b146e00) TM 1000: _localCommit: after beginUpdate 00000074.0065e88c 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:30:07 2019:src/rdb/TM.cc:2026 (thr_id:0x81b146e00) TM 1000: _localCommit: after saveTxnChanges (dbId=484), st=SUCCESS 00000074.0065e88d 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:30:07 2019:src/rdb/TM.cc:2030 (thr_id:0x81b146e00) TM 1000: _localCommit: before LocalUnit::commit 00000074.0065e88e 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:30:07 2019:src/rdb/TM.cc:2045 (thr_id:0x81b146e00) TM 1000: _localCommit: after LocalUnit::commit, st=SUCCESS 00000074.0065e88f 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:30:07 2019:src/rdb/TM.cc:2053 (thr_id:0x81b146e00) TM 1000: _localCommit: after _refreshUnitInfo, st=SUCCESS 00000074.0065e890 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:30:07 2019:src/rdb/TM.cc:2080 (thr_id:0x81b146e00) TM 1000: Local commit for TID <5,981373,981373> label 'job_manager job tx loop' : time: 2 msec; result: SUCCESS. 00000074.0065e891 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:30:07 2019:src/rdb/TM.cc:2964 (thr_id:0x81b146e00) TM 1000: secondary committed txn TID <5,981373,981373> (from <5,981372>). 00000074.0065e892 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:30:07 2019:src/rdb/TM.cc:2661 (thr_id:0x81d1e6f00) TM 1000: app commit: TID <5,981374,981374>. 00000074.0065e893 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:30:07 2019:src/rdb/TM.cc:2920 (thr_id:0x81b146e00) TM 1000: receives propagation of TID <5,981374,981374> (from <5,981373>). 00000074.0065e894 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:30:07 2019:src/rdb/TM.cc:2001 (thr_id:0x81b146e00) TM 1000: Begin commit for TID <5,981374,981374> labelOnly true label 'job_manager job_sched check claimable' 00000074.0065e895 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:30:07 2019:src/rdb/TM.cc:2012 (thr_id:0x81b146e00) TM 1000: _localCommit: before beginUpdate 00000074.0065e896 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:30:07 2019:src/rdb/TM.cc:2018 (thr_id:0x81b146e00) TM 1000: _localCommit: after beginUpdate 00000074.0065e897 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:30:07 2019:src/rdb/TM.cc:2030 (thr_id:0x81b146e00) TM 1000: _localCommit: before LocalUnit::commit 00000074.0065e898 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:30:07 2019:src/rdb/TM.cc:2045 (thr_id:0x81b146e00) TM 1000: _localCommit: after LocalUnit::commit, st=SUCCESS 00000074.0065e899 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:30:07 2019:src/rdb/TM.cc:2053 (thr_id:0x81b146e00) TM 1000: _localCommit: after _refreshUnitInfo, st=SUCCESS 00000074.0065e89a 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:30:07 2019:src/rdb/TM.cc:2080 (thr_id:0x81b146e00) TM 1000: Local commit for TID <5,981374,981374> label 'job_manager job_sched check claimable' : time: 1 msec; result: SUCCESS. 00000074.0065e89b 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:30:07 2019:src/rdb/TM.cc:2964 (thr_id:0x81b146e00) TM 1000: secondary committed txn TID <5,981374,981374> (from <5,981373>). 00000074.0065e89c 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:30:10 2019:src/rdb/TM.cc:2920 (thr_id:0x81b146e00) TM 1000: receives propagation of TID <5,981375,981375> (from <5,981374>). 00000074.0065e89d 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:30:10 2019:src/rdb/TM.cc:2001 (thr_id:0x81b146e00) TM 1000: Begin commit for TID <5,981375,981375> labelOnly false label 'job_manager job tx loop' 00000074.0065e89e 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:30:10 2019:src/rdb/TM.cc:2012 (thr_id:0x81b146e00) TM 1000: _localCommit: before beginUpdate 00000074.0065e89f 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:30:10 2019:src/rdb/TM.cc:2018 (thr_id:0x81b146e00) TM 1000: _localCommit: after beginUpdate 00000074.0065e8a0 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:30:10 2019:src/rdb/TM.cc:2026 (thr_id:0x81b146e00) TM 1000: _localCommit: after saveTxnChanges (dbId=484), st=SUCCESS 00000074.0065e8a1 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:30:10 2019:src/rdb/TM.cc:2030 (thr_id:0x81b146e00) TM 1000: _localCommit: before LocalUnit::commit 00000074.0065e8a2 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:30:10 2019:src/rdb/TM.cc:2045 (thr_id:0x81b146e00) TM 1000: _localCommit: after LocalUnit::commit, st=SUCCESS 00000074.0065e8a3 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:30:10 2019:src/rdb/TM.cc:2053 (thr_id:0x81b146e00) TM 1000: _localCommit: after _refreshUnitInfo, st=SUCCESS 00000074.0065e8a4 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:30:10 2019:src/rdb/TM.cc:2080 (thr_id:0x81b146e00) TM 1000: Local commit for TID <5,981375,981375> label 'job_manager job tx loop' : time: 1 msec; result: SUCCESS. 00000074.0065e8a5 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:30:10 2019:src/rdb/TM.cc:2964 (thr_id:0x81b146e00) TM 1000: secondary committed txn TID <5,981375,981375> (from <5,981374>). 00000074.0065e8a6 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:30:12 2019:src/rdb/TM.cc:2920 (thr_id:0x81b146e00) TM 1000: receives propagation of TID <5,981376,981376> (from <5,981375>). 00000074.0065e8a7 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:30:12 2019:src/rdb/TM.cc:2001 (thr_id:0x81b146e00) TM 1000: Begin commit for TID <5,981376,981376> labelOnly false label 'job_manager job tx loop' 00000074.0065e8a8 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:30:12 2019:src/rdb/TM.cc:2012 (thr_id:0x81b146e00) TM 1000: _localCommit: before beginUpdate 00000074.0065e8a9 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:30:12 2019:src/rdb/TM.cc:2018 (thr_id:0x81b146e00) TM 1000: _localCommit: after beginUpdate 00000074.0065e8aa 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:30:12 2019:src/rdb/TM.cc:2026 (thr_id:0x81b146e00) TM 1000: _localCommit: after saveTxnChanges (dbId=484), st=SUCCESS 00000074.0065e8ab 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:30:12 2019:src/rdb/TM.cc:2030 (thr_id:0x81b146e00) TM 1000: _localCommit: before LocalUnit::commit 00000074.0065e8ac 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:30:12 2019:src/rdb/TM.cc:2045 (thr_id:0x81b146e00) TM 1000: _localCommit: after LocalUnit::commit, st=SUCCESS 00000074.0065e8ad 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:30:12 2019:src/rdb/TM.cc:2053 (thr_id:0x81b146e00) TM 1000: _localCommit: after _refreshUnitInfo, st=SUCCESS 00000074.0065e8ae 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:30:12 2019:src/rdb/TM.cc:2080 (thr_id:0x81b146e00) TM 1000: Local commit for TID <5,981376,981376> label 'job_manager job tx loop' : time: 1 msec; result: SUCCESS. 00000074.0065e8af 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:30:12 2019:src/rdb/TM.cc:2964 (thr_id:0x81b146e00) TM 1000: secondary committed txn TID <5,981376,981376> (from <5,981375>). 00000074.0065e8b0 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:31:48 2019:src/rdb/TM.cc:2920 (thr_id:0x81b146900) TM 1000: receives propagation of TID <5,981378,981378> (from <5,981376>). 00000074.0065e8b1 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:31:48 2019:src/rdb/TM.cc:2001 (thr_id:0x81b146900) TM 1000: Begin commit for TID <5,981378,981378> labelOnly false label 'SP: rdb-info-update lock' 00000074.0065e8b2 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:31:48 2019:src/rdb/TM.cc:2012 (thr_id:0x81b146900) TM 1000: _localCommit: before beginUpdate 00000074.0065e8b3 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:31:48 2019:src/rdb/TM.cc:2018 (thr_id:0x81b146900) TM 1000: _localCommit: after beginUpdate 00000074.0065e8b4 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:31:48 2019:src/rdb/TM.cc:2026 (thr_id:0x81b146900) TM 1000: _localCommit: after saveTxnChanges (dbId=145), st=SUCCESS 00000074.0065e8b5 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:31:48 2019:src/rdb/TM.cc:2030 (thr_id:0x81b146900) TM 1000: _localCommit: before LocalUnit::commit 00000074.0065e8b6 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:31:48 2019:src/rdb/TM.cc:2045 (thr_id:0x81b146900) TM 1000: _localCommit: after LocalUnit::commit, st=SUCCESS 00000074.0065e8b7 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:31:48 2019:src/rdb/TM.cc:2053 (thr_id:0x81b146900) TM 1000: _localCommit: after _refreshUnitInfo, st=SUCCESS 00000074.0065e8b8 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:31:48 2019:src/rdb/TM.cc:2080 (thr_id:0x81b146900) TM 1000: Local commit for TID <5,981378,981378> label 'SP: rdb-info-update lock' : time: 1 msec; result: SUCCESS. 00000074.0065e8b9 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:31:48 2019:src/rdb/TM.cc:2964 (thr_id:0x81b146900) TM 1000: secondary committed txn TID <5,981378,981378> (from <5,981376>). 00000074.0065e8ba 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:35:07 2019:src/rdb/TM.cc:2920 (thr_id:0x81b146e00) TM 1000: receives propagation of TID <5,981379,981379> (from <5,981378>). 00000074.0065e8bb 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:35:07 2019:src/rdb/TM.cc:2001 (thr_id:0x81b146e00) TM 1000: Begin commit for TID <5,981379,981379> labelOnly false label 'job_manager job_sched check claimable' 00000074.0065e8bc 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:35:07 2019:src/rdb/TM.cc:2012 (thr_id:0x81b146e00) TM 1000: _localCommit: before beginUpdate 00000074.0065e8bd 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:35:07 2019:src/rdb/TM.cc:2018 (thr_id:0x81b146e00) TM 1000: _localCommit: after beginUpdate 00000074.0065e8be 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:35:07 2019:src/rdb/TM.cc:2026 (thr_id:0x81b146e00) TM 1000: _localCommit: after saveTxnChanges (dbId=484), st=SUCCESS 00000074.0065e8bf 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:35:07 2019:src/rdb/TM.cc:2030 (thr_id:0x81b146e00) TM 1000: _localCommit: before LocalUnit::commit 00000074.0065e8c0 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:35:07 2019:src/rdb/TM.cc:2045 (thr_id:0x81b146e00) TM 1000: _localCommit: after LocalUnit::commit, st=SUCCESS 00000074.0065e8c1 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:35:07 2019:src/rdb/TM.cc:2053 (thr_id:0x81b146e00) TM 1000: _localCommit: after _refreshUnitInfo, st=SUCCESS 00000074.0065e8c2 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:35:07 2019:src/rdb/TM.cc:2080 (thr_id:0x81b146e00) TM 1000: Local commit for TID <5,981379,981379> label 'job_manager job_sched check claimable' : time: 2 msec; result: SUCCESS. 00000074.0065e8c3 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:35:07 2019:src/rdb/TM.cc:2964 (thr_id:0x81b146e00) TM 1000: secondary committed txn TID <5,981379,981379> (from <5,981378>). 00000074.0065e8c4 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:35:07 2019:src/rdb/TM.cc:2661 (thr_id:0x81d1ea100) TM 1000: app commit: TID <5,981380,981380>. 00000074.0065e8c5 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:35:07 2019:src/rdb/TM.cc:2920 (thr_id:0x81b146e00) TM 1000: receives propagation of TID <5,981380,981380> (from <5,981379>). 00000074.0065e8c6 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:35:07 2019:src/rdb/TM.cc:2001 (thr_id:0x81b146e00) TM 1000: Begin commit for TID <5,981380,981380> labelOnly false label 'job_manager job tx loop' 00000074.0065e8c7 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:35:07 2019:src/rdb/TM.cc:2012 (thr_id:0x81b146e00) TM 1000: _localCommit: before beginUpdate 00000074.0065e8c8 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:35:07 2019:src/rdb/TM.cc:2018 (thr_id:0x81b146e00) TM 1000: _localCommit: after beginUpdate 00000074.0065e8c9 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:35:07 2019:src/rdb/TM.cc:2026 (thr_id:0x81b146e00) TM 1000: _localCommit: after saveTxnChanges (dbId=484), st=SUCCESS 00000074.0065e8ca 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:35:07 2019:src/rdb/TM.cc:2030 (thr_id:0x81b146e00) TM 1000: _localCommit: before LocalUnit::commit 00000074.0065e8cb 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:35:07 2019:src/rdb/TM.cc:2045 (thr_id:0x81b146e00) TM 1000: _localCommit: after LocalUnit::commit, st=SUCCESS 00000074.0065e8cc 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:35:07 2019:src/rdb/TM.cc:2053 (thr_id:0x81b146e00) TM 1000: _localCommit: after _refreshUnitInfo, st=SUCCESS 00000074.0065e8cd 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:35:07 2019:src/rdb/TM.cc:2080 (thr_id:0x81b146e00) TM 1000: Local commit for TID <5,981380,981380> label 'job_manager job tx loop' : time: 2 msec; result: SUCCESS. 00000074.0065e8ce 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:35:07 2019:src/rdb/TM.cc:2964 (thr_id:0x81b146e00) TM 1000: secondary committed txn TID <5,981380,981380> (from <5,981379>). 00000074.0065e8cf 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:35:07 2019:src/rdb/TM.cc:2661 (thr_id:0x81d1e6000) TM 1000: app commit: TID <5,981381,981381>. 00000074.0065e8d0 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:35:07 2019:src/rdb/TM.cc:2920 (thr_id:0x81b146e00) TM 1000: receives propagation of TID <5,981381,981381> (from <5,981380>). 00000074.0065e8d1 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:35:07 2019:src/rdb/TM.cc:2001 (thr_id:0x81b146e00) TM 1000: Begin commit for TID <5,981381,981381> labelOnly true label 'job_manager job_sched check claimable' 00000074.0065e8d2 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:35:07 2019:src/rdb/TM.cc:2012 (thr_id:0x81b146e00) TM 1000: _localCommit: before beginUpdate 00000074.0065e8d3 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:35:07 2019:src/rdb/TM.cc:2018 (thr_id:0x81b146e00) TM 1000: _localCommit: after beginUpdate 00000074.0065e8d4 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:35:07 2019:src/rdb/TM.cc:2030 (thr_id:0x81b146e00) TM 1000: _localCommit: before LocalUnit::commit 00000074.0065e8d5 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:35:07 2019:src/rdb/TM.cc:2045 (thr_id:0x81b146e00) TM 1000: _localCommit: after LocalUnit::commit, st=SUCCESS 00000074.0065e8d6 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:35:07 2019:src/rdb/TM.cc:2053 (thr_id:0x81b146e00) TM 1000: _localCommit: after _refreshUnitInfo, st=SUCCESS 00000074.0065e8d7 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:35:07 2019:src/rdb/TM.cc:2080 (thr_id:0x81b146e00) TM 1000: Local commit for TID <5,981381,981381> label 'job_manager job_sched check claimable' : time: 1 msec; result: SUCCESS. 00000074.0065e8d8 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:35:07 2019:src/rdb/TM.cc:2964 (thr_id:0x81b146e00) TM 1000: secondary committed txn TID <5,981381,981381> (from <5,981380>). 00000074.0065e8d9 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:35:12 2019:src/rdb/TM.cc:2920 (thr_id:0x81b146e00) TM 1000: receives propagation of TID <5,981382,981382> (from <5,981381>). 00000074.0065e8da 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:35:12 2019:src/rdb/TM.cc:2001 (thr_id:0x81b146e00) TM 1000: Begin commit for TID <5,981382,981382> labelOnly false label 'job_manager job tx loop' 00000074.0065e8db 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:35:12 2019:src/rdb/TM.cc:2012 (thr_id:0x81b146e00) TM 1000: _localCommit: before beginUpdate 00000074.0065e8dc 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:35:12 2019:src/rdb/TM.cc:2018 (thr_id:0x81b146e00) TM 1000: _localCommit: after beginUpdate 00000074.0065e8dd 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:35:12 2019:src/rdb/TM.cc:2026 (thr_id:0x81b146e00) TM 1000: _localCommit: after saveTxnChanges (dbId=484), st=SUCCESS 00000074.0065e8de 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:35:12 2019:src/rdb/TM.cc:2030 (thr_id:0x81b146e00) TM 1000: _localCommit: before LocalUnit::commit 00000074.0065e8df 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:35:12 2019:src/rdb/TM.cc:2045 (thr_id:0x81b146e00) TM 1000: _localCommit: after LocalUnit::commit, st=SUCCESS 00000074.0065e8e0 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:35:12 2019:src/rdb/TM.cc:2053 (thr_id:0x81b146e00) TM 1000: _localCommit: after _refreshUnitInfo, st=SUCCESS 00000074.0065e8e1 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:35:12 2019:src/rdb/TM.cc:2080 (thr_id:0x81b146e00) TM 1000: Local commit for TID <5,981382,981382> label 'job_manager job tx loop' : time: 2 msec; result: SUCCESS. 00000074.0065e8e2 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:35:12 2019:src/rdb/TM.cc:2964 (thr_id:0x81b146e00) TM 1000: secondary committed txn TID <5,981382,981382> (from <5,981381>). 00000074.0065e8e3 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:40:06 2019:src/rdb/TM.cc:2920 (thr_id:0x81b146900) TM 1000: receives propagation of TID <5,981383,981383> (from <5,981382>). 00000074.0065e8e4 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:40:06 2019:src/rdb/TM.cc:2001 (thr_id:0x81b146900) TM 1000: Begin commit for TID <5,981383,981383> labelOnly false label 'job_manager job_sched check claimable' 00000074.0065e8e5 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:40:06 2019:src/rdb/TM.cc:2012 (thr_id:0x81b146900) TM 1000: _localCommit: before beginUpdate 00000074.0065e8e6 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:40:06 2019:src/rdb/TM.cc:2018 (thr_id:0x81b146900) TM 1000: _localCommit: after beginUpdate 00000074.0065e8e7 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:40:06 2019:src/rdb/TM.cc:2026 (thr_id:0x81b146900) TM 1000: _localCommit: after saveTxnChanges (dbId=484), st=SUCCESS 00000074.0065e8e8 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:40:06 2019:src/rdb/TM.cc:2030 (thr_id:0x81b146900) TM 1000: _localCommit: before LocalUnit::commit 00000074.0065e8e9 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:40:06 2019:src/rdb/TM.cc:2045 (thr_id:0x81b146900) TM 1000: _localCommit: after LocalUnit::commit, st=SUCCESS 00000074.0065e8ea 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:40:06 2019:src/rdb/TM.cc:2053 (thr_id:0x81b146900) TM 1000: _localCommit: after _refreshUnitInfo, st=SUCCESS 00000074.0065e8eb 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:40:06 2019:src/rdb/TM.cc:2080 (thr_id:0x81b146900) TM 1000: Local commit for TID <5,981383,981383> label 'job_manager job_sched check claimable' : time: 2 msec; result: SUCCESS. 00000074.0065e8ec 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:40:06 2019:src/rdb/TM.cc:2964 (thr_id:0x81b146900) TM 1000: secondary committed txn TID <5,981383,981383> (from <5,981382>). 00000074.0065e8ed 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:40:07 2019:src/rdb/TM.cc:2661 (thr_id:0x81d1ea100) TM 1000: app commit: TID <5,981384,981384>. 00000074.0065e8ee 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:40:07 2019:src/rdb/TM.cc:2920 (thr_id:0x81b146900) TM 1000: receives propagation of TID <5,981384,981384> (from <5,981383>). 00000074.0065e8ef 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:40:07 2019:src/rdb/TM.cc:2001 (thr_id:0x81b146900) TM 1000: Begin commit for TID <5,981384,981384> labelOnly false label 'job_manager job tx loop' 00000074.0065e8f0 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:40:07 2019:src/rdb/TM.cc:2012 (thr_id:0x81b146900) TM 1000: _localCommit: before beginUpdate 00000074.0065e8f1 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:40:07 2019:src/rdb/TM.cc:2018 (thr_id:0x81b146900) TM 1000: _localCommit: after beginUpdate 00000074.0065e8f2 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:40:07 2019:src/rdb/TM.cc:2026 (thr_id:0x81b146900) TM 1000: _localCommit: after saveTxnChanges (dbId=484), st=SUCCESS 00000074.0065e8f3 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:40:07 2019:src/rdb/TM.cc:2030 (thr_id:0x81b146900) TM 1000: _localCommit: before LocalUnit::commit 00000074.0065e8f4 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:40:07 2019:src/rdb/TM.cc:2045 (thr_id:0x81b146900) TM 1000: _localCommit: after LocalUnit::commit, st=SUCCESS 00000074.0065e8f5 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:40:07 2019:src/rdb/TM.cc:2053 (thr_id:0x81b146900) TM 1000: _localCommit: after _refreshUnitInfo, st=SUCCESS 00000074.0065e8f6 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:40:07 2019:src/rdb/TM.cc:2080 (thr_id:0x81b146900) TM 1000: Local commit for TID <5,981384,981384> label 'job_manager job tx loop' : time: 2 msec; result: SUCCESS. 00000074.0065e8f7 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:40:07 2019:src/rdb/TM.cc:2964 (thr_id:0x81b146900) TM 1000: secondary committed txn TID <5,981384,981384> (from <5,981383>). 00000074.0065e8f8 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:40:11 2019:src/rdb/TM.cc:2920 (thr_id:0x81b146900) TM 1000: receives propagation of TID <5,981385,981385> (from <5,981384>). 00000074.0065e8f9 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:40:11 2019:src/rdb/TM.cc:2001 (thr_id:0x81b146900) TM 1000: Begin commit for TID <5,981385,981385> labelOnly false label 'job_manager job tx loop' 00000074.0065e8fa 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:40:11 2019:src/rdb/TM.cc:2012 (thr_id:0x81b146900) TM 1000: _localCommit: before beginUpdate 00000074.0065e8fb 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:40:11 2019:src/rdb/TM.cc:2018 (thr_id:0x81b146900) TM 1000: _localCommit: after beginUpdate 00000074.0065e8fc 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:40:11 2019:src/rdb/TM.cc:2026 (thr_id:0x81b146900) TM 1000: _localCommit: after saveTxnChanges (dbId=484), st=SUCCESS 00000074.0065e8fd 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:40:11 2019:src/rdb/TM.cc:2030 (thr_id:0x81b146900) TM 1000: _localCommit: before LocalUnit::commit 00000074.0065e8fe 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:40:11 2019:src/rdb/TM.cc:2045 (thr_id:0x81b146900) TM 1000: _localCommit: after LocalUnit::commit, st=SUCCESS 00000074.0065e8ff 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:40:11 2019:src/rdb/TM.cc:2053 (thr_id:0x81b146900) TM 1000: _localCommit: after _refreshUnitInfo, st=SUCCESS 00000074.0065e900 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:40:11 2019:src/rdb/TM.cc:2080 (thr_id:0x81b146900) TM 1000: Local commit for TID <5,981385,981385> label 'job_manager job tx loop' : time: 2 msec; result: SUCCESS. 00000074.0065e901 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:40:11 2019:src/rdb/TM.cc:2964 (thr_id:0x81b146900) TM 1000: secondary committed txn TID <5,981385,981385> (from <5,981384>). 00000074.0065e902 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:41:49 2019:src/rdb/TM.cc:2661 (thr_id:0x81b6aba00) TM 1000: app commit: TID <5,981387,981387>. 00000074.0065e903 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:41:49 2019:src/rdb/TM.cc:2920 (thr_id:0x81b146e00) TM 1000: receives propagation of TID <5,981387,981387> (from <5,981385>). 00000074.0065e904 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:41:49 2019:src/rdb/TM.cc:2001 (thr_id:0x81b146e00) TM 1000: Begin commit for TID <5,981387,981387> labelOnly false label 'SP: rdb-info-update lock' 00000074.0065e905 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:41:49 2019:src/rdb/TM.cc:2012 (thr_id:0x81b146e00) TM 1000: _localCommit: before beginUpdate 00000074.0065e906 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:41:49 2019:src/rdb/TM.cc:2018 (thr_id:0x81b146e00) TM 1000: _localCommit: after beginUpdate 00000074.0065e907 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:41:49 2019:src/rdb/TM.cc:2026 (thr_id:0x81b146e00) TM 1000: _localCommit: after saveTxnChanges (dbId=145), st=SUCCESS 00000074.0065e908 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:41:49 2019:src/rdb/TM.cc:2030 (thr_id:0x81b146e00) TM 1000: _localCommit: before LocalUnit::commit 00000074.0065e909 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:41:49 2019:src/rdb/TM.cc:2045 (thr_id:0x81b146e00) TM 1000: _localCommit: after LocalUnit::commit, st=SUCCESS 00000074.0065e90a 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:41:49 2019:src/rdb/TM.cc:2053 (thr_id:0x81b146e00) TM 1000: _localCommit: after _refreshUnitInfo, st=SUCCESS 00000074.0065e90b 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:41:49 2019:src/rdb/TM.cc:2080 (thr_id:0x81b146e00) TM 1000: Local commit for TID <5,981387,981387> label 'SP: rdb-info-update lock' : time: 2 msec; result: SUCCESS. 00000074.0065e90c 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:41:49 2019:src/rdb/TM.cc:2964 (thr_id:0x81b146e00) TM 1000: secondary committed txn TID <5,981387,981387> (from <5,981385>). 00000074.0065e90d 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:45:07 2019:src/rdb/TM.cc:2920 (thr_id:0x81b146900) TM 1000: receives propagation of TID <5,981388,981388> (from <5,981387>). 00000074.0065e90e 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:45:07 2019:src/rdb/TM.cc:2001 (thr_id:0x81b146900) TM 1000: Begin commit for TID <5,981388,981388> labelOnly false label 'job_manager job_sched check claimable' 00000074.0065e90f 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:45:07 2019:src/rdb/TM.cc:2012 (thr_id:0x81b146900) TM 1000: _localCommit: before beginUpdate 00000074.0065e910 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:45:07 2019:src/rdb/TM.cc:2018 (thr_id:0x81b146900) TM 1000: _localCommit: after beginUpdate 00000074.0065e911 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:45:07 2019:src/rdb/TM.cc:2026 (thr_id:0x81b146900) TM 1000: _localCommit: after saveTxnChanges (dbId=484), st=SUCCESS 00000074.0065e912 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:45:07 2019:src/rdb/TM.cc:2030 (thr_id:0x81b146900) TM 1000: _localCommit: before LocalUnit::commit 00000074.0065e913 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:45:07 2019:src/rdb/TM.cc:2045 (thr_id:0x81b146900) TM 1000: _localCommit: after LocalUnit::commit, st=SUCCESS 00000074.0065e914 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:45:07 2019:src/rdb/TM.cc:2053 (thr_id:0x81b146900) TM 1000: _localCommit: after _refreshUnitInfo, st=SUCCESS 00000074.0065e915 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:45:07 2019:src/rdb/TM.cc:2080 (thr_id:0x81b146900) TM 1000: Local commit for TID <5,981388,981388> label 'job_manager job_sched check claimable' : time: 2 msec; result: SUCCESS. 00000074.0065e916 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:45:07 2019:src/rdb/TM.cc:2964 (thr_id:0x81b146900) TM 1000: secondary committed txn TID <5,981388,981388> (from <5,981387>). 00000074.0065e917 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:45:07 2019:src/rdb/TM.cc:2661 (thr_id:0x81d1e9c00) TM 1000: app commit: TID <5,981389,981389>. 00000074.0065e918 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:45:07 2019:src/rdb/TM.cc:2920 (thr_id:0x81b146900) TM 1000: receives propagation of TID <5,981389,981389> (from <5,981388>). 00000074.0065e919 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:45:07 2019:src/rdb/TM.cc:2001 (thr_id:0x81b146900) TM 1000: Begin commit for TID <5,981389,981389> labelOnly false label 'job_manager job_sched check claimable' 00000074.0065e91a 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:45:07 2019:src/rdb/TM.cc:2012 (thr_id:0x81b146900) TM 1000: _localCommit: before beginUpdate 00000074.0065e91b 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:45:07 2019:src/rdb/TM.cc:2018 (thr_id:0x81b146900) TM 1000: _localCommit: after beginUpdate 00000074.0065e91c 243b8c4e Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:45:07 2019:src/rdb/TM.cc:2026 (thr_id:0x81b146900) TM 1000: _localCommit: after saveTxnChanges (dbId=484), st=SUCCESS 00000074.0065e91d 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:45:07 2019:src/rdb/TM.cc:2030 (thr_id:0x81b146900) TM 1000: _localCommit: before LocalUnit::commit 00000074.0065e91e 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:45:07 2019:src/rdb/TM.cc:2045 (thr_id:0x81b146900) TM 1000: _localCommit: after LocalUnit::commit, st=SUCCESS 00000074.0065e91f 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:45:07 2019:src/rdb/TM.cc:2053 (thr_id:0x81b146900) TM 1000: _localCommit: after _refreshUnitInfo, st=SUCCESS 00000074.0065e920 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:45:07 2019:src/rdb/TM.cc:2080 (thr_id:0x81b146900) TM 1000: Local commit for TID <5,981389,981389> label 'job_manager job_sched check claimable' : time: 2 msec; result: SUCCESS. 00000074.0065e921 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:45:07 2019:src/rdb/TM.cc:2964 (thr_id:0x81b146900) TM 1000: secondary committed txn TID <5,981389,981389> (from <5,981388>). 00000074.0065e922 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:45:11 2019:src/rdb/TM.cc:2920 (thr_id:0x81b146900) TM 1000: receives propagation of TID <5,981390,981390> (from <5,981389>). 00000074.0065e923 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:45:11 2019:src/rdb/TM.cc:2001 (thr_id:0x81b146900) TM 1000: Begin commit for TID <5,981390,981390> labelOnly false label 'job_manager job tx loop' 00000074.0065e924 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:45:11 2019:src/rdb/TM.cc:2012 (thr_id:0x81b146900) TM 1000: _localCommit: before beginUpdate 00000074.0065e925 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:45:11 2019:src/rdb/TM.cc:2018 (thr_id:0x81b146900) TM 1000: _localCommit: after beginUpdate 00000074.0065e926 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:45:11 2019:src/rdb/TM.cc:2026 (thr_id:0x81b146900) TM 1000: _localCommit: after saveTxnChanges (dbId=484), st=SUCCESS 00000074.0065e927 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:45:11 2019:src/rdb/TM.cc:2030 (thr_id:0x81b146900) TM 1000: _localCommit: before LocalUnit::commit 00000074.0065e928 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:45:11 2019:src/rdb/TM.cc:2045 (thr_id:0x81b146900) TM 1000: _localCommit: after LocalUnit::commit, st=SUCCESS 00000074.0065e929 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:45:11 2019:src/rdb/TM.cc:2053 (thr_id:0x81b146900) TM 1000: _localCommit: after _refreshUnitInfo, st=SUCCESS 00000074.0065e92a 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:45:11 2019:src/rdb/TM.cc:2080 (thr_id:0x81b146900) TM 1000: Local commit for TID <5,981390,981390> label 'job_manager job tx loop' : time: 1 msec; result: SUCCESS. 00000074.0065e92b 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:45:11 2019:src/rdb/TM.cc:2964 (thr_id:0x81b146900) TM 1000: secondary committed txn TID <5,981390,981390> (from <5,981389>). 00000074.0065e92c 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:45:12 2019:src/rdb/TM.cc:2920 (thr_id:0x81b146900) TM 1000: receives propagation of TID <5,981391,981391> (from <5,981390>). 00000074.0065e92d 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:45:12 2019:src/rdb/TM.cc:2001 (thr_id:0x81b146900) TM 1000: Begin commit for TID <5,981391,981391> labelOnly false label 'job_manager job tx loop' 00000074.0065e92e 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:45:12 2019:src/rdb/TM.cc:2012 (thr_id:0x81b146900) TM 1000: _localCommit: before beginUpdate 00000074.0065e92f 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:45:12 2019:src/rdb/TM.cc:2018 (thr_id:0x81b146900) TM 1000: _localCommit: after beginUpdate 00000074.0065e930 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:45:12 2019:src/rdb/TM.cc:2026 (thr_id:0x81b146900) TM 1000: _localCommit: after saveTxnChanges (dbId=484), st=SUCCESS 00000074.0065e931 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:45:12 2019:src/rdb/TM.cc:2030 (thr_id:0x81b146900) TM 1000: _localCommit: before LocalUnit::commit 00000074.0065e932 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:45:12 2019:src/rdb/TM.cc:2045 (thr_id:0x81b146900) TM 1000: _localCommit: after LocalUnit::commit, st=SUCCESS 00000074.0065e933 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:45:12 2019:src/rdb/TM.cc:2053 (thr_id:0x81b146900) TM 1000: _localCommit: after _refreshUnitInfo, st=SUCCESS 00000074.0065e934 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:45:12 2019:src/rdb/TM.cc:2080 (thr_id:0x81b146900) TM 1000: Local commit for TID <5,981391,981391> label 'job_manager job tx loop' : time: 2 msec; result: SUCCESS. 00000074.0065e935 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:45:12 2019:src/rdb/TM.cc:2964 (thr_id:0x81b146900) TM 1000: secondary committed txn TID <5,981391,981391> (from <5,981390>). 00000074.0065e936 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:46:48 2019:src/rdb/TM.cc:2920 (thr_id:0x81b146e00) TM 1000: receives propagation of TID <5,981393,981393> (from <5,981391>). 00000074.0065e937 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:46:48 2019:src/rdb/TM.cc:2001 (thr_id:0x81b146e00) TM 1000: Begin commit for TID <5,981393,981393> labelOnly false label 'SP: rdb-info-update lock' 00000074.0065e938 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:46:48 2019:src/rdb/TM.cc:2012 (thr_id:0x81b146e00) TM 1000: _localCommit: before beginUpdate 00000074.0065e939 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:46:48 2019:src/rdb/TM.cc:2018 (thr_id:0x81b146e00) TM 1000: _localCommit: after beginUpdate 00000074.0065e93a 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:46:48 2019:src/rdb/TM.cc:2026 (thr_id:0x81b146e00) TM 1000: _localCommit: after saveTxnChanges (dbId=145), st=SUCCESS 00000074.0065e93b 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:46:48 2019:src/rdb/TM.cc:2030 (thr_id:0x81b146e00) TM 1000: _localCommit: before LocalUnit::commit 00000074.0065e93c 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:46:48 2019:src/rdb/TM.cc:2045 (thr_id:0x81b146e00) TM 1000: _localCommit: after LocalUnit::commit, st=SUCCESS 00000074.0065e93d 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:46:48 2019:src/rdb/TM.cc:2053 (thr_id:0x81b146e00) TM 1000: _localCommit: after _refreshUnitInfo, st=SUCCESS 00000074.0065e93e 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:46:48 2019:src/rdb/TM.cc:2080 (thr_id:0x81b146e00) TM 1000: Local commit for TID <5,981393,981393> label 'SP: rdb-info-update lock' : time: 2 msec; result: SUCCESS. 00000074.0065e93f 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:46:48 2019:src/rdb/TM.cc:2964 (thr_id:0x81b146e00) TM 1000: secondary committed txn TID <5,981393,981393> (from <5,981391>). 00000074.0065e940 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:50:07 2019:src/rdb/TM.cc:2920 (thr_id:0x81b146900) TM 1000: receives propagation of TID <5,981394,981394> (from <5,981393>). 00000074.0065e941 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:50:07 2019:src/rdb/TM.cc:2001 (thr_id:0x81b146900) TM 1000: Begin commit for TID <5,981394,981394> labelOnly false label 'job_manager job_sched check claimable' 00000074.0065e942 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:50:07 2019:src/rdb/TM.cc:2012 (thr_id:0x81b146900) TM 1000: _localCommit: before beginUpdate 00000074.0065e943 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:50:07 2019:src/rdb/TM.cc:2018 (thr_id:0x81b146900) TM 1000: _localCommit: after beginUpdate 00000074.0065e944 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:50:07 2019:src/rdb/TM.cc:2026 (thr_id:0x81b146900) TM 1000: _localCommit: after saveTxnChanges (dbId=484), st=SUCCESS 00000074.0065e945 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:50:07 2019:src/rdb/TM.cc:2030 (thr_id:0x81b146900) TM 1000: _localCommit: before LocalUnit::commit 00000074.0065e946 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:50:07 2019:src/rdb/TM.cc:2045 (thr_id:0x81b146900) TM 1000: _localCommit: after LocalUnit::commit, st=SUCCESS 00000074.0065e947 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:50:07 2019:src/rdb/TM.cc:2053 (thr_id:0x81b146900) TM 1000: _localCommit: after _refreshUnitInfo, st=SUCCESS 00000074.0065e948 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:50:07 2019:src/rdb/TM.cc:2080 (thr_id:0x81b146900) TM 1000: Local commit for TID <5,981394,981394> label 'job_manager job_sched check claimable' : time: 3 msec; result: SUCCESS. 00000074.0065e949 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:50:07 2019:src/rdb/TM.cc:2964 (thr_id:0x81b146900) TM 1000: secondary committed txn TID <5,981394,981394> (from <5,981393>). 00000074.0065e94a 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:50:07 2019:src/rdb/TM.cc:2661 (thr_id:0x81d1e9700) TM 1000: app commit: TID <5,981395,981395>. 00000074.0065e94b 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:50:07 2019:src/rdb/TM.cc:2920 (thr_id:0x81b146900) TM 1000: receives propagation of TID <5,981395,981395> (from <5,981394>). 00000074.0065e94c 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:50:07 2019:src/rdb/TM.cc:2001 (thr_id:0x81b146900) TM 1000: Begin commit for TID <5,981395,981395> labelOnly false label 'job_manager job_sched check claimable' 00000074.0065e94d 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:50:07 2019:src/rdb/TM.cc:2012 (thr_id:0x81b146900) TM 1000: _localCommit: before beginUpdate 00000074.0065e94e 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:50:07 2019:src/rdb/TM.cc:2018 (thr_id:0x81b146900) TM 1000: _localCommit: after beginUpdate 00000074.0065e94f 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:50:07 2019:src/rdb/TM.cc:2026 (thr_id:0x81b146900) TM 1000: _localCommit: after saveTxnChanges (dbId=484), st=SUCCESS 00000074.0065e950 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:50:07 2019:src/rdb/TM.cc:2030 (thr_id:0x81b146900) TM 1000: _localCommit: before LocalUnit::commit 00000074.0065e951 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:50:07 2019:src/rdb/TM.cc:2045 (thr_id:0x81b146900) TM 1000: _localCommit: after LocalUnit::commit, st=SUCCESS 00000074.0065e952 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:50:07 2019:src/rdb/TM.cc:2053 (thr_id:0x81b146900) TM 1000: _localCommit: after _refreshUnitInfo, st=SUCCESS 00000074.0065e953 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:50:07 2019:src/rdb/TM.cc:2080 (thr_id:0x81b146900) TM 1000: Local commit for TID <5,981395,981395> label 'job_manager job_sched check claimable' : time: 2 msec; result: SUCCESS. 00000074.0065e954 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:50:07 2019:src/rdb/TM.cc:2964 (thr_id:0x81b146900) TM 1000: secondary committed txn TID <5,981395,981395> (from <5,981394>). 00000074.0065e955 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:50:12 2019:src/rdb/TM.cc:2920 (thr_id:0x81b146900) TM 1000: receives propagation of TID <5,981396,981396> (from <5,981395>). 00000074.0065e956 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:50:12 2019:src/rdb/TM.cc:2001 (thr_id:0x81b146900) TM 1000: Begin commit for TID <5,981396,981396> labelOnly false label 'job_manager job tx loop' 00000074.0065e957 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:50:12 2019:src/rdb/TM.cc:2012 (thr_id:0x81b146900) TM 1000: _localCommit: before beginUpdate 00000074.0065e958 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:50:12 2019:src/rdb/TM.cc:2018 (thr_id:0x81b146900) TM 1000: _localCommit: after beginUpdate 00000074.0065e959 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:50:12 2019:src/rdb/TM.cc:2026 (thr_id:0x81b146900) TM 1000: _localCommit: after saveTxnChanges (dbId=484), st=SUCCESS 00000074.0065e95a 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:50:12 2019:src/rdb/TM.cc:2030 (thr_id:0x81b146900) TM 1000: _localCommit: before LocalUnit::commit 00000074.0065e95b 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:50:12 2019:src/rdb/TM.cc:2045 (thr_id:0x81b146900) TM 1000: _localCommit: after LocalUnit::commit, st=SUCCESS 00000074.0065e95c 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:50:12 2019:src/rdb/TM.cc:2053 (thr_id:0x81b146900) TM 1000: _localCommit: after _refreshUnitInfo, st=SUCCESS 00000074.0065e95d 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:50:12 2019:src/rdb/TM.cc:2080 (thr_id:0x81b146900) TM 1000: Local commit for TID <5,981396,981396> label 'job_manager job tx loop' : time: 1 msec; result: SUCCESS. 00000074.0065e95e 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:50:12 2019:src/rdb/TM.cc:2964 (thr_id:0x81b146900) TM 1000: secondary committed txn TID <5,981396,981396> (from <5,981395>). 00000074.0065e95f 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:55:00 2019:src/rdb/TM.cc:2661 (thr_id:0x81d1e6000) TM 1000: app commit: TID <5,981397,981397>. 00000074.0065e960 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:55:00 2019:src/rdb/TM.cc:2920 (thr_id:0x81b146e00) TM 1000: receives propagation of TID <5,981397,981397> (from <5,981396>). 00000074.0065e961 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:55:00 2019:src/rdb/TM.cc:2001 (thr_id:0x81b146e00) TM 1000: Begin commit for TID <5,981397,981397> labelOnly false label 'job_manager job_sched check claimable' 00000074.0065e962 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:55:00 2019:src/rdb/TM.cc:2012 (thr_id:0x81b146e00) TM 1000: _localCommit: before beginUpdate 00000074.0065e963 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:55:00 2019:src/rdb/TM.cc:2018 (thr_id:0x81b146e00) TM 1000: _localCommit: after beginUpdate 00000074.0065e964 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:55:00 2019:src/rdb/TM.cc:2026 (thr_id:0x81b146e00) TM 1000: _localCommit: after saveTxnChanges (dbId=484), st=SUCCESS 00000074.0065e965 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:55:00 2019:src/rdb/TM.cc:2030 (thr_id:0x81b146e00) TM 1000: _localCommit: before LocalUnit::commit 00000074.0065e966 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:55:00 2019:src/rdb/TM.cc:2045 (thr_id:0x81b146e00) TM 1000: _localCommit: after LocalUnit::commit, st=SUCCESS 00000074.0065e967 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:55:00 2019:src/rdb/TM.cc:2053 (thr_id:0x81b146e00) TM 1000: _localCommit: after _refreshUnitInfo, st=SUCCESS 00000074.0065e968 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:55:00 2019:src/rdb/TM.cc:2080 (thr_id:0x81b146e00) TM 1000: Local commit for TID <5,981397,981397> label 'job_manager job_sched check claimable' : time: 2 msec; result: SUCCESS. 00000074.0065e969 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:55:00 2019:src/rdb/TM.cc:2964 (thr_id:0x81b146e00) TM 1000: secondary committed txn TID <5,981397,981397> (from <5,981396>). 00000074.0065e96a 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:55:05 2019:src/rdb/TM.cc:2661 (thr_id:0x81d1ea100) TM 1000: app commit: TID <5,981398,981398>. 00000074.0065e96b 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:55:05 2019:src/rdb/TM.cc:2920 (thr_id:0x81b146e00) TM 1000: receives propagation of TID <5,981398,981398> (from <5,981397>). 00000074.0065e96c 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:55:05 2019:src/rdb/TM.cc:2001 (thr_id:0x81b146e00) TM 1000: Begin commit for TID <5,981398,981398> labelOnly false label 'job_manager job tx loop' 00000074.0065e96d 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:55:05 2019:src/rdb/TM.cc:2012 (thr_id:0x81b146e00) TM 1000: _localCommit: before beginUpdate 00000074.0065e96e 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:55:05 2019:src/rdb/TM.cc:2018 (thr_id:0x81b146e00) TM 1000: _localCommit: after beginUpdate 00000074.0065e96f 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:55:05 2019:src/rdb/TM.cc:2026 (thr_id:0x81b146e00) TM 1000: _localCommit: after saveTxnChanges (dbId=484), st=SUCCESS 00000074.0065e970 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:55:05 2019:src/rdb/TM.cc:2030 (thr_id:0x81b146e00) TM 1000: _localCommit: before LocalUnit::commit 00000074.0065e971 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:55:05 2019:src/rdb/TM.cc:2045 (thr_id:0x81b146e00) TM 1000: _localCommit: after LocalUnit::commit, st=SUCCESS 00000074.0065e972 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:55:05 2019:src/rdb/TM.cc:2053 (thr_id:0x81b146e00) TM 1000: _localCommit: after _refreshUnitInfo, st=SUCCESS 00000074.0065e973 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:55:05 2019:src/rdb/TM.cc:2080 (thr_id:0x81b146e00) TM 1000: Local commit for TID <5,981398,981398> label 'job_manager job tx loop' : time: 2 msec; result: SUCCESS. 00000074.0065e974 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:55:05 2019:src/rdb/TM.cc:2964 (thr_id:0x81b146e00) TM 1000: secondary committed txn TID <5,981398,981398> (from <5,981397>). 00000074.0065e975 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:55:12 2019:src/rdb/TM.cc:2920 (thr_id:0x81b146e00) TM 1000: receives propagation of TID <5,981399,981399> (from <5,981398>). 00000074.0065e976 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:55:12 2019:src/rdb/TM.cc:2001 (thr_id:0x81b146e00) TM 1000: Begin commit for TID <5,981399,981399> labelOnly false label 'job_manager job tx loop' 00000074.0065e977 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:55:12 2019:src/rdb/TM.cc:2012 (thr_id:0x81b146e00) TM 1000: _localCommit: before beginUpdate 00000074.0065e978 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:55:12 2019:src/rdb/TM.cc:2018 (thr_id:0x81b146e00) TM 1000: _localCommit: after beginUpdate 00000074.0065e979 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:55:12 2019:src/rdb/TM.cc:2026 (thr_id:0x81b146e00) TM 1000: _localCommit: after saveTxnChanges (dbId=484), st=SUCCESS 00000074.0065e97a 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:55:12 2019:src/rdb/TM.cc:2030 (thr_id:0x81b146e00) TM 1000: _localCommit: before LocalUnit::commit 00000074.0065e97b 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:55:12 2019:src/rdb/TM.cc:2045 (thr_id:0x81b146e00) TM 1000: _localCommit: after LocalUnit::commit, st=SUCCESS 00000074.0065e97c 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:55:12 2019:src/rdb/TM.cc:2053 (thr_id:0x81b146e00) TM 1000: _localCommit: after _refreshUnitInfo, st=SUCCESS 00000074.0065e97d 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:55:12 2019:src/rdb/TM.cc:2080 (thr_id:0x81b146e00) TM 1000: Local commit for TID <5,981399,981399> label 'job_manager job tx loop' : time: 2 msec; result: SUCCESS. 00000074.0065e97e 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:55:12 2019:src/rdb/TM.cc:2964 (thr_id:0x81b146e00) TM 1000: secondary committed txn TID <5,981399,981399> (from <5,981398>). 00000074.0065e97f 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:56:49 2019:src/rdb/TM.cc:2661 (thr_id:0x81da82f00) TM 1000: app commit: TID <5,981401,981401>. 00000074.0065e980 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:56:49 2019:src/rdb/TM.cc:2920 (thr_id:0x81b146900) TM 1000: receives propagation of TID <5,981401,981401> (from <5,981399>). 00000074.0065e981 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:56:49 2019:src/rdb/TM.cc:2001 (thr_id:0x81b146900) TM 1000: Begin commit for TID <5,981401,981401> labelOnly false label 'SP: rdb-info-update lock' 00000074.0065e982 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:56:49 2019:src/rdb/TM.cc:2012 (thr_id:0x81b146900) TM 1000: _localCommit: before beginUpdate 00000074.0065e983 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:56:49 2019:src/rdb/TM.cc:2018 (thr_id:0x81b146900) TM 1000: _localCommit: after beginUpdate 00000074.0065e984 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:56:49 2019:src/rdb/TM.cc:2026 (thr_id:0x81b146900) TM 1000: _localCommit: after saveTxnChanges (dbId=145), st=SUCCESS 00000074.0065e985 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:56:49 2019:src/rdb/TM.cc:2030 (thr_id:0x81b146900) TM 1000: _localCommit: before LocalUnit::commit 00000074.0065e986 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:56:49 2019:src/rdb/TM.cc:2045 (thr_id:0x81b146900) TM 1000: _localCommit: after LocalUnit::commit, st=SUCCESS 00000074.0065e987 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:56:49 2019:src/rdb/TM.cc:2053 (thr_id:0x81b146900) TM 1000: _localCommit: after _refreshUnitInfo, st=SUCCESS 00000074.0065e988 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:56:49 2019:src/rdb/TM.cc:2080 (thr_id:0x81b146900) TM 1000: Local commit for TID <5,981401,981401> label 'SP: rdb-info-update lock' : time: 2 msec; result: SUCCESS. 00000074.0065e989 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 02:56:49 2019:src/rdb/TM.cc:2964 (thr_id:0x81b146900) TM 1000: secondary committed txn TID <5,981401,981401> (from <5,981399>). 00000074.0065e98a 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:00:05 2019:src/rdb/TM.cc:2661 (thr_id:0x81d1ea100) TM 1000: app commit: TID <5,981402,981402>. 00000074.0065e98b 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:00:05 2019:src/rdb/TM.cc:2920 (thr_id:0x81b146e00) TM 1000: receives propagation of TID <5,981402,981402> (from <5,981401>). 00000074.0065e98c 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:00:05 2019:src/rdb/TM.cc:2001 (thr_id:0x81b146e00) TM 1000: Begin commit for TID <5,981402,981402> labelOnly false label 'job_manager job tx loop' 00000074.0065e98d 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:00:05 2019:src/rdb/TM.cc:2012 (thr_id:0x81b146e00) TM 1000: _localCommit: before beginUpdate 00000074.0065e98e 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:00:05 2019:src/rdb/TM.cc:2018 (thr_id:0x81b146e00) TM 1000: _localCommit: after beginUpdate 00000074.0065e98f 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:00:05 2019:src/rdb/TM.cc:2026 (thr_id:0x81b146e00) TM 1000: _localCommit: after saveTxnChanges (dbId=484), st=SUCCESS 00000074.0065e990 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:00:05 2019:src/rdb/TM.cc:2030 (thr_id:0x81b146e00) TM 1000: _localCommit: before LocalUnit::commit 00000074.0065e991 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:00:05 2019:src/rdb/TM.cc:2045 (thr_id:0x81b146e00) TM 1000: _localCommit: after LocalUnit::commit, st=SUCCESS 00000074.0065e992 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:00:05 2019:src/rdb/TM.cc:2053 (thr_id:0x81b146e00) TM 1000: _localCommit: after _refreshUnitInfo, st=SUCCESS 00000074.0065e993 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:00:05 2019:src/rdb/TM.cc:2080 (thr_id:0x81b146e00) TM 1000: Local commit for TID <5,981402,981402> label 'job_manager job tx loop' : time: 2 msec; result: SUCCESS. 00000074.0065e994 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:00:05 2019:src/rdb/TM.cc:2964 (thr_id:0x81b146e00) TM 1000: secondary committed txn TID <5,981402,981402> (from <5,981401>). 00000074.0065e995 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:00:07 2019:src/rdb/TM.cc:2920 (thr_id:0x81b146e00) TM 1000: receives propagation of TID <5,981403,981403> (from <5,981402>). 00000074.0065e996 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:00:07 2019:src/rdb/TM.cc:2001 (thr_id:0x81b146e00) TM 1000: Begin commit for TID <5,981403,981403> labelOnly false label 'job_manager job_sched check claimable' 00000074.0065e997 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:00:07 2019:src/rdb/TM.cc:2012 (thr_id:0x81b146e00) TM 1000: _localCommit: before beginUpdate 00000074.0065e998 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:00:07 2019:src/rdb/TM.cc:2018 (thr_id:0x81b146e00) TM 1000: _localCommit: after beginUpdate 00000074.0065e999 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:00:07 2019:src/rdb/TM.cc:2026 (thr_id:0x81b146e00) TM 1000: _localCommit: after saveTxnChanges (dbId=484), st=SUCCESS 00000074.0065e99a 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:00:07 2019:src/rdb/TM.cc:2030 (thr_id:0x81b146e00) TM 1000: _localCommit: before LocalUnit::commit 00000074.0065e99b 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:00:07 2019:src/rdb/TM.cc:2045 (thr_id:0x81b146e00) TM 1000: _localCommit: after LocalUnit::commit, st=SUCCESS 00000074.0065e99c 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:00:07 2019:src/rdb/TM.cc:2053 (thr_id:0x81b146e00) TM 1000: _localCommit: after _refreshUnitInfo, st=SUCCESS 00000074.0065e99d 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:00:07 2019:src/rdb/TM.cc:2080 (thr_id:0x81b146e00) TM 1000: Local commit for TID <5,981403,981403> label 'job_manager job_sched check claimable' : time: 2 msec; result: SUCCESS. 00000074.0065e99e 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:00:07 2019:src/rdb/TM.cc:2964 (thr_id:0x81b146e00) TM 1000: secondary committed txn TID <5,981403,981403> (from <5,981402>). 00000074.0065e99f 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:00:07 2019:src/rdb/TM.cc:2661 (thr_id:0x81d1e8d00) TM 1000: app commit: TID <5,981404,981404>. 00000074.0065e9a0 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:00:07 2019:src/rdb/TM.cc:2920 (thr_id:0x81b146e00) TM 1000: receives propagation of TID <5,981404,981404> (from <5,981403>). 00000074.0065e9a1 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:00:07 2019:src/rdb/TM.cc:2001 (thr_id:0x81b146e00) TM 1000: Begin commit for TID <5,981404,981404> labelOnly true label 'job_manager job_sched check claimable' 00000074.0065e9a2 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:00:07 2019:src/rdb/TM.cc:2012 (thr_id:0x81b146e00) TM 1000: _localCommit: before beginUpdate 00000074.0065e9a3 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:00:07 2019:src/rdb/TM.cc:2018 (thr_id:0x81b146e00) TM 1000: _localCommit: after beginUpdate 00000074.0065e9a4 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:00:07 2019:src/rdb/TM.cc:2030 (thr_id:0x81b146e00) TM 1000: _localCommit: before LocalUnit::commit 00000074.0065e9a5 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:00:07 2019:src/rdb/TM.cc:2045 (thr_id:0x81b146e00) TM 1000: _localCommit: after LocalUnit::commit, st=SUCCESS 00000074.0065e9a6 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:00:07 2019:src/rdb/TM.cc:2053 (thr_id:0x81b146e00) TM 1000: _localCommit: after _refreshUnitInfo, st=SUCCESS 00000074.0065e9a7 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:00:07 2019:src/rdb/TM.cc:2080 (thr_id:0x81b146e00) TM 1000: Local commit for TID <5,981404,981404> label 'job_manager job_sched check claimable' : time: 0 msec; result: SUCCESS. 00000074.0065e9a8 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:00:07 2019:src/rdb/TM.cc:2964 (thr_id:0x81b146e00) TM 1000: secondary committed txn TID <5,981404,981404> (from <5,981403>). 00000074.0065e9a9 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:00:12 2019:src/rdb/TM.cc:2920 (thr_id:0x81b146e00) TM 1000: receives propagation of TID <5,981405,981405> (from <5,981404>). 00000074.0065e9aa 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:00:12 2019:src/rdb/TM.cc:2001 (thr_id:0x81b146e00) TM 1000: Begin commit for TID <5,981405,981405> labelOnly false label 'job_manager job tx loop' 00000074.0065e9ab 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:00:12 2019:src/rdb/TM.cc:2012 (thr_id:0x81b146e00) TM 1000: _localCommit: before beginUpdate 00000074.0065e9ac 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:00:12 2019:src/rdb/TM.cc:2018 (thr_id:0x81b146e00) TM 1000: _localCommit: after beginUpdate 00000074.0065e9ad 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:00:12 2019:src/rdb/TM.cc:2026 (thr_id:0x81b146e00) TM 1000: _localCommit: after saveTxnChanges (dbId=484), st=SUCCESS 00000074.0065e9ae 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:00:12 2019:src/rdb/TM.cc:2030 (thr_id:0x81b146e00) TM 1000: _localCommit: before LocalUnit::commit 00000074.0065e9af 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:00:12 2019:src/rdb/TM.cc:2045 (thr_id:0x81b146e00) TM 1000: _localCommit: after LocalUnit::commit, st=SUCCESS 00000074.0065e9b0 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:00:12 2019:src/rdb/TM.cc:2053 (thr_id:0x81b146e00) TM 1000: _localCommit: after _refreshUnitInfo, st=SUCCESS 00000074.0065e9b1 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:00:12 2019:src/rdb/TM.cc:2080 (thr_id:0x81b146e00) TM 1000: Local commit for TID <5,981405,981405> label 'job_manager job tx loop' : time: 2 msec; result: SUCCESS. 00000074.0065e9b2 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:00:12 2019:src/rdb/TM.cc:2964 (thr_id:0x81b146e00) TM 1000: secondary committed txn TID <5,981405,981405> (from <5,981404>). 00000074.0065e9b3 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:01:48 2019:src/rdb/TM.cc:2920 (thr_id:0x81b146900) TM 1000: receives propagation of TID <5,981407,981407> (from <5,981405>). 00000074.0065e9b4 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:01:48 2019:src/rdb/TM.cc:2001 (thr_id:0x81b146900) TM 1000: Begin commit for TID <5,981407,981407> labelOnly false label 'SP: rdb-info-update lock' 00000074.0065e9b5 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:01:48 2019:src/rdb/TM.cc:2012 (thr_id:0x81b146900) TM 1000: _localCommit: before beginUpdate 00000074.0065e9b6 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:01:48 2019:src/rdb/TM.cc:2018 (thr_id:0x81b146900) TM 1000: _localCommit: after beginUpdate 00000074.0065e9b7 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:01:48 2019:src/rdb/TM.cc:2026 (thr_id:0x81b146900) TM 1000: _localCommit: after saveTxnChanges (dbId=145), st=SUCCESS 00000074.0065e9b8 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:01:48 2019:src/rdb/TM.cc:2030 (thr_id:0x81b146900) TM 1000: _localCommit: before LocalUnit::commit 00000074.0065e9b9 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:01:48 2019:src/rdb/TM.cc:2045 (thr_id:0x81b146900) TM 1000: _localCommit: after LocalUnit::commit, st=SUCCESS 00000074.0065e9ba 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:01:48 2019:src/rdb/TM.cc:2053 (thr_id:0x81b146900) TM 1000: _localCommit: after _refreshUnitInfo, st=SUCCESS 00000074.0065e9bb 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:01:48 2019:src/rdb/TM.cc:2080 (thr_id:0x81b146900) TM 1000: Local commit for TID <5,981407,981407> label 'SP: rdb-info-update lock' : time: 2 msec; result: SUCCESS. 00000074.0065e9bc 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:01:48 2019:src/rdb/TM.cc:2964 (thr_id:0x81b146900) TM 1000: secondary committed txn TID <5,981407,981407> (from <5,981405>). 00000074.0065e9bd 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:05:00 2019:src/rdb/TM.cc:2661 (thr_id:0x81d1e6a00) TM 1000: app commit: TID <5,981408,981408>. 00000074.0065e9be 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:05:00 2019:src/rdb/TM.cc:2920 (thr_id:0x81b146e00) TM 1000: receives propagation of TID <5,981408,981408> (from <5,981407>). 00000074.0065e9bf 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:05:00 2019:src/rdb/TM.cc:2001 (thr_id:0x81b146e00) TM 1000: Begin commit for TID <5,981408,981408> labelOnly false label 'job_manager job_sched check claimable' 00000074.0065e9c0 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:05:00 2019:src/rdb/TM.cc:2012 (thr_id:0x81b146e00) TM 1000: _localCommit: before beginUpdate 00000074.0065e9c1 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:05:00 2019:src/rdb/TM.cc:2018 (thr_id:0x81b146e00) TM 1000: _localCommit: after beginUpdate 00000074.0065e9c2 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:05:00 2019:src/rdb/TM.cc:2026 (thr_id:0x81b146e00) TM 1000: _localCommit: after saveTxnChanges (dbId=484), st=SUCCESS 00000074.0065e9c3 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:05:00 2019:src/rdb/TM.cc:2030 (thr_id:0x81b146e00) TM 1000: _localCommit: before LocalUnit::commit 00000074.0065e9c4 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:05:00 2019:src/rdb/TM.cc:2045 (thr_id:0x81b146e00) TM 1000: _localCommit: after LocalUnit::commit, st=SUCCESS 00000074.0065e9c5 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:05:00 2019:src/rdb/TM.cc:2053 (thr_id:0x81b146e00) TM 1000: _localCommit: after _refreshUnitInfo, st=SUCCESS 00000074.0065e9c6 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:05:00 2019:src/rdb/TM.cc:2080 (thr_id:0x81b146e00) TM 1000: Local commit for TID <5,981408,981408> label 'job_manager job_sched check claimable' : time: 2 msec; result: SUCCESS. 00000074.0065e9c7 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:05:00 2019:src/rdb/TM.cc:2964 (thr_id:0x81b146e00) TM 1000: secondary committed txn TID <5,981408,981408> (from <5,981407>). 00000074.0065e9c8 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:05:05 2019:src/rdb/TM.cc:2661 (thr_id:0x81d1ea100) TM 1000: app commit: TID <5,981409,981409>. 00000074.0065e9c9 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:05:05 2019:src/rdb/TM.cc:2920 (thr_id:0x81b146e00) TM 1000: receives propagation of TID <5,981409,981409> (from <5,981408>). 00000074.0065e9ca 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:05:05 2019:src/rdb/TM.cc:2001 (thr_id:0x81b146e00) TM 1000: Begin commit for TID <5,981409,981409> labelOnly false label 'job_manager job tx loop' 00000074.0065e9cb 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:05:05 2019:src/rdb/TM.cc:2012 (thr_id:0x81b146e00) TM 1000: _localCommit: before beginUpdate 00000074.0065e9cc 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:05:05 2019:src/rdb/TM.cc:2018 (thr_id:0x81b146e00) TM 1000: _localCommit: after beginUpdate 00000074.0065e9cd 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:05:05 2019:src/rdb/TM.cc:2026 (thr_id:0x81b146e00) TM 1000: _localCommit: after saveTxnChanges (dbId=484), st=SUCCESS 00000074.0065e9ce 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:05:05 2019:src/rdb/TM.cc:2030 (thr_id:0x81b146e00) TM 1000: _localCommit: before LocalUnit::commit 00000074.0065e9cf 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:05:05 2019:src/rdb/TM.cc:2045 (thr_id:0x81b146e00) TM 1000: _localCommit: after LocalUnit::commit, st=SUCCESS 00000074.0065e9d0 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:05:05 2019:src/rdb/TM.cc:2053 (thr_id:0x81b146e00) TM 1000: _localCommit: after _refreshUnitInfo, st=SUCCESS 00000074.0065e9d1 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:05:05 2019:src/rdb/TM.cc:2080 (thr_id:0x81b146e00) TM 1000: Local commit for TID <5,981409,981409> label 'job_manager job tx loop' : time: 2 msec; result: SUCCESS. 00000074.0065e9d2 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:05:05 2019:src/rdb/TM.cc:2964 (thr_id:0x81b146e00) TM 1000: secondary committed txn TID <5,981409,981409> (from <5,981408>). 00000074.0065e9d3 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:05:12 2019:src/rdb/TM.cc:2920 (thr_id:0x81b146e00) TM 1000: receives propagation of TID <5,981410,981410> (from <5,981409>). 00000074.0065e9d4 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:05:12 2019:src/rdb/TM.cc:2001 (thr_id:0x81b146e00) TM 1000: Begin commit for TID <5,981410,981410> labelOnly false label 'job_manager job tx loop' 00000074.0065e9d5 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:05:12 2019:src/rdb/TM.cc:2012 (thr_id:0x81b146e00) TM 1000: _localCommit: before beginUpdate 00000074.0065e9d6 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:05:12 2019:src/rdb/TM.cc:2018 (thr_id:0x81b146e00) TM 1000: _localCommit: after beginUpdate 00000074.0065e9d7 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:05:12 2019:src/rdb/TM.cc:2026 (thr_id:0x81b146e00) TM 1000: _localCommit: after saveTxnChanges (dbId=484), st=SUCCESS 00000074.0065e9d8 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:05:12 2019:src/rdb/TM.cc:2030 (thr_id:0x81b146e00) TM 1000: _localCommit: before LocalUnit::commit 00000074.0065e9d9 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:05:12 2019:src/rdb/TM.cc:2045 (thr_id:0x81b146e00) TM 1000: _localCommit: after LocalUnit::commit, st=SUCCESS 00000074.0065e9da 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:05:12 2019:src/rdb/TM.cc:2053 (thr_id:0x81b146e00) TM 1000: _localCommit: after _refreshUnitInfo, st=SUCCESS 00000074.0065e9db 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:05:12 2019:src/rdb/TM.cc:2080 (thr_id:0x81b146e00) TM 1000: Local commit for TID <5,981410,981410> label 'job_manager job tx loop' : time: 1 msec; result: SUCCESS. 00000074.0065e9dc 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:05:12 2019:src/rdb/TM.cc:2964 (thr_id:0x81b146e00) TM 1000: secondary committed txn TID <5,981410,981410> (from <5,981409>). 00000074.0065e9dd 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:10:02 2019:src/rdb/TM.cc:2920 (thr_id:0x81b146900) TM 1000: receives propagation of TID <5,981411,981411> (from <5,981410>). 00000074.0065e9de 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:10:02 2019:src/rdb/TM.cc:2001 (thr_id:0x81b146900) TM 1000: Begin commit for TID <5,981411,981411> labelOnly false label 'job_manager job_sched check claimable' 00000074.0065e9df 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:10:02 2019:src/rdb/TM.cc:2012 (thr_id:0x81b146900) TM 1000: _localCommit: before beginUpdate 00000074.0065e9e0 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:10:02 2019:src/rdb/TM.cc:2018 (thr_id:0x81b146900) TM 1000: _localCommit: after beginUpdate 00000074.0065e9e1 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:10:02 2019:src/rdb/TM.cc:2026 (thr_id:0x81b146900) TM 1000: _localCommit: after saveTxnChanges (dbId=484), st=SUCCESS 00000074.0065e9e2 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:10:02 2019:src/rdb/TM.cc:2030 (thr_id:0x81b146900) TM 1000: _localCommit: before LocalUnit::commit 00000074.0065e9e3 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:10:02 2019:src/rdb/TM.cc:2045 (thr_id:0x81b146900) TM 1000: _localCommit: after LocalUnit::commit, st=SUCCESS 00000074.0065e9e4 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:10:02 2019:src/rdb/TM.cc:2053 (thr_id:0x81b146900) TM 1000: _localCommit: after _refreshUnitInfo, st=SUCCESS 00000074.0065e9e5 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:10:02 2019:src/rdb/TM.cc:2080 (thr_id:0x81b146900) TM 1000: Local commit for TID <5,981411,981411> label 'job_manager job_sched check claimable' : time: 2 msec; result: SUCCESS. 00000074.0065e9e6 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:10:02 2019:src/rdb/TM.cc:2964 (thr_id:0x81b146900) TM 1000: secondary committed txn TID <5,981411,981411> (from <5,981410>). 00000074.0065e9e7 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:10:05 2019:src/rdb/TM.cc:2661 (thr_id:0x81d1ea100) TM 1000: app commit: TID <5,981412,981412>. 00000074.0065e9e8 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:10:05 2019:src/rdb/TM.cc:2920 (thr_id:0x81b146900) TM 1000: receives propagation of TID <5,981412,981412> (from <5,981411>). 00000074.0065e9e9 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:10:05 2019:src/rdb/TM.cc:2001 (thr_id:0x81b146900) TM 1000: Begin commit for TID <5,981412,981412> labelOnly false label 'job_manager job tx loop' 00000074.0065e9ea 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:10:05 2019:src/rdb/TM.cc:2012 (thr_id:0x81b146900) TM 1000: _localCommit: before beginUpdate 00000074.0065e9eb 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:10:05 2019:src/rdb/TM.cc:2018 (thr_id:0x81b146900) TM 1000: _localCommit: after beginUpdate 00000074.0065e9ec 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:10:05 2019:src/rdb/TM.cc:2026 (thr_id:0x81b146900) TM 1000: _localCommit: after saveTxnChanges (dbId=484), st=SUCCESS 00000074.0065e9ed 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:10:05 2019:src/rdb/TM.cc:2030 (thr_id:0x81b146900) TM 1000: _localCommit: before LocalUnit::commit 00000074.0065e9ee 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:10:05 2019:src/rdb/TM.cc:2045 (thr_id:0x81b146900) TM 1000: _localCommit: after LocalUnit::commit, st=SUCCESS 00000074.0065e9ef 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:10:05 2019:src/rdb/TM.cc:2053 (thr_id:0x81b146900) TM 1000: _localCommit: after _refreshUnitInfo, st=SUCCESS 00000074.0065e9f0 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:10:05 2019:src/rdb/TM.cc:2080 (thr_id:0x81b146900) TM 1000: Local commit for TID <5,981412,981412> label 'job_manager job tx loop' : time: 2 msec; result: SUCCESS. 00000074.0065e9f1 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:10:05 2019:src/rdb/TM.cc:2964 (thr_id:0x81b146900) TM 1000: secondary committed txn TID <5,981412,981412> (from <5,981411>). 00000074.0065e9f2 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:10:07 2019:src/rdb/TM.cc:2920 (thr_id:0x81b146900) TM 1000: receives propagation of TID <5,981413,981413> (from <5,981412>). 00000074.0065e9f3 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:10:07 2019:src/rdb/TM.cc:2001 (thr_id:0x81b146900) TM 1000: Begin commit for TID <5,981413,981413> labelOnly false label 'job_manager job tx loop' 00000074.0065e9f4 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:10:07 2019:src/rdb/TM.cc:2012 (thr_id:0x81b146900) TM 1000: _localCommit: before beginUpdate 00000074.0065e9f5 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:10:07 2019:src/rdb/TM.cc:2018 (thr_id:0x81b146900) TM 1000: _localCommit: after beginUpdate 00000074.0065e9f6 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:10:07 2019:src/rdb/TM.cc:2026 (thr_id:0x81b146900) TM 1000: _localCommit: after saveTxnChanges (dbId=484), st=SUCCESS 00000074.0065e9f7 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:10:07 2019:src/rdb/TM.cc:2030 (thr_id:0x81b146900) TM 1000: _localCommit: before LocalUnit::commit 00000074.0065e9f8 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:10:07 2019:src/rdb/TM.cc:2045 (thr_id:0x81b146900) TM 1000: _localCommit: after LocalUnit::commit, st=SUCCESS 00000074.0065e9f9 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:10:07 2019:src/rdb/TM.cc:2053 (thr_id:0x81b146900) TM 1000: _localCommit: after _refreshUnitInfo, st=SUCCESS 00000074.0065e9fa 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:10:07 2019:src/rdb/TM.cc:2080 (thr_id:0x81b146900) TM 1000: Local commit for TID <5,981413,981413> label 'job_manager job tx loop' : time: 2 msec; result: SUCCESS. 00000074.0065e9fb 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:10:07 2019:src/rdb/TM.cc:2964 (thr_id:0x81b146900) TM 1000: secondary committed txn TID <5,981413,981413> (from <5,981412>). 00000074.0065e9fc 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:11:49 2019:src/rdb/TM.cc:2661 (thr_id:0x81b244200) TM 1000: app commit: TID <5,981415,981415>. 00000074.0065e9fd 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:11:49 2019:src/rdb/TM.cc:2920 (thr_id:0x81b146e00) TM 1000: receives propagation of TID <5,981415,981415> (from <5,981413>). 00000074.0065e9fe 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:11:49 2019:src/rdb/TM.cc:2001 (thr_id:0x81b146e00) TM 1000: Begin commit for TID <5,981415,981415> labelOnly false label 'SP: rdb-info-update lock' 00000074.0065e9ff 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:11:49 2019:src/rdb/TM.cc:2012 (thr_id:0x81b146e00) TM 1000: _localCommit: before beginUpdate 00000074.0065ea00 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:11:49 2019:src/rdb/TM.cc:2018 (thr_id:0x81b146e00) TM 1000: _localCommit: after beginUpdate 00000074.0065ea01 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:11:49 2019:src/rdb/TM.cc:2026 (thr_id:0x81b146e00) TM 1000: _localCommit: after saveTxnChanges (dbId=145), st=SUCCESS 00000074.0065ea02 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:11:49 2019:src/rdb/TM.cc:2030 (thr_id:0x81b146e00) TM 1000: _localCommit: before LocalUnit::commit 00000074.0065ea03 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:11:49 2019:src/rdb/TM.cc:2045 (thr_id:0x81b146e00) TM 1000: _localCommit: after LocalUnit::commit, st=SUCCESS 00000074.0065ea04 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:11:49 2019:src/rdb/TM.cc:2053 (thr_id:0x81b146e00) TM 1000: _localCommit: after _refreshUnitInfo, st=SUCCESS 00000074.0065ea05 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:11:49 2019:src/rdb/TM.cc:2080 (thr_id:0x81b146e00) TM 1000: Local commit for TID <5,981415,981415> label 'SP: rdb-info-update lock' : time: 2 msec; result: SUCCESS. 00000074.0065ea06 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:11:49 2019:src/rdb/TM.cc:2964 (thr_id:0x81b146e00) TM 1000: secondary committed txn TID <5,981415,981415> (from <5,981413>). 00000074.0065ea07 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:14:11 2019:src/rdb/TM.cc:2661 (thr_id:0x81d1e4700) TM 1000: app commit: TID <5,981416,981416>. 00000074.0065ea08 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:14:11 2019:src/rdb/TM.cc:2920 (thr_id:0x81b146900) TM 1000: receives propagation of TID <5,981416,981416> (from <5,981415>). 00000074.0065ea09 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:14:11 2019:src/rdb/TM.cc:2001 (thr_id:0x81b146900) TM 1000: Begin commit for TID <5,981416,981416> labelOnly false label 'job_manager job_sched check claimable' 00000074.0065ea0a 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:14:11 2019:src/rdb/TM.cc:2012 (thr_id:0x81b146900) TM 1000: _localCommit: before beginUpdate 00000074.0065ea0b 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:14:11 2019:src/rdb/TM.cc:2018 (thr_id:0x81b146900) TM 1000: _localCommit: after beginUpdate 00000074.0065ea0c 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:14:11 2019:src/rdb/TM.cc:2026 (thr_id:0x81b146900) TM 1000: _localCommit: after saveTxnChanges (dbId=484), st=SUCCESS 00000074.0065ea0d 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:14:11 2019:src/rdb/TM.cc:2030 (thr_id:0x81b146900) TM 1000: _localCommit: before LocalUnit::commit 00000074.0065ea0e 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:14:11 2019:src/rdb/TM.cc:2045 (thr_id:0x81b146900) TM 1000: _localCommit: after LocalUnit::commit, st=SUCCESS 00000074.0065ea0f 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:14:11 2019:src/rdb/TM.cc:2053 (thr_id:0x81b146900) TM 1000: _localCommit: after _refreshUnitInfo, st=SUCCESS 00000074.0065ea10 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:14:11 2019:src/rdb/TM.cc:2080 (thr_id:0x81b146900) TM 1000: Local commit for TID <5,981416,981416> label 'job_manager job_sched check claimable' : time: 2 msec; result: SUCCESS. 00000074.0065ea11 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:14:11 2019:src/rdb/TM.cc:2964 (thr_id:0x81b146900) TM 1000: secondary committed txn TID <5,981416,981416> (from <5,981415>). 00000074.0065ea12 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:14:11 2019:src/rdb/TM.cc:2661 (thr_id:0x81d1ea100) TM 1000: app commit: TID <5,981417,981417>. 00000074.0065ea13 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:14:11 2019:src/rdb/TM.cc:2920 (thr_id:0x81b146900) TM 1000: receives propagation of TID <5,981417,981417> (from <5,981416>). 00000074.0065ea14 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:14:11 2019:src/rdb/TM.cc:2001 (thr_id:0x81b146900) TM 1000: Begin commit for TID <5,981417,981417> labelOnly false label 'job_manager job tx loop' 00000074.0065ea15 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:14:11 2019:src/rdb/TM.cc:2012 (thr_id:0x81b146900) TM 1000: _localCommit: before beginUpdate 00000074.0065ea16 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:14:11 2019:src/rdb/TM.cc:2018 (thr_id:0x81b146900) TM 1000: _localCommit: after beginUpdate 00000074.0065ea17 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:14:11 2019:src/rdb/TM.cc:2026 (thr_id:0x81b146900) TM 1000: _localCommit: after saveTxnChanges (dbId=484), st=SUCCESS 00000074.0065ea18 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:14:11 2019:src/rdb/TM.cc:2030 (thr_id:0x81b146900) TM 1000: _localCommit: before LocalUnit::commit 00000074.0065ea19 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:14:11 2019:src/rdb/TM.cc:2045 (thr_id:0x81b146900) TM 1000: _localCommit: after LocalUnit::commit, st=SUCCESS 00000074.0065ea1a 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:14:11 2019:src/rdb/TM.cc:2053 (thr_id:0x81b146900) TM 1000: _localCommit: after _refreshUnitInfo, st=SUCCESS 00000074.0065ea1b 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:14:11 2019:src/rdb/TM.cc:2080 (thr_id:0x81b146900) TM 1000: Local commit for TID <5,981417,981417> label 'job_manager job tx loop' : time: 1 msec; result: SUCCESS. 00000074.0065ea1c 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:14:11 2019:src/rdb/TM.cc:2964 (thr_id:0x81b146900) TM 1000: secondary committed txn TID <5,981417,981417> (from <5,981416>). 00000074.0065ea1d 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:14:11 2019:src/rdb/TM.cc:2920 (thr_id:0x81b146900) TM 1000: receives propagation of TID <5,981418,981418> (from <5,981417>). 00000074.0065ea1e 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:14:11 2019:src/rdb/TM.cc:2001 (thr_id:0x81b146900) TM 1000: Begin commit for TID <5,981418,981418> labelOnly false label 'job_manager job_sched check claimable' 00000074.0065ea1f 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:14:11 2019:src/rdb/TM.cc:2012 (thr_id:0x81b146900) TM 1000: _localCommit: before beginUpdate 00000074.0065ea20 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:14:11 2019:src/rdb/TM.cc:2018 (thr_id:0x81b146900) TM 1000: _localCommit: after beginUpdate 00000074.0065ea21 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:14:11 2019:src/rdb/TM.cc:2026 (thr_id:0x81b146900) TM 1000: _localCommit: after saveTxnChanges (dbId=484), st=SUCCESS 00000074.0065ea22 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:14:11 2019:src/rdb/TM.cc:2030 (thr_id:0x81b146900) TM 1000: _localCommit: before LocalUnit::commit 00000074.0065ea23 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:14:11 2019:src/rdb/TM.cc:2045 (thr_id:0x81b146900) TM 1000: _localCommit: after LocalUnit::commit, st=SUCCESS 00000074.0065ea24 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:14:11 2019:src/rdb/TM.cc:2053 (thr_id:0x81b146900) TM 1000: _localCommit: after _refreshUnitInfo, st=SUCCESS 00000074.0065ea25 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:14:11 2019:src/rdb/TM.cc:2080 (thr_id:0x81b146900) TM 1000: Local commit for TID <5,981418,981418> label 'job_manager job_sched check claimable' : time: 2 msec; result: SUCCESS. 00000074.0065ea26 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:14:11 2019:src/rdb/TM.cc:2964 (thr_id:0x81b146900) TM 1000: secondary committed txn TID <5,981418,981418> (from <5,981417>). 00000074.0065ea27 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:15:07 2019:src/rdb/TM.cc:2920 (thr_id:0x81b146900) TM 1000: receives propagation of TID <5,981419,981419> (from <5,981418>). 00000074.0065ea28 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:15:07 2019:src/rdb/TM.cc:2001 (thr_id:0x81b146900) TM 1000: Begin commit for TID <5,981419,981419> labelOnly false label 'job_manager job_sched check claimable' 00000074.0065ea29 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:15:07 2019:src/rdb/TM.cc:2012 (thr_id:0x81b146900) TM 1000: _localCommit: before beginUpdate 00000074.0065ea2a 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:15:07 2019:src/rdb/TM.cc:2018 (thr_id:0x81b146900) TM 1000: _localCommit: after beginUpdate 00000074.0065ea2b 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:15:07 2019:src/rdb/TM.cc:2026 (thr_id:0x81b146900) TM 1000: _localCommit: after saveTxnChanges (dbId=484), st=SUCCESS 00000074.0065ea2c 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:15:07 2019:src/rdb/TM.cc:2030 (thr_id:0x81b146900) TM 1000: _localCommit: before LocalUnit::commit 00000074.0065ea2d 243b8c4f Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:15:07 2019:src/rdb/TM.cc:2045 (thr_id:0x81b146900) TM 1000: _localCommit: after LocalUnit::commit, st=SUCCESS 00000074.0065ea2e 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:15:07 2019:src/rdb/TM.cc:2053 (thr_id:0x81b146900) TM 1000: _localCommit: after _refreshUnitInfo, st=SUCCESS 00000074.0065ea2f 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:15:07 2019:src/rdb/TM.cc:2080 (thr_id:0x81b146900) TM 1000: Local commit for TID <5,981419,981419> label 'job_manager job_sched check claimable' : time: 2 msec; result: SUCCESS. 00000074.0065ea30 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:15:07 2019:src/rdb/TM.cc:2964 (thr_id:0x81b146900) TM 1000: secondary committed txn TID <5,981419,981419> (from <5,981418>). 00000074.0065ea31 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:15:07 2019:src/rdb/TM.cc:2661 (thr_id:0x81d1e6500) TM 1000: app commit: TID <5,981420,981420>. 00000074.0065ea32 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:15:07 2019:src/rdb/TM.cc:2920 (thr_id:0x81b146900) TM 1000: receives propagation of TID <5,981420,981420> (from <5,981419>). 00000074.0065ea33 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:15:07 2019:src/rdb/TM.cc:2001 (thr_id:0x81b146900) TM 1000: Begin commit for TID <5,981420,981420> labelOnly false label 'job_manager job_sched check claimable' 00000074.0065ea34 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:15:07 2019:src/rdb/TM.cc:2012 (thr_id:0x81b146900) TM 1000: _localCommit: before beginUpdate 00000074.0065ea35 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:15:07 2019:src/rdb/TM.cc:2018 (thr_id:0x81b146900) TM 1000: _localCommit: after beginUpdate 00000074.0065ea36 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:15:07 2019:src/rdb/TM.cc:2026 (thr_id:0x81b146900) TM 1000: _localCommit: after saveTxnChanges (dbId=484), st=SUCCESS 00000074.0065ea37 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:15:07 2019:src/rdb/TM.cc:2030 (thr_id:0x81b146900) TM 1000: _localCommit: before LocalUnit::commit 00000074.0065ea38 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:15:07 2019:src/rdb/TM.cc:2045 (thr_id:0x81b146900) TM 1000: _localCommit: after LocalUnit::commit, st=SUCCESS 00000074.0065ea39 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:15:07 2019:src/rdb/TM.cc:2053 (thr_id:0x81b146900) TM 1000: _localCommit: after _refreshUnitInfo, st=SUCCESS 00000074.0065ea3a 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:15:07 2019:src/rdb/TM.cc:2080 (thr_id:0x81b146900) TM 1000: Local commit for TID <5,981420,981420> label 'job_manager job_sched check claimable' : time: 1 msec; result: SUCCESS. 00000074.0065ea3b 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:15:07 2019:src/rdb/TM.cc:2964 (thr_id:0x81b146900) TM 1000: secondary committed txn TID <5,981420,981420> (from <5,981419>). 00000074.0065ea3c 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:15:07 2019:src/rdb/TM.cc:2920 (thr_id:0x81b146900) TM 1000: receives propagation of TID <5,981421,981421> (from <5,981420>). 00000074.0065ea3d 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:15:07 2019:src/rdb/TM.cc:2001 (thr_id:0x81b146900) TM 1000: Begin commit for TID <5,981421,981421> labelOnly false label 'job_manager job tx loop' 00000074.0065ea3e 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:15:07 2019:src/rdb/TM.cc:2012 (thr_id:0x81b146900) TM 1000: _localCommit: before beginUpdate 00000074.0065ea3f 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:15:07 2019:src/rdb/TM.cc:2018 (thr_id:0x81b146900) TM 1000: _localCommit: after beginUpdate 00000074.0065ea40 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:15:07 2019:src/rdb/TM.cc:2026 (thr_id:0x81b146900) TM 1000: _localCommit: after saveTxnChanges (dbId=484), st=SUCCESS 00000074.0065ea41 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:15:07 2019:src/rdb/TM.cc:2030 (thr_id:0x81b146900) TM 1000: _localCommit: before LocalUnit::commit 00000074.0065ea42 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:15:07 2019:src/rdb/TM.cc:2045 (thr_id:0x81b146900) TM 1000: _localCommit: after LocalUnit::commit, st=SUCCESS 00000074.0065ea43 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:15:07 2019:src/rdb/TM.cc:2053 (thr_id:0x81b146900) TM 1000: _localCommit: after _refreshUnitInfo, st=SUCCESS 00000074.0065ea44 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:15:07 2019:src/rdb/TM.cc:2080 (thr_id:0x81b146900) TM 1000: Local commit for TID <5,981421,981421> label 'job_manager job tx loop' : time: 1 msec; result: SUCCESS. 00000074.0065ea45 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:15:07 2019:src/rdb/TM.cc:2964 (thr_id:0x81b146900) TM 1000: secondary committed txn TID <5,981421,981421> (from <5,981420>). 00000074.0065ea46 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:15:12 2019:src/rdb/TM.cc:2920 (thr_id:0x81b146900) TM 1000: receives propagation of TID <5,981422,981422> (from <5,981421>). 00000074.0065ea47 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:15:12 2019:src/rdb/TM.cc:2001 (thr_id:0x81b146900) TM 1000: Begin commit for TID <5,981422,981422> labelOnly false label 'job_manager job tx loop' 00000074.0065ea48 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:15:12 2019:src/rdb/TM.cc:2012 (thr_id:0x81b146900) TM 1000: _localCommit: before beginUpdate 00000074.0065ea49 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:15:12 2019:src/rdb/TM.cc:2018 (thr_id:0x81b146900) TM 1000: _localCommit: after beginUpdate 00000074.0065ea4a 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:15:12 2019:src/rdb/TM.cc:2026 (thr_id:0x81b146900) TM 1000: _localCommit: after saveTxnChanges (dbId=484), st=SUCCESS 00000074.0065ea4b 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:15:12 2019:src/rdb/TM.cc:2030 (thr_id:0x81b146900) TM 1000: _localCommit: before LocalUnit::commit 00000074.0065ea4c 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:15:12 2019:src/rdb/TM.cc:2045 (thr_id:0x81b146900) TM 1000: _localCommit: after LocalUnit::commit, st=SUCCESS 00000074.0065ea4d 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:15:12 2019:src/rdb/TM.cc:2053 (thr_id:0x81b146900) TM 1000: _localCommit: after _refreshUnitInfo, st=SUCCESS 00000074.0065ea4e 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:15:12 2019:src/rdb/TM.cc:2080 (thr_id:0x81b146900) TM 1000: Local commit for TID <5,981422,981422> label 'job_manager job tx loop' : time: 2 msec; result: SUCCESS. 00000074.0065ea4f 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:15:12 2019:src/rdb/TM.cc:2964 (thr_id:0x81b146900) TM 1000: secondary committed txn TID <5,981422,981422> (from <5,981421>). 00000074.0065ea50 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:16:48 2019:src/rdb/TM.cc:2920 (thr_id:0x81b146e00) TM 1000: receives propagation of TID <5,981424,981424> (from <5,981422>). 00000074.0065ea51 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:16:48 2019:src/rdb/TM.cc:2001 (thr_id:0x81b146e00) TM 1000: Begin commit for TID <5,981424,981424> labelOnly false label 'SP: rdb-info-update lock' 00000074.0065ea52 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:16:48 2019:src/rdb/TM.cc:2012 (thr_id:0x81b146e00) TM 1000: _localCommit: before beginUpdate 00000074.0065ea53 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:16:48 2019:src/rdb/TM.cc:2018 (thr_id:0x81b146e00) TM 1000: _localCommit: after beginUpdate 00000074.0065ea54 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:16:48 2019:src/rdb/TM.cc:2026 (thr_id:0x81b146e00) TM 1000: _localCommit: after saveTxnChanges (dbId=145), st=SUCCESS 00000074.0065ea55 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:16:48 2019:src/rdb/TM.cc:2030 (thr_id:0x81b146e00) TM 1000: _localCommit: before LocalUnit::commit 00000074.0065ea56 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:16:48 2019:src/rdb/TM.cc:2045 (thr_id:0x81b146e00) TM 1000: _localCommit: after LocalUnit::commit, st=SUCCESS 00000074.0065ea57 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:16:48 2019:src/rdb/TM.cc:2053 (thr_id:0x81b146e00) TM 1000: _localCommit: after _refreshUnitInfo, st=SUCCESS 00000074.0065ea58 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:16:48 2019:src/rdb/TM.cc:2080 (thr_id:0x81b146e00) TM 1000: Local commit for TID <5,981424,981424> label 'SP: rdb-info-update lock' : time: 2 msec; result: SUCCESS. 00000074.0065ea59 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:16:48 2019:src/rdb/TM.cc:2964 (thr_id:0x81b146e00) TM 1000: secondary committed txn TID <5,981424,981424> (from <5,981422>). 00000074.0065ea5a 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:19:11 2019:src/rdb/TM.cc:2661 (thr_id:0x81d1ea100) TM 1000: app commit: TID <5,981425,981425>. 00000074.0065ea5b 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:19:11 2019:src/rdb/TM.cc:2920 (thr_id:0x81b146900) TM 1000: receives propagation of TID <5,981425,981425> (from <5,981424>). 00000074.0065ea5c 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:19:11 2019:src/rdb/TM.cc:2001 (thr_id:0x81b146900) TM 1000: Begin commit for TID <5,981425,981425> labelOnly false label 'job_manager job tx loop' 00000074.0065ea5d 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:19:11 2019:src/rdb/TM.cc:2012 (thr_id:0x81b146900) TM 1000: _localCommit: before beginUpdate 00000074.0065ea5e 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:19:11 2019:src/rdb/TM.cc:2018 (thr_id:0x81b146900) TM 1000: _localCommit: after beginUpdate 00000074.0065ea5f 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:19:11 2019:src/rdb/TM.cc:2026 (thr_id:0x81b146900) TM 1000: _localCommit: after saveTxnChanges (dbId=484), st=SUCCESS 00000074.0065ea60 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:19:11 2019:src/rdb/TM.cc:2030 (thr_id:0x81b146900) TM 1000: _localCommit: before LocalUnit::commit 00000074.0065ea61 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:19:11 2019:src/rdb/TM.cc:2045 (thr_id:0x81b146900) TM 1000: _localCommit: after LocalUnit::commit, st=SUCCESS 00000074.0065ea62 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:19:11 2019:src/rdb/TM.cc:2053 (thr_id:0x81b146900) TM 1000: _localCommit: after _refreshUnitInfo, st=SUCCESS 00000074.0065ea63 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:19:11 2019:src/rdb/TM.cc:2080 (thr_id:0x81b146900) TM 1000: Local commit for TID <5,981425,981425> label 'job_manager job tx loop' : time: 2 msec; result: SUCCESS. 00000074.0065ea64 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:19:11 2019:src/rdb/TM.cc:2964 (thr_id:0x81b146900) TM 1000: secondary committed txn TID <5,981425,981425> (from <5,981424>). 00000074.0065ea65 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:20:07 2019:src/rdb/TM.cc:2920 (thr_id:0x81b146900) TM 1000: receives propagation of TID <5,981426,981426> (from <5,981425>). 00000074.0065ea66 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:20:07 2019:src/rdb/TM.cc:2001 (thr_id:0x81b146900) TM 1000: Begin commit for TID <5,981426,981426> labelOnly false label 'job_manager job_sched check claimable' 00000074.0065ea67 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:20:07 2019:src/rdb/TM.cc:2012 (thr_id:0x81b146900) TM 1000: _localCommit: before beginUpdate 00000074.0065ea68 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:20:07 2019:src/rdb/TM.cc:2018 (thr_id:0x81b146900) TM 1000: _localCommit: after beginUpdate 00000074.0065ea69 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:20:07 2019:src/rdb/TM.cc:2026 (thr_id:0x81b146900) TM 1000: _localCommit: after saveTxnChanges (dbId=484), st=SUCCESS 00000074.0065ea6a 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:20:07 2019:src/rdb/TM.cc:2030 (thr_id:0x81b146900) TM 1000: _localCommit: before LocalUnit::commit 00000074.0065ea6b 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:20:07 2019:src/rdb/TM.cc:2045 (thr_id:0x81b146900) TM 1000: _localCommit: after LocalUnit::commit, st=SUCCESS 00000074.0065ea6c 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:20:07 2019:src/rdb/TM.cc:2053 (thr_id:0x81b146900) TM 1000: _localCommit: after _refreshUnitInfo, st=SUCCESS 00000074.0065ea6d 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:20:07 2019:src/rdb/TM.cc:2080 (thr_id:0x81b146900) TM 1000: Local commit for TID <5,981426,981426> label 'job_manager job_sched check claimable' : time: 2 msec; result: SUCCESS. 00000074.0065ea6e 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:20:07 2019:src/rdb/TM.cc:2964 (thr_id:0x81b146900) TM 1000: secondary committed txn TID <5,981426,981426> (from <5,981425>). 00000074.0065ea6f 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:20:07 2019:src/rdb/TM.cc:2661 (thr_id:0x81d1e6f00) TM 1000: app commit: TID <5,981427,981427>. 00000074.0065ea70 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:20:07 2019:src/rdb/TM.cc:2920 (thr_id:0x81b146900) TM 1000: receives propagation of TID <5,981427,981427> (from <5,981426>). 00000074.0065ea71 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:20:07 2019:src/rdb/TM.cc:2001 (thr_id:0x81b146900) TM 1000: Begin commit for TID <5,981427,981427> labelOnly false label 'job_manager job_sched check claimable' 00000074.0065ea72 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:20:07 2019:src/rdb/TM.cc:2012 (thr_id:0x81b146900) TM 1000: _localCommit: before beginUpdate 00000074.0065ea73 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:20:07 2019:src/rdb/TM.cc:2018 (thr_id:0x81b146900) TM 1000: _localCommit: after beginUpdate 00000074.0065ea74 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:20:07 2019:src/rdb/TM.cc:2026 (thr_id:0x81b146900) TM 1000: _localCommit: after saveTxnChanges (dbId=484), st=SUCCESS 00000074.0065ea75 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:20:07 2019:src/rdb/TM.cc:2030 (thr_id:0x81b146900) TM 1000: _localCommit: before LocalUnit::commit 00000074.0065ea76 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:20:07 2019:src/rdb/TM.cc:2045 (thr_id:0x81b146900) TM 1000: _localCommit: after LocalUnit::commit, st=SUCCESS 00000074.0065ea77 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:20:07 2019:src/rdb/TM.cc:2053 (thr_id:0x81b146900) TM 1000: _localCommit: after _refreshUnitInfo, st=SUCCESS 00000074.0065ea78 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:20:07 2019:src/rdb/TM.cc:2080 (thr_id:0x81b146900) TM 1000: Local commit for TID <5,981427,981427> label 'job_manager job_sched check claimable' : time: 2 msec; result: SUCCESS. 00000074.0065ea79 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:20:07 2019:src/rdb/TM.cc:2964 (thr_id:0x81b146900) TM 1000: secondary committed txn TID <5,981427,981427> (from <5,981426>). 00000074.0065ea7a 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:20:12 2019:src/rdb/TM.cc:2920 (thr_id:0x81b146900) TM 1000: receives propagation of TID <5,981428,981428> (from <5,981427>). 00000074.0065ea7b 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:20:12 2019:src/rdb/TM.cc:2001 (thr_id:0x81b146900) TM 1000: Begin commit for TID <5,981428,981428> labelOnly false label 'job_manager job tx loop' 00000074.0065ea7c 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:20:12 2019:src/rdb/TM.cc:2012 (thr_id:0x81b146900) TM 1000: _localCommit: before beginUpdate 00000074.0065ea7d 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:20:12 2019:src/rdb/TM.cc:2018 (thr_id:0x81b146900) TM 1000: _localCommit: after beginUpdate 00000074.0065ea7e 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:20:12 2019:src/rdb/TM.cc:2026 (thr_id:0x81b146900) TM 1000: _localCommit: after saveTxnChanges (dbId=484), st=SUCCESS 00000074.0065ea7f 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:20:12 2019:src/rdb/TM.cc:2030 (thr_id:0x81b146900) TM 1000: _localCommit: before LocalUnit::commit 00000074.0065ea80 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:20:12 2019:src/rdb/TM.cc:2045 (thr_id:0x81b146900) TM 1000: _localCommit: after LocalUnit::commit, st=SUCCESS 00000074.0065ea81 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:20:12 2019:src/rdb/TM.cc:2053 (thr_id:0x81b146900) TM 1000: _localCommit: after _refreshUnitInfo, st=SUCCESS 00000074.0065ea82 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:20:12 2019:src/rdb/TM.cc:2080 (thr_id:0x81b146900) TM 1000: Local commit for TID <5,981428,981428> label 'job_manager job tx loop' : time: 2 msec; result: SUCCESS. 00000074.0065ea83 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:20:12 2019:src/rdb/TM.cc:2964 (thr_id:0x81b146900) TM 1000: secondary committed txn TID <5,981428,981428> (from <5,981427>). 00000074.0065ea84 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:24:11 2019:src/rdb/TM.cc:2661 (thr_id:0x81d1ea100) TM 1000: app commit: TID <5,981429,981429>. 00000074.0065ea85 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:24:11 2019:src/rdb/TM.cc:2920 (thr_id:0x81b146e00) TM 1000: receives propagation of TID <5,981429,981429> (from <5,981428>). 00000074.0065ea86 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:24:11 2019:src/rdb/TM.cc:2001 (thr_id:0x81b146e00) TM 1000: Begin commit for TID <5,981429,981429> labelOnly false label 'job_manager job tx loop' 00000074.0065ea87 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:24:11 2019:src/rdb/TM.cc:2012 (thr_id:0x81b146e00) TM 1000: _localCommit: before beginUpdate 00000074.0065ea88 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:24:11 2019:src/rdb/TM.cc:2018 (thr_id:0x81b146e00) TM 1000: _localCommit: after beginUpdate 00000074.0065ea89 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:24:11 2019:src/rdb/TM.cc:2026 (thr_id:0x81b146e00) TM 1000: _localCommit: after saveTxnChanges (dbId=484), st=SUCCESS 00000074.0065ea8a 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:24:11 2019:src/rdb/TM.cc:2030 (thr_id:0x81b146e00) TM 1000: _localCommit: before LocalUnit::commit 00000074.0065ea8b 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:24:11 2019:src/rdb/TM.cc:2045 (thr_id:0x81b146e00) TM 1000: _localCommit: after LocalUnit::commit, st=SUCCESS 00000074.0065ea8c 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:24:11 2019:src/rdb/TM.cc:2053 (thr_id:0x81b146e00) TM 1000: _localCommit: after _refreshUnitInfo, st=SUCCESS 00000074.0065ea8d 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:24:11 2019:src/rdb/TM.cc:2080 (thr_id:0x81b146e00) TM 1000: Local commit for TID <5,981429,981429> label 'job_manager job tx loop' : time: 2 msec; result: SUCCESS. 00000074.0065ea8e 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:24:11 2019:src/rdb/TM.cc:2964 (thr_id:0x81b146e00) TM 1000: secondary committed txn TID <5,981429,981429> (from <5,981428>). 00000074.0065ea8f 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:25:03 2019:src/rdb/TM.cc:2920 (thr_id:0x81b146e00) TM 1000: receives propagation of TID <5,981430,981430> (from <5,981429>). 00000074.0065ea90 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:25:03 2019:src/rdb/TM.cc:2001 (thr_id:0x81b146e00) TM 1000: Begin commit for TID <5,981430,981430> labelOnly false label 'job_manager job_sched check claimable' 00000074.0065ea91 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:25:03 2019:src/rdb/TM.cc:2012 (thr_id:0x81b146e00) TM 1000: _localCommit: before beginUpdate 00000074.0065ea92 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:25:03 2019:src/rdb/TM.cc:2018 (thr_id:0x81b146e00) TM 1000: _localCommit: after beginUpdate 00000074.0065ea93 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:25:03 2019:src/rdb/TM.cc:2026 (thr_id:0x81b146e00) TM 1000: _localCommit: after saveTxnChanges (dbId=484), st=SUCCESS 00000074.0065ea94 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:25:03 2019:src/rdb/TM.cc:2030 (thr_id:0x81b146e00) TM 1000: _localCommit: before LocalUnit::commit 00000074.0065ea95 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:25:03 2019:src/rdb/TM.cc:2045 (thr_id:0x81b146e00) TM 1000: _localCommit: after LocalUnit::commit, st=SUCCESS 00000074.0065ea96 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:25:03 2019:src/rdb/TM.cc:2053 (thr_id:0x81b146e00) TM 1000: _localCommit: after _refreshUnitInfo, st=SUCCESS 00000074.0065ea97 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:25:03 2019:src/rdb/TM.cc:2080 (thr_id:0x81b146e00) TM 1000: Local commit for TID <5,981430,981430> label 'job_manager job_sched check claimable' : time: 2 msec; result: SUCCESS. 00000074.0065ea98 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:25:03 2019:src/rdb/TM.cc:2964 (thr_id:0x81b146e00) TM 1000: secondary committed txn TID <5,981430,981430> (from <5,981429>). 00000074.0065ea99 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:25:08 2019:src/rdb/TM.cc:2920 (thr_id:0x81b146e00) TM 1000: receives propagation of TID <5,981431,981431> (from <5,981430>). 00000074.0065ea9a 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:25:08 2019:src/rdb/TM.cc:2001 (thr_id:0x81b146e00) TM 1000: Begin commit for TID <5,981431,981431> labelOnly false label 'job_manager job tx loop' 00000074.0065ea9b 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:25:08 2019:src/rdb/TM.cc:2012 (thr_id:0x81b146e00) TM 1000: _localCommit: before beginUpdate 00000074.0065ea9c 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:25:08 2019:src/rdb/TM.cc:2018 (thr_id:0x81b146e00) TM 1000: _localCommit: after beginUpdate 00000074.0065ea9d 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:25:08 2019:src/rdb/TM.cc:2026 (thr_id:0x81b146e00) TM 1000: _localCommit: after saveTxnChanges (dbId=484), st=SUCCESS 00000074.0065ea9e 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:25:08 2019:src/rdb/TM.cc:2030 (thr_id:0x81b146e00) TM 1000: _localCommit: before LocalUnit::commit 00000074.0065ea9f 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:25:08 2019:src/rdb/TM.cc:2045 (thr_id:0x81b146e00) TM 1000: _localCommit: after LocalUnit::commit, st=SUCCESS 00000074.0065eaa0 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:25:08 2019:src/rdb/TM.cc:2053 (thr_id:0x81b146e00) TM 1000: _localCommit: after _refreshUnitInfo, st=SUCCESS 00000074.0065eaa1 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:25:08 2019:src/rdb/TM.cc:2080 (thr_id:0x81b146e00) TM 1000: Local commit for TID <5,981431,981431> label 'job_manager job tx loop' : time: 2 msec; result: SUCCESS. 00000074.0065eaa2 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:25:08 2019:src/rdb/TM.cc:2964 (thr_id:0x81b146e00) TM 1000: secondary committed txn TID <5,981431,981431> (from <5,981430>). 00000074.0065eaa3 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:26:49 2019:src/rdb/TM.cc:2661 (thr_id:0x81b7bb900) TM 1000: app commit: TID <5,981433,981433>. 00000074.0065eaa4 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:26:49 2019:src/rdb/TM.cc:2920 (thr_id:0x81b146900) TM 1000: receives propagation of TID <5,981433,981433> (from <5,981431>). 00000074.0065eaa5 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:26:49 2019:src/rdb/TM.cc:2001 (thr_id:0x81b146900) TM 1000: Begin commit for TID <5,981433,981433> labelOnly false label 'SP: rdb-info-update lock' 00000074.0065eaa6 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:26:49 2019:src/rdb/TM.cc:2012 (thr_id:0x81b146900) TM 1000: _localCommit: before beginUpdate 00000074.0065eaa7 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:26:49 2019:src/rdb/TM.cc:2018 (thr_id:0x81b146900) TM 1000: _localCommit: after beginUpdate 00000074.0065eaa8 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:26:49 2019:src/rdb/TM.cc:2026 (thr_id:0x81b146900) TM 1000: _localCommit: after saveTxnChanges (dbId=145), st=SUCCESS 00000074.0065eaa9 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:26:49 2019:src/rdb/TM.cc:2030 (thr_id:0x81b146900) TM 1000: _localCommit: before LocalUnit::commit 00000074.0065eaaa 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:26:49 2019:src/rdb/TM.cc:2045 (thr_id:0x81b146900) TM 1000: _localCommit: after LocalUnit::commit, st=SUCCESS 00000074.0065eaab 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:26:49 2019:src/rdb/TM.cc:2053 (thr_id:0x81b146900) TM 1000: _localCommit: after _refreshUnitInfo, st=SUCCESS 00000074.0065eaac 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:26:49 2019:src/rdb/TM.cc:2080 (thr_id:0x81b146900) TM 1000: Local commit for TID <5,981433,981433> label 'SP: rdb-info-update lock' : time: 1 msec; result: SUCCESS. 00000074.0065eaad 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:26:49 2019:src/rdb/TM.cc:2964 (thr_id:0x81b146900) TM 1000: secondary committed txn TID <5,981433,981433> (from <5,981431>). 00000074.0065eaae 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:29:11 2019:src/rdb/TM.cc:2661 (thr_id:0x81d1ea100) TM 1000: app commit: TID <5,981434,981434>. 00000074.0065eaaf 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:29:11 2019:src/rdb/TM.cc:2920 (thr_id:0x81b146e00) TM 1000: receives propagation of TID <5,981434,981434> (from <5,981433>). 00000074.0065eab0 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:29:11 2019:src/rdb/TM.cc:2001 (thr_id:0x81b146e00) TM 1000: Begin commit for TID <5,981434,981434> labelOnly false label 'job_manager job tx loop' 00000074.0065eab1 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:29:11 2019:src/rdb/TM.cc:2012 (thr_id:0x81b146e00) TM 1000: _localCommit: before beginUpdate 00000074.0065eab2 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:29:11 2019:src/rdb/TM.cc:2018 (thr_id:0x81b146e00) TM 1000: _localCommit: after beginUpdate 00000074.0065eab3 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:29:11 2019:src/rdb/TM.cc:2026 (thr_id:0x81b146e00) TM 1000: _localCommit: after saveTxnChanges (dbId=484), st=SUCCESS 00000074.0065eab4 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:29:11 2019:src/rdb/TM.cc:2030 (thr_id:0x81b146e00) TM 1000: _localCommit: before LocalUnit::commit 00000074.0065eab5 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:29:11 2019:src/rdb/TM.cc:2045 (thr_id:0x81b146e00) TM 1000: _localCommit: after LocalUnit::commit, st=SUCCESS 00000074.0065eab6 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:29:11 2019:src/rdb/TM.cc:2053 (thr_id:0x81b146e00) TM 1000: _localCommit: after _refreshUnitInfo, st=SUCCESS 00000074.0065eab7 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:29:11 2019:src/rdb/TM.cc:2080 (thr_id:0x81b146e00) TM 1000: Local commit for TID <5,981434,981434> label 'job_manager job tx loop' : time: 2 msec; result: SUCCESS. 00000074.0065eab8 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:29:11 2019:src/rdb/TM.cc:2964 (thr_id:0x81b146e00) TM 1000: secondary committed txn TID <5,981434,981434> (from <5,981433>). 00000074.0065eab9 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:30:07 2019:src/rdb/TM.cc:2920 (thr_id:0x81b146e00) TM 1000: receives propagation of TID <5,981435,981435> (from <5,981434>). 00000074.0065eaba 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:30:07 2019:src/rdb/TM.cc:2001 (thr_id:0x81b146e00) TM 1000: Begin commit for TID <5,981435,981435> labelOnly false label 'job_manager job_sched check claimable' 00000074.0065eabb 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:30:07 2019:src/rdb/TM.cc:2012 (thr_id:0x81b146e00) TM 1000: _localCommit: before beginUpdate 00000074.0065eabc 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:30:07 2019:src/rdb/TM.cc:2018 (thr_id:0x81b146e00) TM 1000: _localCommit: after beginUpdate 00000074.0065eabd 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:30:07 2019:src/rdb/TM.cc:2026 (thr_id:0x81b146e00) TM 1000: _localCommit: after saveTxnChanges (dbId=484), st=SUCCESS 00000074.0065eabe 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:30:07 2019:src/rdb/TM.cc:2030 (thr_id:0x81b146e00) TM 1000: _localCommit: before LocalUnit::commit 00000074.0065eabf 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:30:07 2019:src/rdb/TM.cc:2045 (thr_id:0x81b146e00) TM 1000: _localCommit: after LocalUnit::commit, st=SUCCESS 00000074.0065eac0 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:30:07 2019:src/rdb/TM.cc:2053 (thr_id:0x81b146e00) TM 1000: _localCommit: after _refreshUnitInfo, st=SUCCESS 00000074.0065eac1 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:30:07 2019:src/rdb/TM.cc:2080 (thr_id:0x81b146e00) TM 1000: Local commit for TID <5,981435,981435> label 'job_manager job_sched check claimable' : time: 2 msec; result: SUCCESS. 00000074.0065eac2 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:30:07 2019:src/rdb/TM.cc:2964 (thr_id:0x81b146e00) TM 1000: secondary committed txn TID <5,981435,981435> (from <5,981434>). 00000074.0065eac3 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:30:07 2019:src/rdb/TM.cc:2661 (thr_id:0x81d1e9c00) TM 1000: app commit: TID <5,981436,981436>. 00000074.0065eac4 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:30:07 2019:src/rdb/TM.cc:2920 (thr_id:0x81b146e00) TM 1000: receives propagation of TID <5,981436,981436> (from <5,981435>). 00000074.0065eac5 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:30:07 2019:src/rdb/TM.cc:2001 (thr_id:0x81b146e00) TM 1000: Begin commit for TID <5,981436,981436> labelOnly false label 'job_manager job_sched check claimable' 00000074.0065eac6 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:30:07 2019:src/rdb/TM.cc:2012 (thr_id:0x81b146e00) TM 1000: _localCommit: before beginUpdate 00000074.0065eac7 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:30:07 2019:src/rdb/TM.cc:2018 (thr_id:0x81b146e00) TM 1000: _localCommit: after beginUpdate 00000074.0065eac8 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:30:07 2019:src/rdb/TM.cc:2026 (thr_id:0x81b146e00) TM 1000: _localCommit: after saveTxnChanges (dbId=484), st=SUCCESS 00000074.0065eac9 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:30:07 2019:src/rdb/TM.cc:2030 (thr_id:0x81b146e00) TM 1000: _localCommit: before LocalUnit::commit 00000074.0065eaca 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:30:07 2019:src/rdb/TM.cc:2045 (thr_id:0x81b146e00) TM 1000: _localCommit: after LocalUnit::commit, st=SUCCESS 00000074.0065eacb 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:30:07 2019:src/rdb/TM.cc:2053 (thr_id:0x81b146e00) TM 1000: _localCommit: after _refreshUnitInfo, st=SUCCESS 00000074.0065eacc 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:30:07 2019:src/rdb/TM.cc:2080 (thr_id:0x81b146e00) TM 1000: Local commit for TID <5,981436,981436> label 'job_manager job_sched check claimable' : time: 1 msec; result: SUCCESS. 00000074.0065eacd 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:30:07 2019:src/rdb/TM.cc:2964 (thr_id:0x81b146e00) TM 1000: secondary committed txn TID <5,981436,981436> (from <5,981435>). 00000074.0065eace 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:30:08 2019:src/rdb/TM.cc:2920 (thr_id:0x81b146e00) TM 1000: receives propagation of TID <5,981437,981437> (from <5,981436>). 00000074.0065eacf 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:30:08 2019:src/rdb/TM.cc:2001 (thr_id:0x81b146e00) TM 1000: Begin commit for TID <5,981437,981437> labelOnly false label 'job_manager job tx loop' 00000074.0065ead0 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:30:08 2019:src/rdb/TM.cc:2012 (thr_id:0x81b146e00) TM 1000: _localCommit: before beginUpdate 00000074.0065ead1 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:30:08 2019:src/rdb/TM.cc:2018 (thr_id:0x81b146e00) TM 1000: _localCommit: after beginUpdate 00000074.0065ead2 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:30:08 2019:src/rdb/TM.cc:2026 (thr_id:0x81b146e00) TM 1000: _localCommit: after saveTxnChanges (dbId=484), st=SUCCESS 00000074.0065ead3 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:30:08 2019:src/rdb/TM.cc:2030 (thr_id:0x81b146e00) TM 1000: _localCommit: before LocalUnit::commit 00000074.0065ead4 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:30:08 2019:src/rdb/TM.cc:2045 (thr_id:0x81b146e00) TM 1000: _localCommit: after LocalUnit::commit, st=SUCCESS 00000074.0065ead5 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:30:08 2019:src/rdb/TM.cc:2053 (thr_id:0x81b146e00) TM 1000: _localCommit: after _refreshUnitInfo, st=SUCCESS 00000074.0065ead6 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:30:08 2019:src/rdb/TM.cc:2080 (thr_id:0x81b146e00) TM 1000: Local commit for TID <5,981437,981437> label 'job_manager job tx loop' : time: 2 msec; result: SUCCESS. 00000074.0065ead7 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:30:08 2019:src/rdb/TM.cc:2964 (thr_id:0x81b146e00) TM 1000: secondary committed txn TID <5,981437,981437> (from <5,981436>). 00000074.0065ead8 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:30:12 2019:src/rdb/TM.cc:2920 (thr_id:0x81b146e00) TM 1000: receives propagation of TID <5,981438,981438> (from <5,981437>). 00000074.0065ead9 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:30:12 2019:src/rdb/TM.cc:2001 (thr_id:0x81b146e00) TM 1000: Begin commit for TID <5,981438,981438> labelOnly false label 'job_manager job tx loop' 00000074.0065eada 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:30:12 2019:src/rdb/TM.cc:2012 (thr_id:0x81b146e00) TM 1000: _localCommit: before beginUpdate 00000074.0065eadb 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:30:12 2019:src/rdb/TM.cc:2018 (thr_id:0x81b146e00) TM 1000: _localCommit: after beginUpdate 00000074.0065eadc 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:30:12 2019:src/rdb/TM.cc:2026 (thr_id:0x81b146e00) TM 1000: _localCommit: after saveTxnChanges (dbId=484), st=SUCCESS 00000074.0065eadd 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:30:12 2019:src/rdb/TM.cc:2030 (thr_id:0x81b146e00) TM 1000: _localCommit: before LocalUnit::commit 00000074.0065eade 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:30:12 2019:src/rdb/TM.cc:2045 (thr_id:0x81b146e00) TM 1000: _localCommit: after LocalUnit::commit, st=SUCCESS 00000074.0065eadf 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:30:12 2019:src/rdb/TM.cc:2053 (thr_id:0x81b146e00) TM 1000: _localCommit: after _refreshUnitInfo, st=SUCCESS 00000074.0065eae0 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:30:12 2019:src/rdb/TM.cc:2080 (thr_id:0x81b146e00) TM 1000: Local commit for TID <5,981438,981438> label 'job_manager job tx loop' : time: 2 msec; result: SUCCESS. 00000074.0065eae1 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:30:12 2019:src/rdb/TM.cc:2964 (thr_id:0x81b146e00) TM 1000: secondary committed txn TID <5,981438,981438> (from <5,981437>). 00000074.0065eae2 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:31:48 2019:src/rdb/TM.cc:2920 (thr_id:0x81b146900) TM 1000: receives propagation of TID <5,981440,981440> (from <5,981438>). 00000074.0065eae3 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:31:48 2019:src/rdb/TM.cc:2001 (thr_id:0x81b146900) TM 1000: Begin commit for TID <5,981440,981440> labelOnly false label 'SP: rdb-info-update lock' 00000074.0065eae4 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:31:48 2019:src/rdb/TM.cc:2012 (thr_id:0x81b146900) TM 1000: _localCommit: before beginUpdate 00000074.0065eae5 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:31:48 2019:src/rdb/TM.cc:2018 (thr_id:0x81b146900) TM 1000: _localCommit: after beginUpdate 00000074.0065eae6 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:31:48 2019:src/rdb/TM.cc:2026 (thr_id:0x81b146900) TM 1000: _localCommit: after saveTxnChanges (dbId=145), st=SUCCESS 00000074.0065eae7 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:31:48 2019:src/rdb/TM.cc:2030 (thr_id:0x81b146900) TM 1000: _localCommit: before LocalUnit::commit 00000074.0065eae8 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:31:48 2019:src/rdb/TM.cc:2045 (thr_id:0x81b146900) TM 1000: _localCommit: after LocalUnit::commit, st=SUCCESS 00000074.0065eae9 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:31:48 2019:src/rdb/TM.cc:2053 (thr_id:0x81b146900) TM 1000: _localCommit: after _refreshUnitInfo, st=SUCCESS 00000074.0065eaea 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:31:48 2019:src/rdb/TM.cc:2080 (thr_id:0x81b146900) TM 1000: Local commit for TID <5,981440,981440> label 'SP: rdb-info-update lock' : time: 2 msec; result: SUCCESS. 00000074.0065eaeb 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:31:48 2019:src/rdb/TM.cc:2964 (thr_id:0x81b146900) TM 1000: secondary committed txn TID <5,981440,981440> (from <5,981438>). 00000074.0065eaec 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:34:11 2019:src/rdb/TM.cc:2661 (thr_id:0x81d1ea100) TM 1000: app commit: TID <5,981441,981441>. 00000074.0065eaed 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:34:11 2019:src/rdb/TM.cc:2920 (thr_id:0x81b146e00) TM 1000: receives propagation of TID <5,981441,981441> (from <5,981440>). 00000074.0065eaee 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:34:11 2019:src/rdb/TM.cc:2001 (thr_id:0x81b146e00) TM 1000: Begin commit for TID <5,981441,981441> labelOnly false label 'job_manager job tx loop' 00000074.0065eaef 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:34:11 2019:src/rdb/TM.cc:2012 (thr_id:0x81b146e00) TM 1000: _localCommit: before beginUpdate 00000074.0065eaf0 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:34:11 2019:src/rdb/TM.cc:2018 (thr_id:0x81b146e00) TM 1000: _localCommit: after beginUpdate 00000074.0065eaf1 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:34:11 2019:src/rdb/TM.cc:2026 (thr_id:0x81b146e00) TM 1000: _localCommit: after saveTxnChanges (dbId=484), st=SUCCESS 00000074.0065eaf2 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:34:11 2019:src/rdb/TM.cc:2030 (thr_id:0x81b146e00) TM 1000: _localCommit: before LocalUnit::commit 00000074.0065eaf3 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:34:11 2019:src/rdb/TM.cc:2045 (thr_id:0x81b146e00) TM 1000: _localCommit: after LocalUnit::commit, st=SUCCESS 00000074.0065eaf4 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:34:11 2019:src/rdb/TM.cc:2053 (thr_id:0x81b146e00) TM 1000: _localCommit: after _refreshUnitInfo, st=SUCCESS 00000074.0065eaf5 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:34:11 2019:src/rdb/TM.cc:2080 (thr_id:0x81b146e00) TM 1000: Local commit for TID <5,981441,981441> label 'job_manager job tx loop' : time: 2 msec; result: SUCCESS. 00000074.0065eaf6 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:34:11 2019:src/rdb/TM.cc:2964 (thr_id:0x81b146e00) TM 1000: secondary committed txn TID <5,981441,981441> (from <5,981440>). 00000074.0065eaf7 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:35:07 2019:src/rdb/TM.cc:2920 (thr_id:0x81b146e00) TM 1000: receives propagation of TID <5,981442,981442> (from <5,981441>). 00000074.0065eaf8 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:35:07 2019:src/rdb/TM.cc:2001 (thr_id:0x81b146e00) TM 1000: Begin commit for TID <5,981442,981442> labelOnly false label 'job_manager job_sched check claimable' 00000074.0065eaf9 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:35:07 2019:src/rdb/TM.cc:2012 (thr_id:0x81b146e00) TM 1000: _localCommit: before beginUpdate 00000074.0065eafa 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:35:07 2019:src/rdb/TM.cc:2018 (thr_id:0x81b146e00) TM 1000: _localCommit: after beginUpdate 00000074.0065eafb 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:35:07 2019:src/rdb/TM.cc:2026 (thr_id:0x81b146e00) TM 1000: _localCommit: after saveTxnChanges (dbId=484), st=SUCCESS 00000074.0065eafc 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:35:07 2019:src/rdb/TM.cc:2030 (thr_id:0x81b146e00) TM 1000: _localCommit: before LocalUnit::commit 00000074.0065eafd 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:35:07 2019:src/rdb/TM.cc:2045 (thr_id:0x81b146e00) TM 1000: _localCommit: after LocalUnit::commit, st=SUCCESS 00000074.0065eafe 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:35:07 2019:src/rdb/TM.cc:2053 (thr_id:0x81b146e00) TM 1000: _localCommit: after _refreshUnitInfo, st=SUCCESS 00000074.0065eaff 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:35:07 2019:src/rdb/TM.cc:2080 (thr_id:0x81b146e00) TM 1000: Local commit for TID <5,981442,981442> label 'job_manager job_sched check claimable' : time: 2 msec; result: SUCCESS. 00000074.0065eb00 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:35:07 2019:src/rdb/TM.cc:2964 (thr_id:0x81b146e00) TM 1000: secondary committed txn TID <5,981442,981442> (from <5,981441>). 00000074.0065eb01 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:35:07 2019:src/rdb/TM.cc:2661 (thr_id:0x81d1e9700) TM 1000: app commit: TID <5,981443,981443>. 00000074.0065eb02 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:35:07 2019:src/rdb/TM.cc:2920 (thr_id:0x81b146e00) TM 1000: receives propagation of TID <5,981443,981443> (from <5,981442>). 00000074.0065eb03 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:35:07 2019:src/rdb/TM.cc:2001 (thr_id:0x81b146e00) TM 1000: Begin commit for TID <5,981443,981443> labelOnly false label 'job_manager job_sched check claimable' 00000074.0065eb04 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:35:07 2019:src/rdb/TM.cc:2012 (thr_id:0x81b146e00) TM 1000: _localCommit: before beginUpdate 00000074.0065eb05 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:35:07 2019:src/rdb/TM.cc:2018 (thr_id:0x81b146e00) TM 1000: _localCommit: after beginUpdate 00000074.0065eb06 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:35:07 2019:src/rdb/TM.cc:2026 (thr_id:0x81b146e00) TM 1000: _localCommit: after saveTxnChanges (dbId=484), st=SUCCESS 00000074.0065eb07 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:35:07 2019:src/rdb/TM.cc:2030 (thr_id:0x81b146e00) TM 1000: _localCommit: before LocalUnit::commit 00000074.0065eb08 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:35:07 2019:src/rdb/TM.cc:2045 (thr_id:0x81b146e00) TM 1000: _localCommit: after LocalUnit::commit, st=SUCCESS 00000074.0065eb09 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:35:07 2019:src/rdb/TM.cc:2053 (thr_id:0x81b146e00) TM 1000: _localCommit: after _refreshUnitInfo, st=SUCCESS 00000074.0065eb0a 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:35:07 2019:src/rdb/TM.cc:2080 (thr_id:0x81b146e00) TM 1000: Local commit for TID <5,981443,981443> label 'job_manager job_sched check claimable' : time: 1 msec; result: SUCCESS. 00000074.0065eb0b 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:35:07 2019:src/rdb/TM.cc:2964 (thr_id:0x81b146e00) TM 1000: secondary committed txn TID <5,981443,981443> (from <5,981442>). 00000074.0065eb0c 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:35:12 2019:src/rdb/TM.cc:2920 (thr_id:0x81b146e00) TM 1000: receives propagation of TID <5,981444,981444> (from <5,981443>). 00000074.0065eb0d 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:35:12 2019:src/rdb/TM.cc:2001 (thr_id:0x81b146e00) TM 1000: Begin commit for TID <5,981444,981444> labelOnly false label 'job_manager job tx loop' 00000074.0065eb0e 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:35:12 2019:src/rdb/TM.cc:2012 (thr_id:0x81b146e00) TM 1000: _localCommit: before beginUpdate 00000074.0065eb0f 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:35:12 2019:src/rdb/TM.cc:2018 (thr_id:0x81b146e00) TM 1000: _localCommit: after beginUpdate 00000074.0065eb10 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:35:12 2019:src/rdb/TM.cc:2026 (thr_id:0x81b146e00) TM 1000: _localCommit: after saveTxnChanges (dbId=484), st=SUCCESS 00000074.0065eb11 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:35:12 2019:src/rdb/TM.cc:2030 (thr_id:0x81b146e00) TM 1000: _localCommit: before LocalUnit::commit 00000074.0065eb12 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:35:12 2019:src/rdb/TM.cc:2045 (thr_id:0x81b146e00) TM 1000: _localCommit: after LocalUnit::commit, st=SUCCESS 00000074.0065eb13 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:35:12 2019:src/rdb/TM.cc:2053 (thr_id:0x81b146e00) TM 1000: _localCommit: after _refreshUnitInfo, st=SUCCESS 00000074.0065eb14 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:35:12 2019:src/rdb/TM.cc:2080 (thr_id:0x81b146e00) TM 1000: Local commit for TID <5,981444,981444> label 'job_manager job tx loop' : time: 2 msec; result: SUCCESS. 00000074.0065eb15 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:35:12 2019:src/rdb/TM.cc:2964 (thr_id:0x81b146e00) TM 1000: secondary committed txn TID <5,981444,981444> (from <5,981443>). 00000074.0065eb16 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:39:11 2019:src/rdb/TM.cc:2661 (thr_id:0x81d1ea100) TM 1000: app commit: TID <5,981445,981445>. 00000074.0065eb17 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:39:11 2019:src/rdb/TM.cc:2920 (thr_id:0x81b146900) TM 1000: receives propagation of TID <5,981445,981445> (from <5,981444>). 00000074.0065eb18 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:39:11 2019:src/rdb/TM.cc:2001 (thr_id:0x81b146900) TM 1000: Begin commit for TID <5,981445,981445> labelOnly false label 'job_manager job tx loop' 00000074.0065eb19 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:39:11 2019:src/rdb/TM.cc:2012 (thr_id:0x81b146900) TM 1000: _localCommit: before beginUpdate 00000074.0065eb1a 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:39:11 2019:src/rdb/TM.cc:2018 (thr_id:0x81b146900) TM 1000: _localCommit: after beginUpdate 00000074.0065eb1b 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:39:11 2019:src/rdb/TM.cc:2026 (thr_id:0x81b146900) TM 1000: _localCommit: after saveTxnChanges (dbId=484), st=SUCCESS 00000074.0065eb1c 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:39:11 2019:src/rdb/TM.cc:2030 (thr_id:0x81b146900) TM 1000: _localCommit: before LocalUnit::commit 00000074.0065eb1d 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:39:11 2019:src/rdb/TM.cc:2045 (thr_id:0x81b146900) TM 1000: _localCommit: after LocalUnit::commit, st=SUCCESS 00000074.0065eb1e 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:39:11 2019:src/rdb/TM.cc:2053 (thr_id:0x81b146900) TM 1000: _localCommit: after _refreshUnitInfo, st=SUCCESS 00000074.0065eb1f 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:39:11 2019:src/rdb/TM.cc:2080 (thr_id:0x81b146900) TM 1000: Local commit for TID <5,981445,981445> label 'job_manager job tx loop' : time: 1 msec; result: SUCCESS. 00000074.0065eb20 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:39:11 2019:src/rdb/TM.cc:2964 (thr_id:0x81b146900) TM 1000: secondary committed txn TID <5,981445,981445> (from <5,981444>). 00000074.0065eb21 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:40:02 2019:src/rdb/TM.cc:2920 (thr_id:0x81b146900) TM 1000: receives propagation of TID <5,981446,981446> (from <5,981445>). 00000074.0065eb22 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:40:02 2019:src/rdb/TM.cc:2001 (thr_id:0x81b146900) TM 1000: Begin commit for TID <5,981446,981446> labelOnly false label 'job_manager job_sched check claimable' 00000074.0065eb23 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:40:02 2019:src/rdb/TM.cc:2012 (thr_id:0x81b146900) TM 1000: _localCommit: before beginUpdate 00000074.0065eb24 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:40:02 2019:src/rdb/TM.cc:2018 (thr_id:0x81b146900) TM 1000: _localCommit: after beginUpdate 00000074.0065eb25 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:40:02 2019:src/rdb/TM.cc:2026 (thr_id:0x81b146900) TM 1000: _localCommit: after saveTxnChanges (dbId=484), st=SUCCESS 00000074.0065eb26 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:40:02 2019:src/rdb/TM.cc:2030 (thr_id:0x81b146900) TM 1000: _localCommit: before LocalUnit::commit 00000074.0065eb27 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:40:02 2019:src/rdb/TM.cc:2045 (thr_id:0x81b146900) TM 1000: _localCommit: after LocalUnit::commit, st=SUCCESS 00000074.0065eb28 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:40:02 2019:src/rdb/TM.cc:2053 (thr_id:0x81b146900) TM 1000: _localCommit: after _refreshUnitInfo, st=SUCCESS 00000074.0065eb29 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:40:02 2019:src/rdb/TM.cc:2080 (thr_id:0x81b146900) TM 1000: Local commit for TID <5,981446,981446> label 'job_manager job_sched check claimable' : time: 2 msec; result: SUCCESS. 00000074.0065eb2a 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:40:02 2019:src/rdb/TM.cc:2964 (thr_id:0x81b146900) TM 1000: secondary committed txn TID <5,981446,981446> (from <5,981445>). 00000074.0065eb2b 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:40:07 2019:src/rdb/TM.cc:2920 (thr_id:0x81b146900) TM 1000: receives propagation of TID <5,981447,981447> (from <5,981446>). 00000074.0065eb2c 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:40:07 2019:src/rdb/TM.cc:2001 (thr_id:0x81b146900) TM 1000: Begin commit for TID <5,981447,981447> labelOnly false label 'job_manager job tx loop' 00000074.0065eb2d 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:40:07 2019:src/rdb/TM.cc:2012 (thr_id:0x81b146900) TM 1000: _localCommit: before beginUpdate 00000074.0065eb2e 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:40:07 2019:src/rdb/TM.cc:2018 (thr_id:0x81b146900) TM 1000: _localCommit: after beginUpdate 00000074.0065eb2f 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:40:07 2019:src/rdb/TM.cc:2026 (thr_id:0x81b146900) TM 1000: _localCommit: after saveTxnChanges (dbId=484), st=SUCCESS 00000074.0065eb30 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:40:07 2019:src/rdb/TM.cc:2030 (thr_id:0x81b146900) TM 1000: _localCommit: before LocalUnit::commit 00000074.0065eb31 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:40:07 2019:src/rdb/TM.cc:2045 (thr_id:0x81b146900) TM 1000: _localCommit: after LocalUnit::commit, st=SUCCESS 00000074.0065eb32 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:40:07 2019:src/rdb/TM.cc:2053 (thr_id:0x81b146900) TM 1000: _localCommit: after _refreshUnitInfo, st=SUCCESS 00000074.0065eb33 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:40:07 2019:src/rdb/TM.cc:2080 (thr_id:0x81b146900) TM 1000: Local commit for TID <5,981447,981447> label 'job_manager job tx loop' : time: 1 msec; result: SUCCESS. 00000074.0065eb34 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:40:07 2019:src/rdb/TM.cc:2964 (thr_id:0x81b146900) TM 1000: secondary committed txn TID <5,981447,981447> (from <5,981446>). 00000074.0065eb35 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:41:49 2019:src/rdb/TM.cc:2661 (thr_id:0x81b6aba00) TM 1000: app commit: TID <5,981449,981449>. 00000074.0065eb36 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:41:49 2019:src/rdb/TM.cc:2920 (thr_id:0x81b146e00) TM 1000: receives propagation of TID <5,981449,981449> (from <5,981447>). 00000074.0065eb37 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:41:49 2019:src/rdb/TM.cc:2001 (thr_id:0x81b146e00) TM 1000: Begin commit for TID <5,981449,981449> labelOnly false label 'SP: rdb-info-update lock' 00000074.0065eb38 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:41:49 2019:src/rdb/TM.cc:2012 (thr_id:0x81b146e00) TM 1000: _localCommit: before beginUpdate 00000074.0065eb39 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:41:49 2019:src/rdb/TM.cc:2018 (thr_id:0x81b146e00) TM 1000: _localCommit: after beginUpdate 00000074.0065eb3a 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:41:49 2019:src/rdb/TM.cc:2026 (thr_id:0x81b146e00) TM 1000: _localCommit: after saveTxnChanges (dbId=145), st=SUCCESS 00000074.0065eb3b 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:41:49 2019:src/rdb/TM.cc:2030 (thr_id:0x81b146e00) TM 1000: _localCommit: before LocalUnit::commit 00000074.0065eb3c 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:41:49 2019:src/rdb/TM.cc:2045 (thr_id:0x81b146e00) TM 1000: _localCommit: after LocalUnit::commit, st=SUCCESS 00000074.0065eb3d 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:41:49 2019:src/rdb/TM.cc:2053 (thr_id:0x81b146e00) TM 1000: _localCommit: after _refreshUnitInfo, st=SUCCESS 00000074.0065eb3e 243b8c50 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:41:49 2019:src/rdb/TM.cc:2080 (thr_id:0x81b146e00) TM 1000: Local commit for TID <5,981449,981449> label 'SP: rdb-info-update lock' : time: 2 msec; result: SUCCESS. 00000074.0065eb3f 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:41:49 2019:src/rdb/TM.cc:2964 (thr_id:0x81b146e00) TM 1000: secondary committed txn TID <5,981449,981449> (from <5,981447>). 00000074.0065eb40 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:44:11 2019:src/rdb/TM.cc:2661 (thr_id:0x81d1ea100) TM 1000: app commit: TID <5,981450,981450>. 00000074.0065eb41 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:44:11 2019:src/rdb/TM.cc:2920 (thr_id:0x81b146900) TM 1000: receives propagation of TID <5,981450,981450> (from <5,981449>). 00000074.0065eb42 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:44:11 2019:src/rdb/TM.cc:2001 (thr_id:0x81b146900) TM 1000: Begin commit for TID <5,981450,981450> labelOnly false label 'job_manager job tx loop' 00000074.0065eb43 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:44:11 2019:src/rdb/TM.cc:2012 (thr_id:0x81b146900) TM 1000: _localCommit: before beginUpdate 00000074.0065eb44 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:44:11 2019:src/rdb/TM.cc:2018 (thr_id:0x81b146900) TM 1000: _localCommit: after beginUpdate 00000074.0065eb45 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:44:11 2019:src/rdb/TM.cc:2026 (thr_id:0x81b146900) TM 1000: _localCommit: after saveTxnChanges (dbId=484), st=SUCCESS 00000074.0065eb46 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:44:11 2019:src/rdb/TM.cc:2030 (thr_id:0x81b146900) TM 1000: _localCommit: before LocalUnit::commit 00000074.0065eb47 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:44:11 2019:src/rdb/TM.cc:2045 (thr_id:0x81b146900) TM 1000: _localCommit: after LocalUnit::commit, st=SUCCESS 00000074.0065eb48 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:44:11 2019:src/rdb/TM.cc:2053 (thr_id:0x81b146900) TM 1000: _localCommit: after _refreshUnitInfo, st=SUCCESS 00000074.0065eb49 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:44:11 2019:src/rdb/TM.cc:2080 (thr_id:0x81b146900) TM 1000: Local commit for TID <5,981450,981450> label 'job_manager job tx loop' : time: 2 msec; result: SUCCESS. 00000074.0065eb4a 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:44:11 2019:src/rdb/TM.cc:2964 (thr_id:0x81b146900) TM 1000: secondary committed txn TID <5,981450,981450> (from <5,981449>). 00000074.0065eb4b 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:45:07 2019:src/rdb/TM.cc:2920 (thr_id:0x81b146900) TM 1000: receives propagation of TID <5,981451,981451> (from <5,981450>). 00000074.0065eb4c 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:45:07 2019:src/rdb/TM.cc:2001 (thr_id:0x81b146900) TM 1000: Begin commit for TID <5,981451,981451> labelOnly false label 'job_manager job_sched check claimable' 00000074.0065eb4d 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:45:07 2019:src/rdb/TM.cc:2012 (thr_id:0x81b146900) TM 1000: _localCommit: before beginUpdate 00000074.0065eb4e 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:45:07 2019:src/rdb/TM.cc:2018 (thr_id:0x81b146900) TM 1000: _localCommit: after beginUpdate 00000074.0065eb4f 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:45:07 2019:src/rdb/TM.cc:2026 (thr_id:0x81b146900) TM 1000: _localCommit: after saveTxnChanges (dbId=484), st=SUCCESS 00000074.0065eb50 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:45:07 2019:src/rdb/TM.cc:2030 (thr_id:0x81b146900) TM 1000: _localCommit: before LocalUnit::commit 00000074.0065eb51 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:45:07 2019:src/rdb/TM.cc:2045 (thr_id:0x81b146900) TM 1000: _localCommit: after LocalUnit::commit, st=SUCCESS 00000074.0065eb52 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:45:07 2019:src/rdb/TM.cc:2053 (thr_id:0x81b146900) TM 1000: _localCommit: after _refreshUnitInfo, st=SUCCESS 00000074.0065eb53 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:45:07 2019:src/rdb/TM.cc:2080 (thr_id:0x81b146900) TM 1000: Local commit for TID <5,981451,981451> label 'job_manager job_sched check claimable' : time: 2 msec; result: SUCCESS. 00000074.0065eb54 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:45:07 2019:src/rdb/TM.cc:2964 (thr_id:0x81b146900) TM 1000: secondary committed txn TID <5,981451,981451> (from <5,981450>). 00000074.0065eb55 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:45:07 2019:src/rdb/TM.cc:2920 (thr_id:0x81b146900) TM 1000: receives propagation of TID <5,981452,981452> (from <5,981451>). 00000074.0065eb56 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:45:07 2019:src/rdb/TM.cc:2001 (thr_id:0x81b146900) TM 1000: Begin commit for TID <5,981452,981452> labelOnly false label 'job_manager job tx loop' 00000074.0065eb57 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:45:07 2019:src/rdb/TM.cc:2012 (thr_id:0x81b146900) TM 1000: _localCommit: before beginUpdate 00000074.0065eb58 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:45:07 2019:src/rdb/TM.cc:2018 (thr_id:0x81b146900) TM 1000: _localCommit: after beginUpdate 00000074.0065eb59 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:45:07 2019:src/rdb/TM.cc:2026 (thr_id:0x81b146900) TM 1000: _localCommit: after saveTxnChanges (dbId=484), st=SUCCESS 00000074.0065eb5a 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:45:07 2019:src/rdb/TM.cc:2030 (thr_id:0x81b146900) TM 1000: _localCommit: before LocalUnit::commit 00000074.0065eb5b 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:45:07 2019:src/rdb/TM.cc:2045 (thr_id:0x81b146900) TM 1000: _localCommit: after LocalUnit::commit, st=SUCCESS 00000074.0065eb5c 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:45:07 2019:src/rdb/TM.cc:2053 (thr_id:0x81b146900) TM 1000: _localCommit: after _refreshUnitInfo, st=SUCCESS 00000074.0065eb5d 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:45:07 2019:src/rdb/TM.cc:2080 (thr_id:0x81b146900) TM 1000: Local commit for TID <5,981452,981452> label 'job_manager job tx loop' : time: 1 msec; result: SUCCESS. 00000074.0065eb5e 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:45:07 2019:src/rdb/TM.cc:2964 (thr_id:0x81b146900) TM 1000: secondary committed txn TID <5,981452,981452> (from <5,981451>). 00000074.0065eb5f 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:45:07 2019:src/rdb/TM.cc:2661 (thr_id:0x81d1e8300) TM 1000: app commit: TID <5,981453,981453>. 00000074.0065eb60 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:45:07 2019:src/rdb/TM.cc:2920 (thr_id:0x81b146900) TM 1000: receives propagation of TID <5,981453,981453> (from <5,981452>). 00000074.0065eb61 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:45:07 2019:src/rdb/TM.cc:2001 (thr_id:0x81b146900) TM 1000: Begin commit for TID <5,981453,981453> labelOnly false label 'job_manager job_sched check claimable' 00000074.0065eb62 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:45:07 2019:src/rdb/TM.cc:2012 (thr_id:0x81b146900) TM 1000: _localCommit: before beginUpdate 00000074.0065eb63 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:45:07 2019:src/rdb/TM.cc:2018 (thr_id:0x81b146900) TM 1000: _localCommit: after beginUpdate 00000074.0065eb64 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:45:07 2019:src/rdb/TM.cc:2026 (thr_id:0x81b146900) TM 1000: _localCommit: after saveTxnChanges (dbId=484), st=SUCCESS 00000074.0065eb65 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:45:07 2019:src/rdb/TM.cc:2030 (thr_id:0x81b146900) TM 1000: _localCommit: before LocalUnit::commit 00000074.0065eb66 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:45:07 2019:src/rdb/TM.cc:2045 (thr_id:0x81b146900) TM 1000: _localCommit: after LocalUnit::commit, st=SUCCESS 00000074.0065eb67 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:45:07 2019:src/rdb/TM.cc:2053 (thr_id:0x81b146900) TM 1000: _localCommit: after _refreshUnitInfo, st=SUCCESS 00000074.0065eb68 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:45:07 2019:src/rdb/TM.cc:2080 (thr_id:0x81b146900) TM 1000: Local commit for TID <5,981453,981453> label 'job_manager job_sched check claimable' : time: 1 msec; result: SUCCESS. 00000074.0065eb69 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:45:07 2019:src/rdb/TM.cc:2964 (thr_id:0x81b146900) TM 1000: secondary committed txn TID <5,981453,981453> (from <5,981452>). 00000074.0065eb6a 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:45:12 2019:src/rdb/TM.cc:2920 (thr_id:0x81b146900) TM 1000: receives propagation of TID <5,981454,981454> (from <5,981453>). 00000074.0065eb6b 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:45:12 2019:src/rdb/TM.cc:2001 (thr_id:0x81b146900) TM 1000: Begin commit for TID <5,981454,981454> labelOnly false label 'job_manager job tx loop' 00000074.0065eb6c 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:45:12 2019:src/rdb/TM.cc:2012 (thr_id:0x81b146900) TM 1000: _localCommit: before beginUpdate 00000074.0065eb6d 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:45:12 2019:src/rdb/TM.cc:2018 (thr_id:0x81b146900) TM 1000: _localCommit: after beginUpdate 00000074.0065eb6e 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:45:12 2019:src/rdb/TM.cc:2026 (thr_id:0x81b146900) TM 1000: _localCommit: after saveTxnChanges (dbId=484), st=SUCCESS 00000074.0065eb6f 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:45:12 2019:src/rdb/TM.cc:2030 (thr_id:0x81b146900) TM 1000: _localCommit: before LocalUnit::commit 00000074.0065eb70 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:45:12 2019:src/rdb/TM.cc:2045 (thr_id:0x81b146900) TM 1000: _localCommit: after LocalUnit::commit, st=SUCCESS 00000074.0065eb71 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:45:12 2019:src/rdb/TM.cc:2053 (thr_id:0x81b146900) TM 1000: _localCommit: after _refreshUnitInfo, st=SUCCESS 00000074.0065eb72 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:45:12 2019:src/rdb/TM.cc:2080 (thr_id:0x81b146900) TM 1000: Local commit for TID <5,981454,981454> label 'job_manager job tx loop' : time: 2 msec; result: SUCCESS. 00000074.0065eb73 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:45:12 2019:src/rdb/TM.cc:2964 (thr_id:0x81b146900) TM 1000: secondary committed txn TID <5,981454,981454> (from <5,981453>). 00000074.0065eb74 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:46:48 2019:src/rdb/TM.cc:2920 (thr_id:0x81b146e00) TM 1000: receives propagation of TID <5,981456,981456> (from <5,981454>). 00000074.0065eb75 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:46:48 2019:src/rdb/TM.cc:2001 (thr_id:0x81b146e00) TM 1000: Begin commit for TID <5,981456,981456> labelOnly false label 'SP: rdb-info-update lock' 00000074.0065eb76 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:46:48 2019:src/rdb/TM.cc:2012 (thr_id:0x81b146e00) TM 1000: _localCommit: before beginUpdate 00000074.0065eb77 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:46:48 2019:src/rdb/TM.cc:2018 (thr_id:0x81b146e00) TM 1000: _localCommit: after beginUpdate 00000074.0065eb78 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:46:48 2019:src/rdb/TM.cc:2026 (thr_id:0x81b146e00) TM 1000: _localCommit: after saveTxnChanges (dbId=145), st=SUCCESS 00000074.0065eb79 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:46:48 2019:src/rdb/TM.cc:2030 (thr_id:0x81b146e00) TM 1000: _localCommit: before LocalUnit::commit 00000074.0065eb7a 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:46:48 2019:src/rdb/TM.cc:2045 (thr_id:0x81b146e00) TM 1000: _localCommit: after LocalUnit::commit, st=SUCCESS 00000074.0065eb7b 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:46:48 2019:src/rdb/TM.cc:2053 (thr_id:0x81b146e00) TM 1000: _localCommit: after _refreshUnitInfo, st=SUCCESS 00000074.0065eb7c 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:46:48 2019:src/rdb/TM.cc:2080 (thr_id:0x81b146e00) TM 1000: Local commit for TID <5,981456,981456> label 'SP: rdb-info-update lock' : time: 2 msec; result: SUCCESS. 00000074.0065eb7d 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:46:48 2019:src/rdb/TM.cc:2964 (thr_id:0x81b146e00) TM 1000: secondary committed txn TID <5,981456,981456> (from <5,981454>). 00000074.0065eb7e 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:49:11 2019:src/rdb/TM.cc:2661 (thr_id:0x81d1ea100) TM 1000: app commit: TID <5,981457,981457>. 00000074.0065eb7f 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:49:11 2019:src/rdb/TM.cc:2920 (thr_id:0x81b146900) TM 1000: receives propagation of TID <5,981457,981457> (from <5,981456>). 00000074.0065eb80 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:49:11 2019:src/rdb/TM.cc:2001 (thr_id:0x81b146900) TM 1000: Begin commit for TID <5,981457,981457> labelOnly false label 'job_manager job tx loop' 00000074.0065eb81 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:49:11 2019:src/rdb/TM.cc:2012 (thr_id:0x81b146900) TM 1000: _localCommit: before beginUpdate 00000074.0065eb82 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:49:11 2019:src/rdb/TM.cc:2018 (thr_id:0x81b146900) TM 1000: _localCommit: after beginUpdate 00000074.0065eb83 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:49:11 2019:src/rdb/TM.cc:2026 (thr_id:0x81b146900) TM 1000: _localCommit: after saveTxnChanges (dbId=484), st=SUCCESS 00000074.0065eb84 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:49:11 2019:src/rdb/TM.cc:2030 (thr_id:0x81b146900) TM 1000: _localCommit: before LocalUnit::commit 00000074.0065eb85 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:49:11 2019:src/rdb/TM.cc:2045 (thr_id:0x81b146900) TM 1000: _localCommit: after LocalUnit::commit, st=SUCCESS 00000074.0065eb86 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:49:11 2019:src/rdb/TM.cc:2053 (thr_id:0x81b146900) TM 1000: _localCommit: after _refreshUnitInfo, st=SUCCESS 00000074.0065eb87 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:49:11 2019:src/rdb/TM.cc:2080 (thr_id:0x81b146900) TM 1000: Local commit for TID <5,981457,981457> label 'job_manager job tx loop' : time: 2 msec; result: SUCCESS. 00000074.0065eb88 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:49:11 2019:src/rdb/TM.cc:2964 (thr_id:0x81b146900) TM 1000: secondary committed txn TID <5,981457,981457> (from <5,981456>). 00000074.0065eb89 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:50:07 2019:src/rdb/TM.cc:2920 (thr_id:0x81b146900) TM 1000: receives propagation of TID <5,981458,981458> (from <5,981457>). 00000074.0065eb8a 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:50:07 2019:src/rdb/TM.cc:2001 (thr_id:0x81b146900) TM 1000: Begin commit for TID <5,981458,981458> labelOnly false label 'job_manager job_sched check claimable' 00000074.0065eb8b 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:50:07 2019:src/rdb/TM.cc:2012 (thr_id:0x81b146900) TM 1000: _localCommit: before beginUpdate 00000074.0065eb8c 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:50:07 2019:src/rdb/TM.cc:2018 (thr_id:0x81b146900) TM 1000: _localCommit: after beginUpdate 00000074.0065eb8d 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:50:07 2019:src/rdb/TM.cc:2026 (thr_id:0x81b146900) TM 1000: _localCommit: after saveTxnChanges (dbId=484), st=SUCCESS 00000074.0065eb8e 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:50:07 2019:src/rdb/TM.cc:2030 (thr_id:0x81b146900) TM 1000: _localCommit: before LocalUnit::commit 00000074.0065eb8f 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:50:07 2019:src/rdb/TM.cc:2045 (thr_id:0x81b146900) TM 1000: _localCommit: after LocalUnit::commit, st=SUCCESS 00000074.0065eb90 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:50:07 2019:src/rdb/TM.cc:2053 (thr_id:0x81b146900) TM 1000: _localCommit: after _refreshUnitInfo, st=SUCCESS 00000074.0065eb91 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:50:07 2019:src/rdb/TM.cc:2080 (thr_id:0x81b146900) TM 1000: Local commit for TID <5,981458,981458> label 'job_manager job_sched check claimable' : time: 2 msec; result: SUCCESS. 00000074.0065eb92 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:50:07 2019:src/rdb/TM.cc:2964 (thr_id:0x81b146900) TM 1000: secondary committed txn TID <5,981458,981458> (from <5,981457>). 00000074.0065eb93 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:50:07 2019:src/rdb/TM.cc:2661 (thr_id:0x81d1e9200) TM 1000: app commit: TID <5,981459,981459>. 00000074.0065eb94 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:50:07 2019:src/rdb/TM.cc:2920 (thr_id:0x81b146900) TM 1000: receives propagation of TID <5,981459,981459> (from <5,981458>). 00000074.0065eb95 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:50:07 2019:src/rdb/TM.cc:2001 (thr_id:0x81b146900) TM 1000: Begin commit for TID <5,981459,981459> labelOnly false label 'job_manager job_sched check claimable' 00000074.0065eb96 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:50:07 2019:src/rdb/TM.cc:2012 (thr_id:0x81b146900) TM 1000: _localCommit: before beginUpdate 00000074.0065eb97 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:50:07 2019:src/rdb/TM.cc:2018 (thr_id:0x81b146900) TM 1000: _localCommit: after beginUpdate 00000074.0065eb98 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:50:07 2019:src/rdb/TM.cc:2026 (thr_id:0x81b146900) TM 1000: _localCommit: after saveTxnChanges (dbId=484), st=SUCCESS 00000074.0065eb99 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:50:07 2019:src/rdb/TM.cc:2030 (thr_id:0x81b146900) TM 1000: _localCommit: before LocalUnit::commit 00000074.0065eb9a 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:50:07 2019:src/rdb/TM.cc:2045 (thr_id:0x81b146900) TM 1000: _localCommit: after LocalUnit::commit, st=SUCCESS 00000074.0065eb9b 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:50:07 2019:src/rdb/TM.cc:2053 (thr_id:0x81b146900) TM 1000: _localCommit: after _refreshUnitInfo, st=SUCCESS 00000074.0065eb9c 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:50:07 2019:src/rdb/TM.cc:2080 (thr_id:0x81b146900) TM 1000: Local commit for TID <5,981459,981459> label 'job_manager job_sched check claimable' : time: 1 msec; result: SUCCESS. 00000074.0065eb9d 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:50:07 2019:src/rdb/TM.cc:2964 (thr_id:0x81b146900) TM 1000: secondary committed txn TID <5,981459,981459> (from <5,981458>). 00000074.0065eb9e 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:50:12 2019:src/rdb/TM.cc:2920 (thr_id:0x81b146900) TM 1000: receives propagation of TID <5,981460,981460> (from <5,981459>). 00000074.0065eb9f 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:50:12 2019:src/rdb/TM.cc:2001 (thr_id:0x81b146900) TM 1000: Begin commit for TID <5,981460,981460> labelOnly false label 'job_manager job tx loop' 00000074.0065eba0 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:50:12 2019:src/rdb/TM.cc:2012 (thr_id:0x81b146900) TM 1000: _localCommit: before beginUpdate 00000074.0065eba1 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:50:12 2019:src/rdb/TM.cc:2018 (thr_id:0x81b146900) TM 1000: _localCommit: after beginUpdate 00000074.0065eba2 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:50:12 2019:src/rdb/TM.cc:2026 (thr_id:0x81b146900) TM 1000: _localCommit: after saveTxnChanges (dbId=484), st=SUCCESS 00000074.0065eba3 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:50:12 2019:src/rdb/TM.cc:2030 (thr_id:0x81b146900) TM 1000: _localCommit: before LocalUnit::commit 00000074.0065eba4 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:50:12 2019:src/rdb/TM.cc:2045 (thr_id:0x81b146900) TM 1000: _localCommit: after LocalUnit::commit, st=SUCCESS 00000074.0065eba5 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:50:12 2019:src/rdb/TM.cc:2053 (thr_id:0x81b146900) TM 1000: _localCommit: after _refreshUnitInfo, st=SUCCESS 00000074.0065eba6 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:50:12 2019:src/rdb/TM.cc:2080 (thr_id:0x81b146900) TM 1000: Local commit for TID <5,981460,981460> label 'job_manager job tx loop' : time: 2 msec; result: SUCCESS. 00000074.0065eba7 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:50:12 2019:src/rdb/TM.cc:2964 (thr_id:0x81b146900) TM 1000: secondary committed txn TID <5,981460,981460> (from <5,981459>). 00000074.0065eba8 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:54:11 2019:src/rdb/TM.cc:2661 (thr_id:0x81d1ea100) TM 1000: app commit: TID <5,981461,981461>. 00000074.0065eba9 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:54:11 2019:src/rdb/TM.cc:2920 (thr_id:0x81b146e00) TM 1000: receives propagation of TID <5,981461,981461> (from <5,981460>). 00000074.0065ebaa 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:54:11 2019:src/rdb/TM.cc:2001 (thr_id:0x81b146e00) TM 1000: Begin commit for TID <5,981461,981461> labelOnly false label 'job_manager job tx loop' 00000074.0065ebab 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:54:11 2019:src/rdb/TM.cc:2012 (thr_id:0x81b146e00) TM 1000: _localCommit: before beginUpdate 00000074.0065ebac 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:54:11 2019:src/rdb/TM.cc:2018 (thr_id:0x81b146e00) TM 1000: _localCommit: after beginUpdate 00000074.0065ebad 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:54:11 2019:src/rdb/TM.cc:2026 (thr_id:0x81b146e00) TM 1000: _localCommit: after saveTxnChanges (dbId=484), st=SUCCESS 00000074.0065ebae 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:54:11 2019:src/rdb/TM.cc:2030 (thr_id:0x81b146e00) TM 1000: _localCommit: before LocalUnit::commit 00000074.0065ebaf 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:54:11 2019:src/rdb/TM.cc:2045 (thr_id:0x81b146e00) TM 1000: _localCommit: after LocalUnit::commit, st=SUCCESS 00000074.0065ebb0 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:54:11 2019:src/rdb/TM.cc:2053 (thr_id:0x81b146e00) TM 1000: _localCommit: after _refreshUnitInfo, st=SUCCESS 00000074.0065ebb1 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:54:11 2019:src/rdb/TM.cc:2080 (thr_id:0x81b146e00) TM 1000: Local commit for TID <5,981461,981461> label 'job_manager job tx loop' : time: 2 msec; result: SUCCESS. 00000074.0065ebb2 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:54:11 2019:src/rdb/TM.cc:2964 (thr_id:0x81b146e00) TM 1000: secondary committed txn TID <5,981461,981461> (from <5,981460>). 00000074.0065ebb3 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:55:00 2019:src/rdb/TM.cc:2920 (thr_id:0x81b146e00) TM 1000: receives propagation of TID <5,981462,981462> (from <5,981461>). 00000074.0065ebb4 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:55:00 2019:src/rdb/TM.cc:2001 (thr_id:0x81b146e00) TM 1000: Begin commit for TID <5,981462,981462> labelOnly false label 'job_manager job_sched check claimable' 00000074.0065ebb5 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:55:00 2019:src/rdb/TM.cc:2012 (thr_id:0x81b146e00) TM 1000: _localCommit: before beginUpdate 00000074.0065ebb6 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:55:00 2019:src/rdb/TM.cc:2018 (thr_id:0x81b146e00) TM 1000: _localCommit: after beginUpdate 00000074.0065ebb7 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:55:00 2019:src/rdb/TM.cc:2026 (thr_id:0x81b146e00) TM 1000: _localCommit: after saveTxnChanges (dbId=484), st=SUCCESS 00000074.0065ebb8 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:55:00 2019:src/rdb/TM.cc:2030 (thr_id:0x81b146e00) TM 1000: _localCommit: before LocalUnit::commit 00000074.0065ebb9 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:55:00 2019:src/rdb/TM.cc:2045 (thr_id:0x81b146e00) TM 1000: _localCommit: after LocalUnit::commit, st=SUCCESS 00000074.0065ebba 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:55:00 2019:src/rdb/TM.cc:2053 (thr_id:0x81b146e00) TM 1000: _localCommit: after _refreshUnitInfo, st=SUCCESS 00000074.0065ebbb 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:55:00 2019:src/rdb/TM.cc:2080 (thr_id:0x81b146e00) TM 1000: Local commit for TID <5,981462,981462> label 'job_manager job_sched check claimable' : time: 2 msec; result: SUCCESS. 00000074.0065ebbc 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:55:00 2019:src/rdb/TM.cc:2964 (thr_id:0x81b146e00) TM 1000: secondary committed txn TID <5,981462,981462> (from <5,981461>). 00000074.0065ebbd 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:55:07 2019:src/rdb/TM.cc:2920 (thr_id:0x81b146e00) TM 1000: receives propagation of TID <5,981463,981463> (from <5,981462>). 00000074.0065ebbe 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:55:07 2019:src/rdb/TM.cc:2001 (thr_id:0x81b146e00) TM 1000: Begin commit for TID <5,981463,981463> labelOnly false label 'job_manager job tx loop' 00000074.0065ebbf 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:55:07 2019:src/rdb/TM.cc:2012 (thr_id:0x81b146e00) TM 1000: _localCommit: before beginUpdate 00000074.0065ebc0 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:55:07 2019:src/rdb/TM.cc:2018 (thr_id:0x81b146e00) TM 1000: _localCommit: after beginUpdate 00000074.0065ebc1 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:55:07 2019:src/rdb/TM.cc:2026 (thr_id:0x81b146e00) TM 1000: _localCommit: after saveTxnChanges (dbId=484), st=SUCCESS 00000074.0065ebc2 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:55:07 2019:src/rdb/TM.cc:2030 (thr_id:0x81b146e00) TM 1000: _localCommit: before LocalUnit::commit 00000074.0065ebc3 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:55:07 2019:src/rdb/TM.cc:2045 (thr_id:0x81b146e00) TM 1000: _localCommit: after LocalUnit::commit, st=SUCCESS 00000074.0065ebc4 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:55:07 2019:src/rdb/TM.cc:2053 (thr_id:0x81b146e00) TM 1000: _localCommit: after _refreshUnitInfo, st=SUCCESS 00000074.0065ebc5 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:55:07 2019:src/rdb/TM.cc:2080 (thr_id:0x81b146e00) TM 1000: Local commit for TID <5,981463,981463> label 'job_manager job tx loop' : time: 2 msec; result: SUCCESS. 00000074.0065ebc6 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:55:07 2019:src/rdb/TM.cc:2964 (thr_id:0x81b146e00) TM 1000: secondary committed txn TID <5,981463,981463> (from <5,981462>). 00000074.0065ebc7 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:56:50 2019:src/rdb/TM.cc:2661 (thr_id:0x81b6aba00) TM 1000: app commit: TID <5,981465,981465>. 00000074.0065ebc8 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:56:50 2019:src/rdb/TM.cc:2920 (thr_id:0x81b146900) TM 1000: receives propagation of TID <5,981465,981465> (from <5,981463>). 00000074.0065ebc9 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:56:50 2019:src/rdb/TM.cc:2001 (thr_id:0x81b146900) TM 1000: Begin commit for TID <5,981465,981465> labelOnly false label 'SP: rdb-info-update lock' 00000074.0065ebca 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:56:50 2019:src/rdb/TM.cc:2012 (thr_id:0x81b146900) TM 1000: _localCommit: before beginUpdate 00000074.0065ebcb 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:56:50 2019:src/rdb/TM.cc:2018 (thr_id:0x81b146900) TM 1000: _localCommit: after beginUpdate 00000074.0065ebcc 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:56:50 2019:src/rdb/TM.cc:2026 (thr_id:0x81b146900) TM 1000: _localCommit: after saveTxnChanges (dbId=145), st=SUCCESS 00000074.0065ebcd 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:56:50 2019:src/rdb/TM.cc:2030 (thr_id:0x81b146900) TM 1000: _localCommit: before LocalUnit::commit 00000074.0065ebce 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:56:50 2019:src/rdb/TM.cc:2045 (thr_id:0x81b146900) TM 1000: _localCommit: after LocalUnit::commit, st=SUCCESS 00000074.0065ebcf 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:56:50 2019:src/rdb/TM.cc:2053 (thr_id:0x81b146900) TM 1000: _localCommit: after _refreshUnitInfo, st=SUCCESS 00000074.0065ebd0 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:56:50 2019:src/rdb/TM.cc:2080 (thr_id:0x81b146900) TM 1000: Local commit for TID <5,981465,981465> label 'SP: rdb-info-update lock' : time: 1 msec; result: SUCCESS. 00000074.0065ebd1 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:56:50 2019:src/rdb/TM.cc:2964 (thr_id:0x81b146900) TM 1000: secondary committed txn TID <5,981465,981465> (from <5,981463>). 00000074.0065ebd2 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:59:11 2019:src/rdb/TM.cc:2661 (thr_id:0x81d1ea100) TM 1000: app commit: TID <5,981466,981466>. 00000074.0065ebd3 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:59:18 2019:src/rdb/TM.cc:2920 (thr_id:0x81b146e00) TM 1000: receives propagation of TID <5,981466,981466> (from <5,981465>). 00000074.0065ebd4 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:59:18 2019:src/rdb/TM.cc:2001 (thr_id:0x81b146e00) TM 1000: Begin commit for TID <5,981466,981466> labelOnly false label 'job_manager job tx loop' 00000074.0065ebd5 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:59:18 2019:src/rdb/TM.cc:2012 (thr_id:0x81b146e00) TM 1000: _localCommit: before beginUpdate 00000074.0065ebd6 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:59:18 2019:src/rdb/TM.cc:2018 (thr_id:0x81b146e00) TM 1000: _localCommit: after beginUpdate 00000074.0065ebd7 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:59:18 2019:src/rdb/TM.cc:2026 (thr_id:0x81b146e00) TM 1000: _localCommit: after saveTxnChanges (dbId=484), st=SUCCESS 00000074.0065ebd8 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:59:18 2019:src/rdb/TM.cc:2030 (thr_id:0x81b146e00) TM 1000: _localCommit: before LocalUnit::commit 00000074.0065ebd9 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:59:18 2019:src/rdb/TM.cc:2045 (thr_id:0x81b146e00) TM 1000: _localCommit: after LocalUnit::commit, st=SUCCESS 00000074.0065ebda 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:59:18 2019:src/rdb/TM.cc:2053 (thr_id:0x81b146e00) TM 1000: _localCommit: after _refreshUnitInfo, st=SUCCESS 00000074.0065ebdb 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:59:18 2019:src/rdb/TM.cc:2080 (thr_id:0x81b146e00) TM 1000: Local commit for TID <5,981466,981466> label 'job_manager job tx loop' : time: 2 msec; result: SUCCESS. 00000074.0065ebdc 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 03:59:18 2019:src/rdb/TM.cc:2964 (thr_id:0x81b146e00) TM 1000: secondary committed txn TID <5,981466,981466> (from <5,981465>). 00000074.0065ebdd 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 04:00:00 2019:src/rdb/TM.cc:2920 (thr_id:0x81b146e00) TM 1000: receives propagation of TID <5,981467,981467> (from <5,981466>). 00000074.0065ebde 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 04:00:00 2019:src/rdb/TM.cc:2001 (thr_id:0x81b146e00) TM 1000: Begin commit for TID <5,981467,981467> labelOnly false label 'job_manager job_sched check claimable' 00000074.0065ebdf 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 04:00:00 2019:src/rdb/TM.cc:2012 (thr_id:0x81b146e00) TM 1000: _localCommit: before beginUpdate 00000074.0065ebe0 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 04:00:00 2019:src/rdb/TM.cc:2018 (thr_id:0x81b146e00) TM 1000: _localCommit: after beginUpdate 00000074.0065ebe1 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 04:00:00 2019:src/rdb/TM.cc:2026 (thr_id:0x81b146e00) TM 1000: _localCommit: after saveTxnChanges (dbId=484), st=SUCCESS 00000074.0065ebe2 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 04:00:00 2019:src/rdb/TM.cc:2030 (thr_id:0x81b146e00) TM 1000: _localCommit: before LocalUnit::commit 00000074.0065ebe3 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 04:00:00 2019:src/rdb/TM.cc:2045 (thr_id:0x81b146e00) TM 1000: _localCommit: after LocalUnit::commit, st=SUCCESS 00000074.0065ebe4 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 04:00:00 2019:src/rdb/TM.cc:2053 (thr_id:0x81b146e00) TM 1000: _localCommit: after _refreshUnitInfo, st=SUCCESS 00000074.0065ebe5 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 04:00:00 2019:src/rdb/TM.cc:2080 (thr_id:0x81b146e00) TM 1000: Local commit for TID <5,981467,981467> label 'job_manager job_sched check claimable' : time: 2 msec; result: SUCCESS. 00000074.0065ebe6 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 04:00:00 2019:src/rdb/TM.cc:2964 (thr_id:0x81b146e00) TM 1000: secondary committed txn TID <5,981467,981467> (from <5,981466>). 00000074.0065ebe7 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 04:00:08 2019:src/rdb/TM.cc:2920 (thr_id:0x81b146e00) TM 1000: receives propagation of TID <5,981468,981468> (from <5,981467>). 00000074.0065ebe8 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 04:00:08 2019:src/rdb/TM.cc:2001 (thr_id:0x81b146e00) TM 1000: Begin commit for TID <5,981468,981468> labelOnly false label 'job_manager job tx loop' 00000074.0065ebe9 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 04:00:08 2019:src/rdb/TM.cc:2012 (thr_id:0x81b146e00) TM 1000: _localCommit: before beginUpdate 00000074.0065ebea 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 04:00:08 2019:src/rdb/TM.cc:2018 (thr_id:0x81b146e00) TM 1000: _localCommit: after beginUpdate 00000074.0065ebeb 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 04:00:08 2019:src/rdb/TM.cc:2026 (thr_id:0x81b146e00) TM 1000: _localCommit: after saveTxnChanges (dbId=484), st=SUCCESS 00000074.0065ebec 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 04:00:08 2019:src/rdb/TM.cc:2030 (thr_id:0x81b146e00) TM 1000: _localCommit: before LocalUnit::commit 00000074.0065ebed 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 04:00:08 2019:src/rdb/TM.cc:2045 (thr_id:0x81b146e00) TM 1000: _localCommit: after LocalUnit::commit, st=SUCCESS 00000074.0065ebee 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 04:00:08 2019:src/rdb/TM.cc:2053 (thr_id:0x81b146e00) TM 1000: _localCommit: after _refreshUnitInfo, st=SUCCESS 00000074.0065ebef 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 04:00:08 2019:src/rdb/TM.cc:2080 (thr_id:0x81b146e00) TM 1000: Local commit for TID <5,981468,981468> label 'job_manager job tx loop' : time: 2 msec; result: SUCCESS. 00000074.0065ebf0 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 04:00:08 2019:src/rdb/TM.cc:2964 (thr_id:0x81b146e00) TM 1000: secondary committed txn TID <5,981468,981468> (from <5,981467>). 00000074.0065ebf1 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 04:00:09 2019:src/rdb/TM.cc:2920 (thr_id:0x81b146e00) TM 1000: receives propagation of TID <5,981469,981469> (from <5,981468>). 00000074.0065ebf2 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 04:00:09 2019:src/rdb/TM.cc:2001 (thr_id:0x81b146e00) TM 1000: Begin commit for TID <5,981469,981469> labelOnly false label 'job_manager job tx loop' 00000074.0065ebf3 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 04:00:09 2019:src/rdb/TM.cc:2012 (thr_id:0x81b146e00) TM 1000: _localCommit: before beginUpdate 00000074.0065ebf4 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 04:00:09 2019:src/rdb/TM.cc:2018 (thr_id:0x81b146e00) TM 1000: _localCommit: after beginUpdate 00000074.0065ebf5 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 04:00:09 2019:src/rdb/TM.cc:2026 (thr_id:0x81b146e00) TM 1000: _localCommit: after saveTxnChanges (dbId=484), st=SUCCESS 00000074.0065ebf6 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 04:00:09 2019:src/rdb/TM.cc:2030 (thr_id:0x81b146e00) TM 1000: _localCommit: before LocalUnit::commit 00000074.0065ebf7 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 04:00:09 2019:src/rdb/TM.cc:2045 (thr_id:0x81b146e00) TM 1000: _localCommit: after LocalUnit::commit, st=SUCCESS 00000074.0065ebf8 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 04:00:09 2019:src/rdb/TM.cc:2053 (thr_id:0x81b146e00) TM 1000: _localCommit: after _refreshUnitInfo, st=SUCCESS 00000074.0065ebf9 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 04:00:09 2019:src/rdb/TM.cc:2080 (thr_id:0x81b146e00) TM 1000: Local commit for TID <5,981469,981469> label 'job_manager job tx loop' : time: 1 msec; result: SUCCESS. 00000074.0065ebfa 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 04:00:09 2019:src/rdb/TM.cc:2964 (thr_id:0x81b146e00) TM 1000: secondary committed txn TID <5,981469,981469> (from <5,981468>). 00000074.0065ebfb 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 04:01:48 2019:src/rdb/TM.cc:2920 (thr_id:0x81b146900) TM 1000: receives propagation of TID <5,981471,981471> (from <5,981469>). 00000074.0065ebfc 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 04:01:48 2019:src/rdb/TM.cc:2001 (thr_id:0x81b146900) TM 1000: Begin commit for TID <5,981471,981471> labelOnly false label 'SP: rdb-info-update lock' 00000074.0065ebfd 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 04:01:48 2019:src/rdb/TM.cc:2012 (thr_id:0x81b146900) TM 1000: _localCommit: before beginUpdate 00000074.0065ebfe 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 04:01:48 2019:src/rdb/TM.cc:2018 (thr_id:0x81b146900) TM 1000: _localCommit: after beginUpdate 00000074.0065ebff 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 04:01:48 2019:src/rdb/TM.cc:2026 (thr_id:0x81b146900) TM 1000: _localCommit: after saveTxnChanges (dbId=145), st=SUCCESS 00000074.0065ec00 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 04:01:48 2019:src/rdb/TM.cc:2030 (thr_id:0x81b146900) TM 1000: _localCommit: before LocalUnit::commit 00000074.0065ec01 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 04:01:48 2019:src/rdb/TM.cc:2045 (thr_id:0x81b146900) TM 1000: _localCommit: after LocalUnit::commit, st=SUCCESS 00000074.0065ec02 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 04:01:48 2019:src/rdb/TM.cc:2053 (thr_id:0x81b146900) TM 1000: _localCommit: after _refreshUnitInfo, st=SUCCESS 00000074.0065ec03 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 04:01:48 2019:src/rdb/TM.cc:2080 (thr_id:0x81b146900) TM 1000: Local commit for TID <5,981471,981471> label 'SP: rdb-info-update lock' : time: 2 msec; result: SUCCESS. 00000074.0065ec04 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 04:01:48 2019:src/rdb/TM.cc:2964 (thr_id:0x81b146900) TM 1000: secondary committed txn TID <5,981471,981471> (from <5,981469>). 00000074.0065ec05 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 04:04:18 2019:src/rdb/TM.cc:2661 (thr_id:0x81d1ea100) TM 1000: app commit: TID <5,981472,981472>. 00000074.0065ec06 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::TM:Thu Sep 26 04:04:48 2019:src/rdb/TM.cc:1883 (thr_id:0x81d1ea100) TM _localSiteHasFailed called with epoch 5 (vs _epoch=5), claimedRole TM_CLIENT (1) 00000074.0065ec07 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] ******* OOQ mtrace dump END ********* 00000074.0065ec08 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] ******* OOQ QM mtrace dump BEGIN ********* 00000074.0065ec09 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::qm:Fri Dec 29 13:17:05 2017:src/rdb/quorum/qm_states/qm_out_initializing.cc:41 (thr_id:0x81d1df700) InitializingState::state2: WS_Initializing -> WS_WaitingForStart 00000074.0065ec0a 243b8c51 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::qm:Fri Dec 29 13:17:05 2017:src/rdb/quorum/qm_states/qm_state.cc:560 (thr_id:0x81d1df700) QmState::stateTrans: WS_Initializing -> WS_WaitingForStart at: 5874815s, why: initialized 00000074.0065ec0b 243b8c61 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::qm:Fri Dec 29 13:17:05 2017:src/rdb/quorum/dslqm.cc:538 (thr_id:0x81a804200) addSite index: 0 myVoterIndex 0. 00000074.0065ec0c 243b8c61 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::qm:Fri Dec 29 13:17:05 2017:src/rdb/quorum/dslqm.cc:538 (thr_id:0x81a804200) addSite index: 1 myVoterIndex 0. 00000074.0065ec0d 243b8c61 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::qm:Fri Dec 29 13:17:05 2017:src/rdb/quorum/qm_states/qm_out_waiting_for_start.cc:46 (thr_id:0x81a804200) WaitingForStartState::state2: WS_WaitingForStart -> WS_WaitingForVotes 00000074.0065ec0e 243b8c62 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::qm:Fri Dec 29 13:17:05 2017:src/rdb/quorum/qm_states/qm_out_no_reply.cc:50 (thr_id:0x81a804200) NoReplyState::stateUp2NoReply: WS_WaitingForStart -> WS_WaitingForVotes 00000074.0065ec0f 243b8c62 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::qm:Fri Dec 29 13:17:05 2017:src/rdb/quorum/qm_states/qm_state.cc:309 (thr_id:0x81a804200) qmsPreferredCandidate_set till: 5874333s who: 1000 00000074.0065ec10 243b8c62 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::qm:Fri Dec 29 13:17:05 2017:src/rdb/quorum/qm_states/qm_out_out_of_quorum.cc:66 (thr_id:0x81a804200) OutOfQuorumState::stateUp2OutOfQuorum: WS_WaitingForStart -> WS_WaitingForVotes 00000074.0065ec11 243b8c62 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::qm:Fri Dec 29 13:17:05 2017:src/rdb/quorum/qm_states/qm_state.cc:560 (thr_id:0x81a804200) QmState::stateTrans: WS_WaitingForStart -> WS_WaitingForVotes at: 5874815s, why: started 00000074.0065ec12 243b8c62 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::qm:Fri Dec 29 15:17:45 2017:src/rdb/quorum/quorumimpl.cc:352 (thr_id:0x81b7bb400) ensureBeaconOrder: sender 1001, voter incarnation 0 -> 2, voters beacon epoch 0 -> 5, voters beacon count 0 -> 577547 00000074.0065ec13 243b8c62 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::qm:Fri Dec 29 15:17:45 2017:src/rdb/quorum/quorumimpl.cc:2233 (thr_id:0x81b7bb400) secondaryJoinsExistingQuorum QM epoch change: 4 => 5 00000074.0065ec14 243b8c62 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::qm:Fri Dec 29 15:17:45 2017:src/rdb/quorum/qm_states/qm_out_waiting_for_votes.cc:86 (thr_id:0x81b7bb400) WaitingForVotesState::state2: WS_WaitingForVotes -> WS_BecomingMember 00000074.0065ec15 243b8c62 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::qm:Fri Dec 29 15:17:45 2017:src/rdb/quorum/qm_states/qm_out_replying_out_of_quorum.cc:227 (thr_id:0x81b7bb400) ReplyingOutOfQuorumState::stateUp2ReplyingOutOfQuorum: WS_WaitingForVotes -> WS_BecomingMember 00000074.0065ec16 243b8c62 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::qm:Fri Dec 29 15:17:45 2017:src/rdb/quorum/qm_states/qm_out_out_of_quorum.cc:66 (thr_id:0x81b7bb400) OutOfQuorumState::stateUp2OutOfQuorum: WS_WaitingForVotes -> WS_BecomingMember 00000074.0065ec17 243b8c62 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::qm:Fri Dec 29 15:17:45 2017:src/rdb/quorum/qm_states/qm_state.cc:560 (thr_id:0x81b7bb400) QmState::stateTrans: WS_WaitingForVotes -> WS_BecomingMember at: 5882054s, why: poll_received 00000074.0065ec18 243b8c62 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::qm:Fri Dec 29 15:17:45 2017:src/rdb/quorum/quorumimpl.cc:1771 (thr_id:0x81b7bb400) inContactUpcall QM Upcall status: Offline ==> Secondary Epoch: 0 => 5 isFastPath 1 isFastPathOverride 0 membershipDisabled: 0 00000074.0065ec19 243b8c62 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::qm:Fri Dec 29 15:17:45 2017:src/rdb/quorum/qm_states/qm_in_becoming_secondary.cc:80 (thr_id:0x81b7bb400) BecomingSecondaryState::state2: WS_BecomingMember -> WS_QuorumMember 00000074.0065ec1a 243b8c62 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::qm:Fri Dec 29 15:17:45 2017:src/rdb/quorum/qm_states/qm_state.cc:560 (thr_id:0x81b7bb400) QmState::stateTrans: WS_BecomingMember -> WS_QuorumMember at: 5882054s, why: told_toJoinQuorum 00000074.0065ec1b 243b8c62 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::qm:Thu Sep 26 04:04:48 2019:src/rdb/quorum/quorumimpl.cc:945 (thr_id:0x81d1ea100) secondaryFailed declare secondary failed in epoch: 5, state: WS_QuorumMember (transaction manager) fastPath 0. 00000074.0065ec1c 243b8c62 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::qm:Thu Sep 26 04:04:48 2019:src/rdb/quorum/qm_states/qm_in_secondary.cc:308 (thr_id:0x81d1ea100) SecondaryState::secondaryFailed: FastPathDefault 1, Membership terminated by secondaryFailed call at: 60788231s, _failedTillTime 60788234s 00000074.0065ec1d 243b8c62 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::qm:Thu Sep 26 04:04:48 2019:src/rdb/quorum/qm_states/qm_in_quorum_member.cc:69 (thr_id:0x81d1ea100) QuorumMemberState::state2: WS_QuorumMember-> WS_Failed 00000074.0065ec1e 243b8c62 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::qm:Thu Sep 26 04:04:48 2019:src/rdb/quorum/qm_states/qm_in_secondary.cc:328 (thr_id:0x81d1ea100) SecondaryState::stateUp2Secondary: WS_QuorumMember -> WS_Failed 00000074.0065ec1f 243b8c62 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:debug:2284] upgrademgr_event_callback::database_online_callback - invoked; [ANDU_LOG at src/tables/cluster_image.cc:6583 in 'database_online_callback'] 00000074.0065ec20 243b8c62 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::qm:Thu Sep 26 04:04:48 2019:src/rdb/quorum/qm_states/qm_state.cc:309 (thr_id:0x81d1ea100) qmsPreferredCandidate_set till: 60788236s who: 1001 00000074.0065ec21 243b8c62 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::qm:Thu Sep 26 04:04:48 2019:src/rdb/quorum/qm_states/qm_in_in_quorum.cc:54 (thr_id:0x81d1ea100) InQuorumState::stateUp2InQuorum: WS_QuorumMember -> WS_Failed 00000074.0065ec22 243b8c62 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::qm:Thu Sep 26 04:04:48 2019:src/rdb/quorum/quorumimpl.cc:1824 (thr_id:0x81d1ea100) local_offlineUpcall why: secondaryFailed stateUp2InQuorum 00000074.0065ec23 243b8c62 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] upgrademgr_event_callback::run - UNIT_IS_OFFLINE; [ANDU_LOG at src/tables/cluster_image.cc:6445 in 'run'] 00000074.0065ec24 243b8c62 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::qm:Thu Sep 26 04:04:48 2019:src/rdb/quorum/quorumimpl.cc:1833 (thr_id:0x81d1ea100) local_offlineUpcall QM Upcall status: Secondary ==> Offline Epoch: 5 => 5 isFastPath 1 isFastPathOverride 0 membershipDisabled: 0 00000074.0065ec25 243b8c62 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] rdb::qm:Thu Sep 26 04:04:48 2019:src/rdb/quorum/qm_states/qm_state.cc:560 (thr_id:0x81d1ea100) QmState::stateTrans: WS_QuorumMember -> WS_Failed at: 60788231s, why: secondaryFailed 00000074.0065ec26 243b8c62 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] ******* OOQ QM mtrace dump END ********* 00000074.0065ec27 243b8c62 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] A [src/rdb/TM.cc 1721 (0x81d1e0100)]: TM 1000: change role at epoch 0 to 0x40 recovery transaction number 0 00000074.0065ec28 243b8c62 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] A [src/rdb/TM.cc 1459 (0x81d1e0100)]: TM 1000: Report UNIT_IS_OFFLINE (epoch 0, master 0). Reason: could not commit transaction: RPC failure (f_coord_commit_1: RPC: Timed out; netid=tcp fd=630 TO=30.0s TT=30.000s O=36 00000074.0065ec29 243b8c62 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] A [src/rdb/TM.cc 1464 (0x81d1e0100)]: FAILOVER rdb: Local unit Management offline 00000074.0065ec2a 243b8c62 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] Notice: online_status_callback: RDB unit is offline 00000074.0065ec2b 243b8c62 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] 0x81d1e0600: 0: INFO: RDB::callback::registrar: callback:src/rdb/rdb_online_registrar.cc:81 rdb_callbacks::ONLINE::BEGIN:: 60788239844 00000074.0065ec2c 243b8c62 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] 0x81d1e0600: 0: INFO: RDB::callback::registrar: callback:src/rdb/rdb_online_registrar.cc:106 rdb_callbacks::ONLINE::END:: 60788239845 00000074.0065ec2d 243b8c62 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] 0x81a9f1d00: 0: INFO: license_v2: onlineInitCallback: RDB online callback, status= 2 00000074.0065ec2e 243b8c62 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] 0x81a9f1d00: 0: INFO: license_v2: onlineInitCallback: RDB is offline [status= 2]. Default licenses are not created. 00000074.0065ec2f 243b8c62 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] Could not update schema validator config Reason:RDB is offline 00000074.0065ec30 243b8c62 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] Could not update default values for ontapi limits Reason:RDB is offline 00000074.0065ec31 243b8c62 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] 0x81a9f1d00: 0: INFO: nonshared_clus_online_cb: join_unjoin_work:src/cluster_setup/nonshared_clus_online_cb.cc:233 UNIT_IS_OFFLINE, ignoring callback 00000074.0065ec32 243b8c62 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] 0x81a9f1d00: 0: INFO: nonshared_clus_online_cb: eligibility_change_work:src/cluster_setup/nonshared_clus_online_cb.cc:265 UNIT_IS_OFFLINE, ignoring eligibility work callback 00000074.0065ec33 243b8c62 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] 0x81a9f1d00: 0: INFO: capability_kernel: online status callback capability_kernel status=2 00000074.0065ec34 243b8c62 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] 0x81a9f1d00: 0: NOTICE: MGWD::cluster_id: online_callback reported UNIT_IS_OFFLINE 00000074.0065ec35 243b8c62 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] A [src/rdb/TM.cc 776 (0x81d1e0100)]: Tran: auto-aborting txn TID <5,981472,981472> 'job_manager job tx loop'. 00000074.0065ec36 243b8c62 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] A [src/rdb/cluster_events.cc 78 (0x81d1e0100)]: Cluster event: node-event, epoch 0, site 1000 [local node offline: could not commit transaction: RPC failure (f_coord_commit_1: RPC: Timed out; netid=tcp fd=630 TO=30.0s TT=30.000s O=3680b I=0b ]. 00000074.0065ec37 243b8c62 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] A [src/rdb/rpcmgr.cc 581 (0x81d1ea100)]: Site 1001: successful failover to 169.254.5.219. 00000074.0065ec38 243b8c62 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] 0x81d1ea100: 86ffff0000000035: ERR: rdb_tran_glue: commit: commit failed: tid=0x81d1ea100 label='job_manager job tx loop' tranId=<5,981472> error='UNIT_OFFLINE' 00000074.0065ec39 243b8c62 Thu Sep 26 2019 04:04:48 -06:00 [kern_mgwd:info:2284] 0x81d1ea100: 86ffff0000000035: WARNING: job_manager::job_store: commit:src/job_store.cc:604 rdb_transaction: Failed to commit transaction: 55 00000074.0065ec3a 243b8c62 Thu Sep 26 2019 04:04:49 -06:00 [kern_mgwd:info:2284] 0x81a9f1d00: 0: ERR: TABLES::COPY_OFFLOAD: src/tables/copy_offload.cc:onlineEvent:503 Unit is still offline 00000074.0065ec3b 243b8c62 Thu Sep 26 2019 04:04:49 -06:00 [kern_mgwd:info:2284] Info: online_status_callback: sp user refresh - online status = 2 00000074.0065ec3c 243b8c62 Thu Sep 26 2019 04:04:49 -06:00 [kern_mgwd:info:2284] 0x81a9f1d00: 0: ERR: tables::exports_cache: online_callback:src/tables/exports_cache.cc:2273 Unit is offline 00000074.0065ec3d 243b8c62 Thu Sep 26 2019 04:04:49 -06:00 [kern_mgwd:info:2284] 0x81a9f1d00: 0: ERR: FlexCache: **************online status callback status=2********** 00000074.0065ec3e 243b8c62 Thu Sep 26 2019 04:04:49 -06:00 [kern_mgwd:info:2284] snapshot_policy: online status callback status=2 00000074.0065ec3f 243b8c62 Thu Sep 26 2019 04:04:49 -06:00 [kern_mgwd:info:2284] rebaseline_stream:Thu Sep 26 04:04:49 2019:src/tables/vserverdr/common/synthetic_method_handling.cc:76 (thr_id:0x81a9f1d00) 0x81a9f1d00: online_callback, Entry 00000074.0065ec40 243b8c62 Thu Sep 26 2019 04:04:49 -06:00 [kern_mgwd:info:2284] rebaseline_stream:Thu Sep 26 04:04:49 2019:src/tables/vserverdr/common/synthetic_method_handling.cc:76 (thr_id:0x81a9f1d00) 0x81a9f1d00: checkMasterAndSpawnThread, Entry 00000074.0065ec41 243b8c62 Thu Sep 26 2019 04:04:49 -06:00 [kern_mgwd:info:2284] rebaseline_stream:Thu Sep 26 04:04:49 2019:src/tables/vserverdr/common/synthetic_method_handling.cc:76 (thr_id:0x81a9f1d00) 0x81a9f1d00: checkMasterAndSpawnThread, No Entries in the trigger_baseline_generation RDB 00000074.0065ec42 243b8c62 Thu Sep 26 2019 04:04:49 -06:00 [kern_mgwd:info:2284] 0x81a9f1d00: 0: ERR: RBAC::login: src/tables/vs_userprofile.cc:2843 calling online_callback status 2 00000074.0065ec43 243b8c62 Thu Sep 26 2019 04:04:49 -06:00 [kern_mgwd:info:2284] 0x81a9f1d00: 0: DEBUG: function_start_end_time_log: Start online_callback: 00000074.0065ec44 243b8c62 Thu Sep 26 2019 04:04:49 -06:00 [kern_mgwd:info:2284] 0x81a9f1d00: 0: DEBUG: function_start_end_time_log: End online_callback: total elapsed time in milliseconds is 0 00000074.0065ec45 243b8c62 Thu Sep 26 2019 04:04:49 -06:00 [kern_mgwd:info:2284] 0x81a9f1d00: 0: INFO: vserverdr_failover: src/tables/vserverdr/svmdr/vserverdr_failover.cc:87 on_online_status_cb In online callback 00000074.0065ec46 243b8c62 Thu Sep 26 2019 04:04:49 -06:00 [kern_mgwd:info:2284] 0x81a9f1d00: 0: NOTICE: Tables:web: Synchronizing the web server configuration from the cluster to the nodes 00000074.0065ec47 243b8c62 Thu Sep 26 2019 04:04:49 -06:00 [kern_mgwd:info:2284] 0x81a9f1d00: 0: NOTICE: Tables:web: The web server configuration has been synchronized from the cluster to the nodes 00000074.0065ec48 243b8c62 Thu Sep 26 2019 04:04:49 -06:00 [kern_mgwd:info:2284] 0x81a9f1d00: 0: NOTICE: Tables:web: reconf_cluster_proxy_async (local): Reconfiguration is now in progress 00000074.0065ec49 243b8c62 Thu Sep 26 2019 04:04:49 -06:00 [kern_mgwd:info:2284] 0x81b6afb00: 0: NOTICE: Tables:web: Starting cluster proxy reconfig thread is_all_nodes=0 00000074.0065ec4a 243b8c62 Thu Sep 26 2019 04:04:49 -06:00 [kern_mgwd:info:2284] 0x81a9f1d00: 0: NOTICE: Tables:web: web_server_config online callback: Updating the proxy server 00000074.0065ec4b 243b8c62 Thu Sep 26 2019 04:04:49 -06:00 [kern_mgwd:info:2284] 0x81b6afb00: 0: INFO: SFO_Ready|Cluster_Apps: wait_for_apps_online (waiter: RECONF_CLUSTER_PROXY_THREAD) apps: mgwd vldb vifmgr bcomd crs, maxTime 60 sec: starting 00000074.0065ec4c 243b8c62 Thu Sep 26 2019 04:04:49 -06:00 [kern_mgwd:info:2284] 0x81a9f1d00: 0: INFO: license_v2: RDB online callback. status=2 00000074.0065ec4d 243b8c62 Thu Sep 26 2019 04:04:49 -06:00 [kern_mgwd:info:2284] 0x81b6afb00: 0: INFO: SFO_Ready|Cluster_Apps: wait_for_apps_online (RECONF_CLUSTER_PROXY_THREAD): vldb is online. Number of tries: 1. 00000074.0065ec4e 243b8c62 Thu Sep 26 2019 04:04:49 -06:00 [kern_mgwd:info:2284] 0x81b6afb00: 0: INFO: SFO_Ready|Cluster_Apps: wait_for_apps_online (RECONF_CLUSTER_PROXY_THREAD): vifmgr is online. Number of tries: 1. 00000074.0065ec4f 243b8c62 Thu Sep 26 2019 04:04:49 -06:00 [kern_mgwd:info:2284] 0x81b6afb00: 0: INFO: SFO_Ready|Cluster_Apps: wait_for_apps_online (RECONF_CLUSTER_PROXY_THREAD): vifmgr is in running state. Number of tries: 1. 00000074.0065ec50 243b8c62 Thu Sep 26 2019 04:04:49 -06:00 [kern_mgwd:info:2284] 0x81a9f1d00: 0: INFO: MGWD::NDO: Processing RDB online callback. Online status is Offline. 00000074.0065ec51 243b8c62 Thu Sep 26 2019 04:04:49 -06:00 [kern_mgwd:info:2284] 0x81a9f1d00: 0: WARNING: job_manager::job_ext: on_online_status_cb:src/job_ext.cc:512 on_online_status_cb 00000074.0065ec52 243b8c62 Thu Sep 26 2019 04:04:49 -06:00 [kern_mgwd:info:2284] 0x81a9f1d00: 0: WARNING: job_manager::job_q: on_online_status_cb:src/job_q.cc:702 on_online_status_cb 00000074.0065ec53 243b8c62 Thu Sep 26 2019 04:04:49 -06:00 [kern_mgwd:info:2284] 0x81a9f1d00: 0: WARNING: job_manager::job_sched: on_online_status_cb:src/job_sched.cc:1203 on_online_status_cb (2) 00000074.0065ec54 243b8c62 Thu Sep 26 2019 04:04:49 -06:00 [kern_mgwd:info:2284] 0x81b6afb00: 0: INFO: SFO_Ready|Cluster_Apps: wait_for_apps_online (RECONF_CLUSTER_PROXY_THREAD): bcomd is online. Number of tries: 1. 00000074.0065ec55 243b8c62 Thu Sep 26 2019 04:04:49 -06:00 [kern_mgwd:info:2284] 0x81b6afb00: 0: INFO: SFO_Ready|Cluster_Apps: wait_for_apps_online (RECONF_CLUSTER_PROXY_THREAD): crs is online. Number of tries: 1. 00000074.0065ec56 243b8c62 Thu Sep 26 2019 04:04:49 -06:00 [kern_mgwd:info:2284] A [src/rdb/quorum/quorumimpl.cc 2716 (0x81b244200)]: Received Poll from 1001 expected status: VS_M_Supporter state: WS_Failed 00000074.0065ec57 243b8c7e Thu Sep 26 2019 04:04:50 -06:00 [kern_mgwd:info:2284] A [src/rdb/quorum/quorumimpl.cc 2716 (0x81b6a7e00)]: Received Poll from 1001 expected status: VS_M_Supporter state: WS_Failed 00000074.0065ec58 243b8c7e Thu Sep 26 2019 04:04:51 -06:00 [kern_mgwd:info:2284] A [src/rdb/quorum/qm_states/qm_out_failed.cc 50 (0x81d1df700)]: FailedState::state2: WS_Failed -> WS_WaitingForVotes 00000074.0065ec59 243b8c7e Thu Sep 26 2019 04:04:51 -06:00 [kern_mgwd:info:2284] A [src/rdb/quorum/qm_states/qm_out_no_reply.cc 45 (0x81d1df700)]: NoReplyState::stateUp2NoReply: WS_Failed -> WS_WaitingForVotes 00000074.0065ec5a 243b8c7e Thu Sep 26 2019 04:04:51 -06:00 [kern_mgwd:info:2284] A [src/rdb/quorum/qm_states/qm_state.cc 306 (0x81d1df700)]: qmsPreferredCandidate_set till: 60788236s who: 1000. 00000074.0065ec5b 243b8c7e Thu Sep 26 2019 04:04:51 -06:00 [kern_mgwd:info:2284] A [src/rdb/quorum/qm_states/qm_out_out_of_quorum.cc 61 (0x81d1df700)]: OutOfQuorumState::stateUp2OutOfQuorum: WS_Failed -> WS_WaitingForVotes 00000074.0065ec5c 243b8c7e Thu Sep 26 2019 04:04:51 -06:00 [kern_mgwd:info:2284] A [src/rdb/quorum/qm_states/qm_state.cc 552 (0x81d1df700)]: stateTrans: WS_Failed -> WS_WaitingForVotes at: 60788234s 00000074.0065ec5d 243b8c7e Thu Sep 26 2019 04:04:51 -06:00 [kern_mgwd:info:2284] 0x81ccad200: 0: NOTICE: RpcConnectionCache: clearFailure: called for 169.254.5.219:536874273(rdb_management_qm)/1[tcp]{fffffffd|ffffffff} 00000074.0065ec5f 243b8c7e Thu Sep 26 2019 04:04:52 -06:00 [kern_mgwd:info:2284] dsmdb_create_imp_1() on kern_shelf_backend_table_create failed: 169.254.5.219{ffffffff|ffffffff} prog=536873508 server=kernel: RPC: Timed out; netid=tcp fd=697 TO=25.0s TT=25.001s O=308b I=0b CN=4857820/3 VSID=-3 169.254.5.219:918 00000074.0065ec60 243b8c7e Thu Sep 26 2019 04:04:52 -06:00 [kern_mgwd:info:2284] 0x81da82a00: 0: INFO: librpcpool: DispProc(DSMDB_QUERY) dispatch_time:60788193781 read_hdr:60788193781(0) read_hdr_done:60788193781(0) get_arg:60788193781(0) execute:60788193781(0) reply:60788218879(25098) reply_done:60788243786(24907) done:60788243786 delta:50005(MSEC) 00000074.0065ec61 243b8cc5 Thu Sep 26 2019 04:04:59 -06:00 [kern_mgwd:info:2284] W [src/rdb/quorum/rpccom.cc 397 (0x81ccad200)]: qmpoll_1 rpc to 1001 failed: 5: qmpoll_1: RPC: Timed out; netid=tcp fd=704 TO=8.0s TT=8.001s O=680b I=0b CN=4857832/1 VSID=-3 169.254.5.219:7816 00000074.0065ec62 243b8cc5 Thu Sep 26 2019 04:04:59 -06:00 [kern_mgwd:info:2284] qmpoll_1: RPC: Timed out; netid=tcp fd=704 TO=8.0s TT=8.001s O=680b I=0b CN=4857832/1 VSID=-3 169.254.5.219:7816 00000074.0065ec63 243b8ceb Thu Sep 26 2019 04:05:03 -06:00 [kern_mgwd:info:2284] Starting a backup of the var filesystem. 00000074.0065ec64 243b8d1f Thu Sep 26 2019 04:05:08 -06:00 [kern_mgwd:info:2284] W [src/rdb/quorum/rpccom.cc 397 (0x81ccae600)]: qmpoll_1 rpc to 1001 failed: 5: qmpoll_1: RPC: Timed out; netid=tcp fd=636 TO=8.0s TT=8.001s O=680b I=0b CN=4857833/1 VSID=-3 169.254.8.83:7816 00000074.0065ec65 243b8d1f Thu Sep 26 2019 04:05:08 -06:00 [kern_mgwd:info:2284] qmpoll_1: RPC: Timed out; netid=tcp fd=636 TO=8.0s TT=8.001s O=680b I=0b CN=4857833/1 VSID=-3 169.254.8.83:7816 00000074.0065ec66 243b8d79 Thu Sep 26 2019 04:05:17 -06:00 [kern_mgwd:info:2284] W [src/rdb/quorum/rpccom.cc 397 (0x81ccad700)]: qmpoll_1 rpc to 1001 failed: 5: qmpoll_1: RPC: Timed out; netid=tcp fd=636 TO=8.0s TT=8.000s O=680b I=0b CN=4857837/1 VSID=-3 169.254.5.219:7816 00000074.0065ec67 243b8d79 Thu Sep 26 2019 04:05:17 -06:00 [kern_mgwd:info:2284] qmpoll_1: RPC: Timed out; netid=tcp fd=636 TO=8.0s TT=8.000s O=680b I=0b CN=4857837/1 VSID=-3 169.254.5.219:7816 00000074.0065ec68 243b8dd3 Thu Sep 26 2019 04:05:26 -06:00 [kern_mgwd:info:2284] W [src/rdb/quorum/rpccom.cc 397 (0x81ccae100)]: qmpoll_1 rpc to 1001 failed: 5: qmpoll_1: RPC: Timed out; netid=tcp fd=636 TO=8.0s TT=8.001s O=680b I=0b CN=4857838/1 VSID=-3 169.254.8.83:7816 00000074.0065ec69 243b8dd3 Thu Sep 26 2019 04:05:26 -06:00 [kern_mgwd:info:2284] qmpoll_1: RPC: Timed out; netid=tcp fd=636 TO=8.0s TT=8.001s O=680b I=0b CN=4857838/1 VSID=-3 169.254.8.83:7816 00000074.0065ec6a 243b8e2d Thu Sep 26 2019 04:05:35 -06:00 [kern_mgwd:info:2284] W [src/rdb/quorum/rpccom.cc 397 (0x81ccaeb00)]: qmpoll_1 rpc to 1001 failed: 5: qmpoll_1: RPC: Timed out; netid=tcp fd=636 TO=8.0s TT=8.001s O=680b I=0b CN=4857839/1 VSID=-3 169.254.5.219:7816 00000074.0065ec6b 243b8e2d Thu Sep 26 2019 04:05:35 -06:00 [kern_mgwd:info:2284] qmpoll_1: RPC: Timed out; netid=tcp fd=636 TO=8.0s TT=8.001s O=680b I=0b CN=4857839/1 VSID=-3 169.254.5.219:7816 00000074.0065ec6c 243b8e87 Thu Sep 26 2019 04:05:44 -06:00 [kern_mgwd:info:2284] W [src/rdb/quorum/rpccom.cc 397 (0x81d1df200)]: qmpoll_1 rpc to 1001 failed: 5: qmpoll_1: RPC: Timed out; netid=tcp fd=636 TO=8.0s TT=8.001s O=680b I=0b CN=4857840/1 VSID=-3 169.254.8.83:7816 00000074.0065ec6d 243b8e87 Thu Sep 26 2019 04:05:44 -06:00 [kern_mgwd:info:2284] qmpoll_1: RPC: Timed out; netid=tcp fd=636 TO=8.0s TT=8.001s O=680b I=0b CN=4857840/1 VSID=-3 169.254.8.83:7816 00000074.0065ec6f 243b8ea4 Thu Sep 26 2019 04:05:47 -06:00 [kern_mgwd:info:2284] dsmdb_create_imp_1() on kern_shelf_backend_table_create failed: 169.254.5.219{ffffffff|ffffffff} prog=536873508 server=kernel: RPC: Timed out; netid=tcp fd=684 TO=25.0s TT=25.001s O=308b I=0b CN=4857823/31 VSID=-3 169.254.5.219:918 00000074.0065ec70 243b8eb9 Thu Sep 26 2019 04:05:49 -06:00 [kern_mgwd:info:2284] 0x81b6afb00: 0: INFO: SFO_Ready|Cluster_Apps: wait_for_apps_online (waiter: RECONF_CLUSTER_PROXY_THREAD): Finished after 30 tries. 00000074.0065ec71 243b8eb9 Thu Sep 26 2019 04:05:49 -06:00 [kern_mgwd:info:2284] 0x81b6afb00: 0: INFO: SFO_Ready|Cluster_Apps: wait_for_apps (RECONF_CLUSTER_PROXY_THREAD): mgwd up: true success, online: false. 00000074.0065ec72 243b8eb9 Thu Sep 26 2019 04:05:49 -06:00 [kern_mgwd:info:2284] 0x81b6afb00: 0: NOTICE: Tables:web: SMF DSMDB service ready 00000074.0065ec73 243b8ee1 Thu Sep 26 2019 04:05:53 -06:00 [kern_mgwd:info:2284] W [src/rdb/quorum/rpccom.cc 397 (0x81ccadc00)]: qmpoll_1 rpc to 1001 failed: 5: qmpoll_1: RPC: Timed out; netid=tcp fd=636 TO=8.0s TT=8.000s O=680b I=0b CN=4857842/1 VSID=-3 169.254.5.219:7816 00000074.0065ec74 243b8ee1 Thu Sep 26 2019 04:05:53 -06:00 [kern_mgwd:info:2284] qmpoll_1: RPC: Timed out; netid=tcp fd=636 TO=8.0s TT=8.000s O=680b I=0b CN=4857842/1 VSID=-3 169.254.5.219:7816 00000074.0065ec75 243b8f3b Thu Sep 26 2019 04:06:02 -06:00 [kern_mgwd:info:2284] W [src/rdb/quorum/rpccom.cc 397 (0x81ccad200)]: qmpoll_1 rpc to 1001 failed: 5: qmpoll_1: RPC: Timed out; netid=tcp fd=636 TO=8.0s TT=8.002s O=680b I=0b CN=4857845/1 VSID=-3 169.254.8.83:7816 00000074.0065ec76 243b8f3b Thu Sep 26 2019 04:06:02 -06:00 [kern_mgwd:info:2284] qmpoll_1: RPC: Timed out; netid=tcp fd=636 TO=8.0s TT=8.002s O=680b I=0b CN=4857845/1 VSID=-3 169.254.8.83:7816 00000074.0065ec77 243b8f9e Thu Sep 26 2019 04:06:11 -06:00 [kern_mgwd:info:2284] W [src/rdb/quorum/rpccom.cc 397 (0x81ccae600)]: qmpoll_1 rpc to 1001 failed: 5: qmpoll_1: RPC: Timed out; netid=tcp fd=636 TO=8.0s TT=8.001s O=680b I=0b CN=4857847/1 VSID=-3 169.254.5.219:7816 00000074.0065ec78 243b8f9e Thu Sep 26 2019 04:06:11 -06:00 [kern_mgwd:info:2284] qmpoll_1: RPC: Timed out; netid=tcp fd=636 TO=8.0s TT=8.001s O=680b I=0b CN=4857847/1 VSID=-3 169.254.5.219:7816 00000074.0065ec7a 243b8f9e Thu Sep 26 2019 04:06:12 -06:00 [kern_mgwd:info:2284] dsmdb_create_imp_1() on kern_shelf_backend_table_create failed: 169.254.5.219{ffffffff|ffffffff} prog=536873508 server=kernel: RPC: Timed out; netid=tcp fd=684 TO=25.0s TT=25.002s O=308b I=0b CN=4857843/1 VSID=-3 169.254.5.219:918 00000074.0065ec7b 243b8fb3 Thu Sep 26 2019 04:06:14 -06:00 [kern_mgwd:info:2284] dsmdb_get_imp_1() on cluster_ring failed: 169.254.5.219{fffffffd|ffffffff} prog=536873488 server=mgwd: RPC: Timed out; netid=tcp fd=686 TO=25.0s TT=25.001s O=360b I=0b CN=4802995/32433 VSID=-3 169.254.5.219:910 00000074.0065ec7c 243b8fb3 Thu Sep 26 2019 04:06:14 -06:00 [kern_mgwd:info:2284] 0x81b6ad300: 0: ERR: Tables:web: web_proxy_cluster_lifs: Failed to query the mgmt RDB status on node nmg-fas8040-02: Timeout: Operation "cluster_ring_iterator::get_imp()" took longer than 25 seconds to complete [from mgwd on node "nmg-fas8040-01" (VSID: -3) to mgwd at 169.254.5.219] 00000074.0065ec7d 243b8fef Thu Sep 26 2019 04:06:20 -06:00 [kern_mgwd:info:2284] W [src/rdb/quorum/rpccom.cc 397 (0x81ccad700)]: qmpoll_1 rpc to 1001 failed: 5: qmpoll_1: RPC: Timed out; netid=tcp fd=636 TO=8.0s TT=8.001s O=680b I=0b CN=4857849/1 VSID=-3 169.254.8.83:7816 00000074.0065ec7e 243b8fef Thu Sep 26 2019 04:06:20 -06:00 [kern_mgwd:info:2284] qmpoll_1: RPC: Timed out; netid=tcp fd=636 TO=8.0s TT=8.001s O=680b I=0b CN=4857849/1 VSID=-3 169.254.8.83:7816 00000074.0065ec7f 243b9049 Thu Sep 26 2019 04:06:29 -06:00 [kern_mgwd:info:2284] W [src/rdb/quorum/rpccom.cc 397 (0x81ccae100)]: qmpoll_1 rpc to 1001 failed: 5: qmpoll_1: RPC: Timed out; netid=tcp fd=692 TO=8.0s TT=8.001s O=680b I=0b CN=4857852/1 VSID=-3 169.254.5.219:7816 00000074.0065ec80 243b9049 Thu Sep 26 2019 04:06:29 -06:00 [kern_mgwd:info:2284] qmpoll_1: RPC: Timed out; netid=tcp fd=692 TO=8.0s TT=8.001s O=680b I=0b CN=4857852/1 VSID=-3 169.254.5.219:7816 00000074.0065ec81 243b90a3 Thu Sep 26 2019 04:06:38 -06:00 [kern_mgwd:info:2284] W [src/rdb/quorum/rpccom.cc 397 (0x81ccaeb00)]: qmpoll_1 rpc to 1001 failed: 5: qmpoll_1: RPC: Timed out; netid=tcp fd=692 TO=8.0s TT=8.001s O=680b I=0b CN=4857853/1 VSID=-3 169.254.8.83:7816 00000074.0065ec82 243b90a3 Thu Sep 26 2019 04:06:38 -06:00 [kern_mgwd:info:2284] qmpoll_1: RPC: Timed out; netid=tcp fd=692 TO=8.0s TT=8.001s O=680b I=0b CN=4857853/1 VSID=-3 169.254.8.83:7816 00000074.0065ec83 243b90ae Thu Sep 26 2019 04:06:39 -06:00 [kern_mgwd:info:2284] dsmdb_get_imp_1() on cluster_ring failed: 169.254.5.219{fffffffd|ffffffff} prog=536873488 server=mgwd: RPC: Timed out; netid=tcp fd=685 TO=25.0s TT=25.001s O=360b I=0b CN=4857846/5 VSID=-3 169.254.5.219:910 00000074.0065ec84 243b90ae Thu Sep 26 2019 04:06:39 -06:00 [kern_mgwd:info:2284] 0x81da83400: 0: ERR: Tables:web: web_proxy_cluster_lifs: Failed to query the vifmgr RDB status on node nmg-fas8040-02: Timeout: Operation "cluster_ring_iterator::get_imp()" took longer than 25 seconds to complete [from mgwd on node "nmg-fas8040-01" (VSID: -3) to mgwd at 169.254.5.219] 00000074.0065ec85 243b90ae Thu Sep 26 2019 04:06:39 -06:00 [kern_mgwd:info:2284] 0x81b6afb00: 0: NOTICE: Tables:web: Updated the proxy server on node nmg-fas8040-01 00000074.0065ec86 243b90ae Thu Sep 26 2019 04:06:39 -06:00 [kern_mgwd:info:2284] 0x81b6afb00: 0: NOTICE: Tables:web: Completed cluster proxy reconfig thread 00000074.0065ec87 243b90e9 Thu Sep 26 2019 04:06:45 -06:00 [kern_mgwd:info:2284] dsmdb_next_imp_1() on mgwd_cdb_vifs_view failed: 169.254.5.219{fffffffd|ffffffff} prog=536873488 server=mgwd: RPC: Timed out; netid=tcp fd=688 TO=25.0s TT=25.000s O=560b I=0b CN=4857851/1 VSID=-3 169.254.5.219:910 00000074.0065ec88 243b90e9 Thu Sep 26 2019 04:06:45 -06:00 [kern_mgwd:info:2284] 0x81b6aec00: 0: ERR: smf::DsmdbClient: Query Request Timedout Trying simple next for mgwd_cdb_vifs_view 00000074.0065ec89 243b90fd Thu Sep 26 2019 04:06:47 -06:00 [kern_mgwd:info:2284] W [src/rdb/quorum/rpccom.cc 397 (0x81d1df200)]: qmpoll_1 rpc to 1001 failed: 5: qmpoll_1: RPC: Timed out; netid=tcp fd=40 TO=8.0s TT=8.001s O=680b I=0b CN=4857855/1 VSID=-3 169.254.5.219:7816 00000074.0065ec8a 243b90fd Thu Sep 26 2019 04:06:47 -06:00 [kern_mgwd:info:2284] qmpoll_1: RPC: Timed out; netid=tcp fd=40 TO=8.0s TT=8.001s O=680b I=0b CN=4857855/1 VSID=-3 169.254.5.219:7816 00000074.0065ec8b 243b9157 Thu Sep 26 2019 04:06:56 -06:00 [kern_mgwd:info:2284] W [src/rdb/quorum/rpccom.cc 397 (0x81ccadc00)]: qmpoll_1 rpc to 1001 failed: 5: qmpoll_1: RPC: Timed out; netid=tcp fd=40 TO=8.0s TT=8.001s O=680b I=0b CN=4857857/1 VSID=-3 169.254.8.83:7816 00000074.0065ec8c 243b9157 Thu Sep 26 2019 04:06:56 -06:00 [kern_mgwd:info:2284] qmpoll_1: RPC: Timed out; netid=tcp fd=40 TO=8.0s TT=8.001s O=680b I=0b CN=4857857/1 VSID=-3 169.254.8.83:7816 00000074.0065ec8d 243b91b1 Thu Sep 26 2019 04:07:05 -06:00 [kern_mgwd:info:2284] W [src/rdb/quorum/rpccom.cc 397 (0x81ccad200)]: qmpoll_1 rpc to 1001 failed: 5: qmpoll_1: RPC: Timed out; netid=tcp fd=40 TO=8.0s TT=8.001s O=680b I=0b CN=4857860/1 VSID=-3 169.254.5.219:7816 00000074.0065ec8e 243b91b1 Thu Sep 26 2019 04:07:05 -06:00 [kern_mgwd:info:2284] qmpoll_1: RPC: Timed out; netid=tcp fd=40 TO=8.0s TT=8.001s O=680b I=0b CN=4857860/1 VSID=-3 169.254.5.219:7816 00000074.0065ec90 243b91c4 Thu Sep 26 2019 04:07:07 -06:00 [kern_mgwd:info:2284] dsmdb_create_imp_1() on kern_shelf_backend_table_create failed: 169.254.5.219{ffffffff|ffffffff} prog=536873508 server=kernel: RPC: Timed out; netid=tcp fd=697 TO=25.0s TT=25.000s O=308b I=0b CN=4857844/21 VSID=-3 169.254.5.219:918 00000074.0065ec91 243b91e3 Thu Sep 26 2019 04:07:10 -06:00 [kern_mgwd:info:2284] dsmdb_next_imp_1() on mgwd_cdb_vifs_view failed: 169.254.5.219{fffffffd|ffffffff} prog=536873488 server=mgwd: RPC: Timed out; netid=tcp fd=685 TO=25.0s TT=25.000s O=312b I=0b CN=4857856/1 VSID=-3 169.254.5.219:910 00000074.0065ec92 243b91e3 Thu Sep 26 2019 04:07:10 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. Timeout: Operation "mgwd_cdb_vifs_view_iterator::next()" took longer than 25 seconds to complete [from mgwd on node "nmg-fas8040-01" (VSID: -3) to mgwd at 169.254.5.219] 00000074.0065ec93 243b91e3 Thu Sep 26 2019 04:07:10 -06:00 [kern_mgwd:info:2284] 0x81b6aec00: 0: ERR: RPCServer: get_vifid_from_ipaddr: src/mgwd_get_blade_info_data.cc:56 cannot query vifid for IP addr 169.254.5.219, error Timeout: Operation "mgwd_cdb_vifs_view_iterator::next()" took longer than 25 seconds to complete [from mgwd on node "nmg-fas8040-01" (VSID: -3) to mgwd at 169.254.5.219]. 00000074.0065ec94 243b91e3 Thu Sep 26 2019 04:07:10 -06:00 [kern_mgwd:info:2284] 0x81b6aec00: 0: ERR: RPCServer: mgwd_get_blade_info_1_svc: src/mgwd_get_blade_info_data.cc:199 failed to query vifid from vifmgr. Skipping vifid based sort 00000074.0065ec95 243b920b Thu Sep 26 2019 04:07:14 -06:00 [kern_mgwd:info:2284] W [src/rdb/quorum/rpccom.cc 397 (0x81ccae600)]: qmpoll_1 rpc to 1001 failed: 5: qmpoll_1: RPC: Timed out; netid=tcp fd=40 TO=8.0s TT=8.000s O=680b I=0b CN=4857862/1 VSID=-3 169.254.8.83:7816 00000074.0065ec96 243b920b Thu Sep 26 2019 04:07:14 -06:00 [kern_mgwd:info:2284] qmpoll_1: RPC: Timed out; netid=tcp fd=40 TO=8.0s TT=8.000s O=680b I=0b CN=4857862/1 VSID=-3 169.254.8.83:7816 00000074.0065ec97 243b9265 Thu Sep 26 2019 04:07:23 -06:00 [kern_mgwd:info:2284] W [src/rdb/quorum/rpccom.cc 397 (0x81ccad700)]: qmpoll_1 rpc to 1001 failed: 5: qmpoll_1: RPC: Timed out; netid=tcp fd=40 TO=8.0s TT=8.000s O=680b I=0b CN=4857866/1 VSID=-3 169.254.5.219:7816 00000074.0065ec98 243b9265 Thu Sep 26 2019 04:07:23 -06:00 [kern_mgwd:info:2284] qmpoll_1: RPC: Timed out; netid=tcp fd=40 TO=8.0s TT=8.000s O=680b I=0b CN=4857866/1 VSID=-3 169.254.5.219:7816 00000074.0065ec99 243b9280 Thu Sep 26 2019 04:07:25 -06:00 [kern_mgwd:info:2284] dsmdb_get_imp_1() on node failed: 169.254.5.219{ffffffff|ffffffff} prog=536873488 server=mgwd: RPC: Timed out; netid=tcp fd=695 TO=25.0s TT=25.001s O=828b I=0b CN=4857861/1 VSID=-3 169.254.5.219:910 00000074.0065ec9a 243b9280 Thu Sep 26 2019 04:07:25 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. Timeout: Operation "node_iterator::get_imp()" took longer than 25 seconds to complete [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065ec9c 243b92bf Thu Sep 26 2019 04:07:32 -06:00 [kern_mgwd:info:2284] dsmdb_create_imp_1() on kern_shelf_backend_table_create failed: 169.254.5.219{ffffffff|ffffffff} prog=536873508 server=kernel: RPC: Timed out; netid=tcp fd=701 TO=25.0s TT=25.000s O=308b I=0b CN=4857863/1 VSID=-3 169.254.5.219:918 00000074.0065ec9d 243b92bf Thu Sep 26 2019 04:07:32 -06:00 [kern_mgwd:info:2284] W [src/rdb/quorum/rpccom.cc 397 (0x81ccae100)]: qmpoll_1 rpc to 1001 failed: 5: qmpoll_1: RPC: Timed out; netid=tcp fd=40 TO=8.0s TT=8.001s O=680b I=0b CN=4857868/1 VSID=-3 169.254.8.83:7816 00000074.0065ec9e 243b92bf Thu Sep 26 2019 04:07:32 -06:00 [kern_mgwd:info:2284] qmpoll_1: RPC: Timed out; netid=tcp fd=40 TO=8.0s TT=8.001s O=680b I=0b CN=4857868/1 VSID=-3 169.254.8.83:7816 00000074.0065ec9f 243b9319 Thu Sep 26 2019 04:07:41 -06:00 [kern_mgwd:info:2284] W [src/rdb/quorum/rpccom.cc 397 (0x81ccaeb00)]: qmpoll_1 rpc to 1001 failed: 5: qmpoll_1: RPC: Timed out; netid=tcp fd=40 TO=8.0s TT=8.000s O=680b I=0b CN=4857870/1 VSID=-3 169.254.5.219:7816 00000074.0065eca0 243b9319 Thu Sep 26 2019 04:07:41 -06:00 [kern_mgwd:info:2284] qmpoll_1: RPC: Timed out; netid=tcp fd=40 TO=8.0s TT=8.000s O=680b I=0b CN=4857870/1 VSID=-3 169.254.5.219:7816 00000074.0065eca1 243b9373 Thu Sep 26 2019 04:07:50 -06:00 [kern_mgwd:info:2284] W [src/rdb/quorum/rpccom.cc 397 (0x81d1df200)]: qmpoll_1 rpc to 1001 failed: 5: qmpoll_1: RPC: Timed out; netid=tcp fd=40 TO=8.0s TT=8.001s O=680b I=0b CN=4857872/1 VSID=-3 169.254.8.83:7816 00000074.0065eca2 243b9373 Thu Sep 26 2019 04:07:50 -06:00 [kern_mgwd:info:2284] qmpoll_1: RPC: Timed out; netid=tcp fd=40 TO=8.0s TT=8.001s O=680b I=0b CN=4857872/1 VSID=-3 169.254.8.83:7816 00000074.0065eca3 243b93cd Thu Sep 26 2019 04:07:59 -06:00 [kern_mgwd:info:2284] W [src/rdb/quorum/rpccom.cc 397 (0x81ccadc00)]: qmpoll_1 rpc to 1001 failed: 5: qmpoll_1: RPC: Timed out; netid=tcp fd=40 TO=8.0s TT=8.001s O=680b I=0b CN=4857873/1 VSID=-3 169.254.5.219:7816 00000074.0065eca4 243b93cd Thu Sep 26 2019 04:07:59 -06:00 [kern_mgwd:info:2284] qmpoll_1: RPC: Timed out; netid=tcp fd=40 TO=8.0s TT=8.001s O=680b I=0b CN=4857873/1 VSID=-3 169.254.5.219:7816 00000074.0065eca5 243b9427 Thu Sep 26 2019 04:08:08 -06:00 [kern_mgwd:info:2284] W [src/rdb/quorum/rpccom.cc 397 (0x81ccad200)]: qmpoll_1 rpc to 1001 failed: 5: qmpoll_1: RPC: Timed out; netid=tcp fd=40 TO=8.0s TT=8.000s O=680b I=0b CN=4857874/1 VSID=-3 169.254.8.83:7816 00000074.0065eca6 243b9427 Thu Sep 26 2019 04:08:08 -06:00 [kern_mgwd:info:2284] qmpoll_1: RPC: Timed out; netid=tcp fd=40 TO=8.0s TT=8.000s O=680b I=0b CN=4857874/1 VSID=-3 169.254.8.83:7816 00000074.0065eca7 243b948b Thu Sep 26 2019 04:08:17 -06:00 [kern_mgwd:info:2284] W [src/rdb/quorum/rpccom.cc 397 (0x81ccae600)]: qmpoll_1 rpc to 1001 failed: 5: qmpoll_1: RPC: Timed out; netid=tcp fd=40 TO=8.0s TT=8.000s O=680b I=0b CN=4857876/1 VSID=-3 169.254.5.219:7816 00000074.0065eca8 243b948b Thu Sep 26 2019 04:08:17 -06:00 [kern_mgwd:info:2284] qmpoll_1: RPC: Timed out; netid=tcp fd=40 TO=8.0s TT=8.000s O=680b I=0b CN=4857876/1 VSID=-3 169.254.5.219:7816 00000074.0065ecab 243b94db Thu Sep 26 2019 04:08:25 -06:00 [kern_mgwd:info:2284] dsmdb_get_imp_1() on node failed: 169.254.5.219{ffffffff|ffffffff} prog=536873488 server=mgwd: RPC: Timed out; netid=tcp fd=693 TO=25.0s TT=25.001s O=828b I=0b CN=4857875/1 VSID=-3 169.254.5.219:910 00000074.0065ecac 243b94db Thu Sep 26 2019 04:08:25 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. Timeout: Operation "node_iterator::get_imp()" took longer than 25 seconds to complete [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065ecad 243b94db Thu Sep 26 2019 04:08:26 -06:00 [kern_mgwd:info:2284] W [src/rdb/quorum/rpccom.cc 397 (0x81ccad700)]: qmpoll_1 rpc to 1001 failed: 5: qmpoll_1: RPC: Timed out; netid=tcp fd=701 TO=8.0s TT=8.001s O=680b I=0b CN=4857880/1 VSID=-3 169.254.8.83:7816 00000074.0065ecae 243b94db Thu Sep 26 2019 04:08:26 -06:00 [kern_mgwd:info:2284] qmpoll_1: RPC: Timed out; netid=tcp fd=701 TO=8.0s TT=8.001s O=680b I=0b CN=4857880/1 VSID=-3 169.254.8.83:7816 00000074.0065ecaf 243b9535 Thu Sep 26 2019 04:08:35 -06:00 [kern_mgwd:info:2284] W [src/rdb/quorum/rpccom.cc 397 (0x81ccae100)]: qmpoll_1 rpc to 1001 failed: 5: qmpoll_1: RPC: Timed out; netid=tcp fd=684 TO=8.0s TT=8.001s O=680b I=0b CN=4857881/1 VSID=-3 169.254.5.219:7816 00000074.0065ecb0 243b9535 Thu Sep 26 2019 04:08:35 -06:00 [kern_mgwd:info:2284] qmpoll_1: RPC: Timed out; netid=tcp fd=684 TO=8.0s TT=8.001s O=680b I=0b CN=4857881/1 VSID=-3 169.254.5.219:7816 00000074.0065ecb1 243b958f Thu Sep 26 2019 04:08:44 -06:00 [kern_mgwd:info:2284] W [src/rdb/quorum/rpccom.cc 397 (0x81ccaeb00)]: qmpoll_1 rpc to 1001 failed: 5: qmpoll_1: RPC: Timed out; netid=tcp fd=684 TO=8.0s TT=8.001s O=680b I=0b CN=4857882/1 VSID=-3 169.254.8.83:7816 00000074.0065ecb2 243b958f Thu Sep 26 2019 04:08:44 -06:00 [kern_mgwd:info:2284] qmpoll_1: RPC: Timed out; netid=tcp fd=684 TO=8.0s TT=8.001s O=680b I=0b CN=4857882/1 VSID=-3 169.254.8.83:7816 00000074.0065ecb3 243b95e9 Thu Sep 26 2019 04:08:53 -06:00 [kern_mgwd:info:2284] W [src/rdb/quorum/rpccom.cc 397 (0x81d1df200)]: qmpoll_1 rpc to 1001 failed: 5: qmpoll_1: RPC: Timed out; netid=tcp fd=684 TO=8.0s TT=8.001s O=680b I=0b CN=4857884/1 VSID=-3 169.254.5.219:7816 00000074.0065ecb4 243b95e9 Thu Sep 26 2019 04:08:53 -06:00 [kern_mgwd:info:2284] qmpoll_1: RPC: Timed out; netid=tcp fd=684 TO=8.0s TT=8.001s O=680b I=0b CN=4857884/1 VSID=-3 169.254.5.219:7816 00000074.0065ecb5 243b9643 Thu Sep 26 2019 04:09:02 -06:00 [kern_mgwd:info:2284] W [src/rdb/quorum/rpccom.cc 397 (0x81ccadc00)]: qmpoll_1 rpc to 1001 failed: 5: qmpoll_1: RPC: Timed out; netid=tcp fd=633 TO=8.0s TT=8.001s O=680b I=0b CN=4857885/1 VSID=-3 169.254.8.83:7816 00000074.0065ecb6 243b9643 Thu Sep 26 2019 04:09:02 -06:00 [kern_mgwd:info:2284] qmpoll_1: RPC: Timed out; netid=tcp fd=633 TO=8.0s TT=8.001s O=680b I=0b CN=4857885/1 VSID=-3 169.254.8.83:7816 00000074.0065ecb8 243b969d Thu Sep 26 2019 04:09:11 -06:00 [kern_mgwd:info:2284] W [src/rdb/quorum/rpccom.cc 397 (0x81ccad200)]: qmpoll_1 rpc to 1001 failed: 5: qmpoll_1: RPC: Timed out; netid=tcp fd=633 TO=8.0s TT=8.000s O=680b I=0b CN=4857887/1 VSID=-3 169.254.5.219:7816 00000074.0065ecb9 243b969d Thu Sep 26 2019 04:09:11 -06:00 [kern_mgwd:info:2284] qmpoll_1: RPC: Timed out; netid=tcp fd=633 TO=8.0s TT=8.000s O=680b I=0b CN=4857887/1 VSID=-3 169.254.5.219:7816 00000074.0065ecba 243b96f7 Thu Sep 26 2019 04:09:20 -06:00 [kern_mgwd:info:2284] W [src/rdb/quorum/rpccom.cc 397 (0x81ccae600)]: qmpoll_1 rpc to 1001 failed: 5: qmpoll_1: RPC: Timed out; netid=tcp fd=633 TO=8.0s TT=8.000s O=680b I=0b CN=4857888/1 VSID=-3 169.254.8.83:7816 00000074.0065ecbb 243b96f7 Thu Sep 26 2019 04:09:20 -06:00 [kern_mgwd:info:2284] qmpoll_1: RPC: Timed out; netid=tcp fd=633 TO=8.0s TT=8.000s O=680b I=0b CN=4857888/1 VSID=-3 169.254.8.83:7816 00000074.0065ecbc 243b9730 Thu Sep 26 2019 04:09:25 -06:00 [kern_mgwd:info:2284] dsmdb_get_imp_1() on node failed: 169.254.5.219{ffffffff|ffffffff} prog=536873488 server=mgwd: RPC: Timed out; netid=tcp fd=685 TO=25.0s TT=25.000s O=828b I=0b CN=4857886/1 VSID=-3 169.254.5.219:910 00000074.0065ecbd 243b9730 Thu Sep 26 2019 04:09:25 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. Timeout: Operation "node_iterator::get_imp()" took longer than 25 seconds to complete [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065ecbe 243b9751 Thu Sep 26 2019 04:09:29 -06:00 [kern_mgwd:info:2284] W [src/rdb/quorum/rpccom.cc 397 (0x81ccad700)]: qmpoll_1 rpc to 1001 failed: 5: qmpoll_1: RPC: Timed out; netid=tcp fd=633 TO=8.0s TT=8.000s O=680b I=0b CN=4857890/1 VSID=-3 169.254.5.219:7816 00000074.0065ecbf 243b9751 Thu Sep 26 2019 04:09:29 -06:00 [kern_mgwd:info:2284] qmpoll_1: RPC: Timed out; netid=tcp fd=633 TO=8.0s TT=8.000s O=680b I=0b CN=4857890/1 VSID=-3 169.254.5.219:7816 00000074.0065ecc0 243b97ab Thu Sep 26 2019 04:09:38 -06:00 [kern_mgwd:info:2284] W [src/rdb/quorum/rpccom.cc 397 (0x81ccaeb00)]: qmpoll_1 rpc to 1001 failed: 5: qmpoll_1: RPC: Timed out; netid=tcp fd=40 TO=8.0s TT=8.001s O=680b I=0b CN=4857891/1 VSID=-3 169.254.8.83:7816 00000074.0065ecc1 243b97ac Thu Sep 26 2019 04:09:38 -06:00 [kern_mgwd:info:2284] qmpoll_1: RPC: Timed out; netid=tcp fd=40 TO=8.0s TT=8.001s O=680b I=0b CN=4857891/1 VSID=-3 169.254.8.83:7816 00000074.0065ecc2 243b980f Thu Sep 26 2019 04:09:47 -06:00 [kern_mgwd:info:2284] W [src/rdb/quorum/rpccom.cc 397 (0x81ccae100)]: qmpoll_1 rpc to 1001 failed: 5: qmpoll_1: RPC: Timed out; netid=tcp fd=40 TO=8.0s TT=8.001s O=680b I=0b CN=4857893/1 VSID=-3 169.254.5.219:7816 00000074.0065ecc3 243b980f Thu Sep 26 2019 04:09:47 -06:00 [kern_mgwd:info:2284] qmpoll_1: RPC: Timed out; netid=tcp fd=40 TO=8.0s TT=8.001s O=680b I=0b CN=4857893/1 VSID=-3 169.254.5.219:7816 00000074.0065ecc4 243b980f Thu Sep 26 2019 04:09:48 -06:00 [kern_mgwd:info:2284] 0x81d1ea100: 86ffff0000000035: WARNING: job_manager::job_store: run:src/job_store_support.cc:568 Job Mgr: rdb_transaction history: Timeout/0 Timeout/330 Timeout/637 00000074.0065ecc5 243b980f Thu Sep 26 2019 04:09:48 -06:00 [kern_mgwd:info:2284] 0x81d1ea100: 86ffff0000000035: ERR: rdb_tran_glue: create: tid=0x81d1ea100 failed to create transaction for label='job_manager job tx loop': UNIT_OFFLINE 00000074.0065ecc6 243b980f Thu Sep 26 2019 04:09:48 -06:00 [kern_mgwd:info:2284] 0x81d1ea100: 86ffff0000000035: ERR: job_manager::rdb_util: create_rw_transaction:src/job_rec_int.cc:643 create_rw_transaction(job_manager job tx loop): Failed to get transaction. Node "nmg-fas8040-01" on ring "Management" is offline. Check the health of the cluster using the "cluster show" command. For further assistance, contact technical support. (393271) 00000074.0065ecc7 243b980f Thu Sep 26 2019 04:09:48 -06:00 [kern_mgwd:info:2284] 0x81d1ea100: 86ffff0000000035: WARNING: job_manager::job_store: flush_caches:src/job_store_support.cc:428 rdb_transaction: flush_caches discarded as job_manager is_waiting_for_online_cb 00000074.0065ecc8 243b9860 Thu Sep 26 2019 04:09:56 -06:00 [kern_mgwd:info:2284] W [src/rdb/quorum/rpccom.cc 397 (0x81d1df200)]: qmpoll_1 rpc to 1001 failed: 5: qmpoll_1: RPC: Timed out; netid=tcp fd=40 TO=8.0s TT=8.001s O=680b I=0b CN=4857895/1 VSID=-3 169.254.8.83:7816 00000074.0065ecc9 243b9860 Thu Sep 26 2019 04:09:56 -06:00 [kern_mgwd:info:2284] qmpoll_1: RPC: Timed out; netid=tcp fd=40 TO=8.0s TT=8.001s O=680b I=0b CN=4857895/1 VSID=-3 169.254.8.83:7816 00000074.0065ecca 243b98ba Thu Sep 26 2019 04:10:05 -06:00 [kern_mgwd:info:2284] W [src/rdb/quorum/rpccom.cc 397 (0x81ccadc00)]: qmpoll_1 rpc to 1001 failed: 5: qmpoll_1: RPC: Timed out; netid=tcp fd=40 TO=8.0s TT=8.001s O=680b I=0b CN=4857896/1 VSID=-3 169.254.5.219:7816 00000074.0065eccb 243b98ba Thu Sep 26 2019 04:10:05 -06:00 [kern_mgwd:info:2284] qmpoll_1: RPC: Timed out; netid=tcp fd=40 TO=8.0s TT=8.001s O=680b I=0b CN=4857896/1 VSID=-3 169.254.5.219:7816 00000074.0065eccc 243b9914 Thu Sep 26 2019 04:10:14 -06:00 [kern_mgwd:info:2284] W [src/rdb/quorum/rpccom.cc 397 (0x81ccad200)]: qmpoll_1 rpc to 1001 failed: 5: qmpoll_1: RPC: Timed out; netid=tcp fd=40 TO=8.0s TT=8.001s O=680b I=0b CN=4857898/1 VSID=-3 169.254.8.83:7816 00000074.0065eccd 243b9914 Thu Sep 26 2019 04:10:14 -06:00 [kern_mgwd:info:2284] qmpoll_1: RPC: Timed out; netid=tcp fd=40 TO=8.0s TT=8.001s O=680b I=0b CN=4857898/1 VSID=-3 169.254.8.83:7816 00000074.0065ecd0 243b996e Thu Sep 26 2019 04:10:23 -06:00 [kern_mgwd:info:2284] W [src/rdb/quorum/rpccom.cc 397 (0x81ccae600)]: qmpoll_1 rpc to 1001 failed: 5: qmpoll_1: RPC: Timed out; netid=tcp fd=40 TO=8.0s TT=8.001s O=680b I=0b CN=4857899/1 VSID=-3 169.254.5.219:7816 00000074.0065ecd1 243b996e Thu Sep 26 2019 04:10:23 -06:00 [kern_mgwd:info:2284] qmpoll_1: RPC: Timed out; netid=tcp fd=40 TO=8.0s TT=8.001s O=680b I=0b CN=4857899/1 VSID=-3 169.254.5.219:7816 00000074.0065ecd2 243b9988 Thu Sep 26 2019 04:10:25 -06:00 [kern_mgwd:info:2284] dsmdb_get_imp_1() on node failed: 169.254.5.219{ffffffff|ffffffff} prog=536873488 server=mgwd: RPC: Timed out; netid=tcp fd=686 TO=25.0s TT=25.001s O=828b I=0b CN=4857897/1 VSID=-3 169.254.5.219:910 00000074.0065ecd3 243b9988 Thu Sep 26 2019 04:10:25 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. Timeout: Operation "node_iterator::get_imp()" took longer than 25 seconds to complete [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065ecd4 243b99c8 Thu Sep 26 2019 04:10:32 -06:00 [kern_mgwd:info:2284] W [src/rdb/quorum/rpccom.cc 397 (0x81ccad700)]: qmpoll_1 rpc to 1001 failed: 5: qmpoll_1: RPC: Timed out; netid=tcp fd=40 TO=8.0s TT=8.000s O=680b I=0b CN=4857901/1 VSID=-3 169.254.8.83:7816 00000074.0065ecd5 243b99c8 Thu Sep 26 2019 04:10:32 -06:00 [kern_mgwd:info:2284] qmpoll_1: RPC: Timed out; netid=tcp fd=40 TO=8.0s TT=8.000s O=680b I=0b CN=4857901/1 VSID=-3 169.254.8.83:7816 00000074.0065ecd9 243b9a22 Thu Sep 26 2019 04:10:41 -06:00 [kern_mgwd:info:2284] W [src/rdb/quorum/rpccom.cc 397 (0x81ccaeb00)]: qmpoll_1 rpc to 1001 failed: 5: qmpoll_1: RPC: Timed out; netid=tcp fd=686 TO=8.0s TT=8.001s O=680b I=0b CN=4857903/1 VSID=-3 169.254.5.219:7816 00000074.0065ecda 243b9a22 Thu Sep 26 2019 04:10:41 -06:00 [kern_mgwd:info:2284] qmpoll_1: RPC: Timed out; netid=tcp fd=686 TO=8.0s TT=8.001s O=680b I=0b CN=4857903/1 VSID=-3 169.254.5.219:7816 00000074.0065ecdd 243b9a7c Thu Sep 26 2019 04:10:50 -06:00 [kern_mgwd:info:2284] W [src/rdb/quorum/rpccom.cc 397 (0x81ccae100)]: qmpoll_1 rpc to 1001 failed: 5: qmpoll_1: RPC: Timed out; netid=tcp fd=636 TO=8.0s TT=8.001s O=680b I=0b CN=4857904/1 VSID=-3 169.254.8.83:7816 00000074.0065ecde 243b9a7c Thu Sep 26 2019 04:10:50 -06:00 [kern_mgwd:info:2284] qmpoll_1: RPC: Timed out; netid=tcp fd=636 TO=8.0s TT=8.001s O=680b I=0b CN=4857904/1 VSID=-3 169.254.8.83:7816 00000074.0065ece1 243b9ad6 Thu Sep 26 2019 04:10:59 -06:00 [kern_mgwd:info:2284] W [src/rdb/quorum/rpccom.cc 397 (0x81d1df200)]: qmpoll_1 rpc to 1001 failed: 5: qmpoll_1: RPC: Timed out; netid=tcp fd=636 TO=8.0s TT=8.001s O=680b I=0b CN=4857906/1 VSID=-3 169.254.5.219:7816 00000074.0065ece2 243b9ad6 Thu Sep 26 2019 04:10:59 -06:00 [kern_mgwd:info:2284] qmpoll_1: RPC: Timed out; netid=tcp fd=636 TO=8.0s TT=8.001s O=680b I=0b CN=4857906/1 VSID=-3 169.254.5.219:7816 00000074.0065ece5 243b9b32 Thu Sep 26 2019 04:11:08 -06:00 [kern_mgwd:info:2284] W [src/rdb/quorum/rpccom.cc 397 (0x81ccadc00)]: qmpoll_1 rpc to 1001 failed: 5: qmpoll_1: RPC: Timed out; netid=tcp fd=636 TO=8.0s TT=8.001s O=680b I=0b CN=4857907/1 VSID=-3 169.254.8.83:7816 00000074.0065ece6 243b9b32 Thu Sep 26 2019 04:11:08 -06:00 [kern_mgwd:info:2284] qmpoll_1: RPC: Timed out; netid=tcp fd=636 TO=8.0s TT=8.001s O=680b I=0b CN=4857907/1 VSID=-3 169.254.8.83:7816 00000074.0065ecea 243b9b8a Thu Sep 26 2019 04:11:17 -06:00 [kern_mgwd:info:2284] W [src/rdb/quorum/rpccom.cc 397 (0x81ccad200)]: qmpoll_1 rpc to 1001 failed: 5: qmpoll_1: RPC: Timed out; netid=tcp fd=636 TO=8.0s TT=8.001s O=680b I=0b CN=4857909/1 VSID=-3 169.254.5.219:7816 00000074.0065eceb 243b9b8a Thu Sep 26 2019 04:11:17 -06:00 [kern_mgwd:info:2284] qmpoll_1: RPC: Timed out; netid=tcp fd=636 TO=8.0s TT=8.001s O=680b I=0b CN=4857909/1 VSID=-3 169.254.5.219:7816 00000074.0065ecee 243b9be4 Thu Sep 26 2019 04:11:25 -06:00 [kern_mgwd:info:2284] dsmdb_get_imp_1() on node failed: 169.254.5.219{ffffffff|ffffffff} prog=536873488 server=mgwd: RPC: Timed out; netid=tcp fd=686 TO=25.0s TT=25.000s O=828b I=0b CN=4857908/1 VSID=-3 169.254.5.219:910 00000074.0065ecef 243b9be4 Thu Sep 26 2019 04:11:25 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. Timeout: Operation "node_iterator::get_imp()" took longer than 25 seconds to complete [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065ecf0 243b9be4 Thu Sep 26 2019 04:11:26 -06:00 [kern_mgwd:info:2284] W [src/rdb/quorum/rpccom.cc 397 (0x81ccae600)]: qmpoll_1 rpc to 1001 failed: 5: qmpoll_1: RPC: Timed out; netid=tcp fd=689 TO=8.0s TT=8.001s O=680b I=0b CN=4857912/1 VSID=-3 169.254.8.83:7816 00000074.0065ecf1 243b9be4 Thu Sep 26 2019 04:11:26 -06:00 [kern_mgwd:info:2284] qmpoll_1: RPC: Timed out; netid=tcp fd=689 TO=8.0s TT=8.001s O=680b I=0b CN=4857912/1 VSID=-3 169.254.8.83:7816 00000074.0065ecf4 243b9c3e Thu Sep 26 2019 04:11:35 -06:00 [kern_mgwd:info:2284] W [src/rdb/quorum/rpccom.cc 397 (0x81ccad700)]: qmpoll_1 rpc to 1001 failed: 5: qmpoll_1: RPC: Timed out; netid=tcp fd=685 TO=8.0s TT=8.001s O=680b I=0b CN=4857914/1 VSID=-3 169.254.5.219:7816 00000074.0065ecf5 243b9c3e Thu Sep 26 2019 04:11:35 -06:00 [kern_mgwd:info:2284] qmpoll_1: RPC: Timed out; netid=tcp fd=685 TO=8.0s TT=8.001s O=680b I=0b CN=4857914/1 VSID=-3 169.254.5.219:7816 00000074.0065ecf8 243b9ca0 Thu Sep 26 2019 04:11:44 -06:00 [kern_mgwd:info:2284] W [src/rdb/quorum/rpccom.cc 397 (0x81ccaeb00)]: qmpoll_1 rpc to 1001 failed: 5: qmpoll_1: RPC: Timed out; netid=tcp fd=684 TO=8.0s TT=8.001s O=680b I=0b CN=4857915/1 VSID=-3 169.254.8.83:7816 00000074.0065ecf9 243b9ca0 Thu Sep 26 2019 04:11:44 -06:00 [kern_mgwd:info:2284] qmpoll_1: RPC: Timed out; netid=tcp fd=684 TO=8.0s TT=8.001s O=680b I=0b CN=4857915/1 VSID=-3 169.254.8.83:7816 00000074.0065ecfb 243b9ca0 Thu Sep 26 2019 04:11:45 -06:00 [kern_mgwd:info:2284] dsmdb_get_imp_1() on vifmgr_get_blade_info failed: 127.0.0.1{fffffffd|ffffffff} prog=536873492 server=vifmgr: RPC: Timed out; netid=tcp fd=693 TO=25.0s TT=25.000s O=388b I=0b CN=4857913/1 VSID=-3 127.0.0.1:911 00000074.0065ecfe 243b9cd2 Thu Sep 26 2019 04:11:50 -06:00 [kern_mgwd:info:2284] 0x81b244200: 0: ERR: rdb_tran_glue: create: tid=0x81b244200 failed to create transaction for label='SP: rdb-info-update lock': UNIT_OFFLINE 00000074.0065ecff 243b9cd2 Thu Sep 26 2019 04:11:50 -06:00 [kern_mgwd:info:2284] 0x81b244200: 0: ERR: rdb_tran_glue: abort: tid=0x81b244200 missing thread context 00000074.0065ed00 243b9cd2 Thu Sep 26 2019 04:11:50 -06:00 [kern_mgwd:info:2284] 0x81b244200: 0: ERR: MGWD::sp_netcfg: spcli_update_rdb: failed to obtain SP RDB transaction 00000074.0065ed03 243b9cf2 Thu Sep 26 2019 04:11:53 -06:00 [kern_mgwd:info:2284] W [src/rdb/quorum/rpccom.cc 397 (0x81ccae100)]: qmpoll_1 rpc to 1001 failed: 5: qmpoll_1: RPC: Timed out; netid=tcp fd=40 TO=8.0s TT=8.001s O=680b I=0b CN=4857916/1 VSID=-3 169.254.5.219:7816 00000074.0065ed04 243b9cf2 Thu Sep 26 2019 04:11:53 -06:00 [kern_mgwd:info:2284] qmpoll_1: RPC: Timed out; netid=tcp fd=40 TO=8.0s TT=8.001s O=680b I=0b CN=4857916/1 VSID=-3 169.254.5.219:7816 00000074.0065ed07 243b9d4c Thu Sep 26 2019 04:12:02 -06:00 [kern_mgwd:info:2284] W [src/rdb/quorum/rpccom.cc 397 (0x81d1df200)]: qmpoll_1 rpc to 1001 failed: 5: qmpoll_1: RPC: Timed out; netid=tcp fd=40 TO=8.0s TT=8.001s O=680b I=0b CN=4857918/1 VSID=-3 169.254.8.83:7816 00000074.0065ed08 243b9d4c Thu Sep 26 2019 04:12:02 -06:00 [kern_mgwd:info:2284] qmpoll_1: RPC: Timed out; netid=tcp fd=40 TO=8.0s TT=8.001s O=680b I=0b CN=4857918/1 VSID=-3 169.254.8.83:7816 00000074.0065ed0b 243b9da6 Thu Sep 26 2019 04:12:11 -06:00 [kern_mgwd:info:2284] W [src/rdb/quorum/rpccom.cc 397 (0x81ccadc00)]: qmpoll_1 rpc to 1001 failed: 5: qmpoll_1: RPC: Timed out; netid=tcp fd=40 TO=8.0s TT=8.001s O=680b I=0b CN=4857920/1 VSID=-3 169.254.5.219:7816 00000074.0065ed0c 243b9da6 Thu Sep 26 2019 04:12:11 -06:00 [kern_mgwd:info:2284] qmpoll_1: RPC: Timed out; netid=tcp fd=40 TO=8.0s TT=8.001s O=680b I=0b CN=4857920/1 VSID=-3 169.254.5.219:7816 00000074.0065ed0f 243b9e03 Thu Sep 26 2019 04:12:20 -06:00 [kern_mgwd:info:2284] W [src/rdb/quorum/rpccom.cc 397 (0x81ccad200)]: qmpoll_1 rpc to 1001 failed: 5: qmpoll_1: RPC: Timed out; netid=tcp fd=40 TO=8.0s TT=8.001s O=680b I=0b CN=4857921/1 VSID=-3 169.254.8.83:7816 00000074.0065ed10 243b9e03 Thu Sep 26 2019 04:12:20 -06:00 [kern_mgwd:info:2284] qmpoll_1: RPC: Timed out; netid=tcp fd=40 TO=8.0s TT=8.001s O=680b I=0b CN=4857921/1 VSID=-3 169.254.8.83:7816 00000074.0065ed13 243b9e38 Thu Sep 26 2019 04:12:25 -06:00 [kern_mgwd:info:2284] dsmdb_get_imp_1() on node failed: 169.254.5.219{ffffffff|ffffffff} prog=536873488 server=mgwd: RPC: Timed out; netid=tcp fd=689 TO=25.0s TT=25.000s O=828b I=0b CN=4857919/1 VSID=-3 169.254.5.219:910 00000074.0065ed14 243b9e38 Thu Sep 26 2019 04:12:25 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. Timeout: Operation "node_iterator::get_imp()" took longer than 25 seconds to complete [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065ed16 243b9e5a Thu Sep 26 2019 04:12:29 -06:00 [kern_mgwd:info:2284] W [src/rdb/quorum/rpccom.cc 397 (0x81ccae600)]: qmpoll_1 rpc to 1001 failed: 5: qmpoll_1: RPC: Timed out; netid=tcp fd=40 TO=8.0s TT=8.000s O=680b I=0b CN=4857923/1 VSID=-3 169.254.5.219:7816 00000074.0065ed17 243b9e5a Thu Sep 26 2019 04:12:29 -06:00 [kern_mgwd:info:2284] qmpoll_1: RPC: Timed out; netid=tcp fd=40 TO=8.0s TT=8.000s O=680b I=0b CN=4857923/1 VSID=-3 169.254.5.219:7816 00000074.0065ed1a 243b9eb4 Thu Sep 26 2019 04:12:38 -06:00 [kern_mgwd:info:2284] W [src/rdb/quorum/rpccom.cc 397 (0x81ccad700)]: qmpoll_1 rpc to 1001 failed: 5: qmpoll_1: RPC: Timed out; netid=tcp fd=689 TO=8.0s TT=8.000s O=680b I=0b CN=4857927/1 VSID=-3 169.254.8.83:7816 00000074.0065ed1b 243b9eb4 Thu Sep 26 2019 04:12:38 -06:00 [kern_mgwd:info:2284] qmpoll_1: RPC: Timed out; netid=tcp fd=689 TO=8.0s TT=8.000s O=680b I=0b CN=4857927/1 VSID=-3 169.254.8.83:7816 00000074.0065ed1e 243b9f0e Thu Sep 26 2019 04:12:47 -06:00 [kern_mgwd:info:2284] W [src/rdb/quorum/rpccom.cc 397 (0x81ccaeb00)]: qmpoll_1 rpc to 1001 failed: 5: qmpoll_1: RPC: Timed out; netid=tcp fd=689 TO=8.0s TT=8.001s O=680b I=0b CN=4857928/1 VSID=-3 169.254.5.219:7816 00000074.0065ed1f 243b9f0e Thu Sep 26 2019 04:12:47 -06:00 [kern_mgwd:info:2284] qmpoll_1: RPC: Timed out; netid=tcp fd=689 TO=8.0s TT=8.001s O=680b I=0b CN=4857928/1 VSID=-3 169.254.5.219:7816 00000074.0065ed22 243b9f6c Thu Sep 26 2019 04:12:56 -06:00 [kern_mgwd:info:2284] W [src/rdb/quorum/rpccom.cc 397 (0x81ccae100)]: qmpoll_1 rpc to 1001 failed: 5: qmpoll_1: RPC: Timed out; netid=tcp fd=689 TO=8.0s TT=8.001s O=680b I=0b CN=4857929/1 VSID=-3 169.254.8.83:7816 00000074.0065ed23 243b9f6c Thu Sep 26 2019 04:12:56 -06:00 [kern_mgwd:info:2284] qmpoll_1: RPC: Timed out; netid=tcp fd=689 TO=8.0s TT=8.001s O=680b I=0b CN=4857929/1 VSID=-3 169.254.8.83:7816 00000074.0065ed27 243b9fc2 Thu Sep 26 2019 04:13:05 -06:00 [kern_mgwd:info:2284] W [src/rdb/quorum/rpccom.cc 397 (0x81d1df200)]: qmpoll_1 rpc to 1001 failed: 5: qmpoll_1: RPC: Timed out; netid=tcp fd=684 TO=8.0s TT=8.001s O=680b I=0b CN=4857931/1 VSID=-3 169.254.5.219:7816 00000074.0065ed28 243b9fc2 Thu Sep 26 2019 04:13:05 -06:00 [kern_mgwd:info:2284] qmpoll_1: RPC: Timed out; netid=tcp fd=684 TO=8.0s TT=8.001s O=680b I=0b CN=4857931/1 VSID=-3 169.254.5.219:7816 00000074.0065ed2b 243ba01c Thu Sep 26 2019 04:13:14 -06:00 [kern_mgwd:info:2284] W [src/rdb/quorum/rpccom.cc 397 (0x81ccadc00)]: qmpoll_1 rpc to 1001 failed: 5: qmpoll_1: RPC: Timed out; netid=tcp fd=684 TO=8.0s TT=8.001s O=680b I=0b CN=4857933/1 VSID=-3 169.254.8.83:7816 00000074.0065ed2c 243ba01c Thu Sep 26 2019 04:13:14 -06:00 [kern_mgwd:info:2284] qmpoll_1: RPC: Timed out; netid=tcp fd=684 TO=8.0s TT=8.001s O=680b I=0b CN=4857933/1 VSID=-3 169.254.8.83:7816 00000074.0065ed31 243ba076 Thu Sep 26 2019 04:13:23 -06:00 [kern_mgwd:info:2284] W [src/rdb/quorum/rpccom.cc 397 (0x81ccad200)]: qmpoll_1 rpc to 1001 failed: 5: qmpoll_1: RPC: Timed out; netid=tcp fd=684 TO=8.0s TT=8.001s O=680b I=0b CN=4857934/1 VSID=-3 169.254.5.219:7816 00000074.0065ed32 243ba076 Thu Sep 26 2019 04:13:23 -06:00 [kern_mgwd:info:2284] qmpoll_1: RPC: Timed out; netid=tcp fd=684 TO=8.0s TT=8.001s O=680b I=0b CN=4857934/1 VSID=-3 169.254.5.219:7816 00000074.0065ed34 243ba090 Thu Sep 26 2019 04:13:25 -06:00 [kern_mgwd:info:2284] dsmdb_get_imp_1() on node failed: 169.254.5.219{ffffffff|ffffffff} prog=536873488 server=mgwd: RPC: Timed out; netid=tcp fd=689 TO=25.0s TT=25.001s O=828b I=0b CN=4857932/1 VSID=-3 169.254.5.219:910 00000074.0065ed35 243ba090 Thu Sep 26 2019 04:13:25 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. Timeout: Operation "node_iterator::get_imp()" took longer than 25 seconds to complete [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065ed37 243ba0d5 Thu Sep 26 2019 04:13:32 -06:00 [kern_mgwd:info:2284] W [src/rdb/quorum/rpccom.cc 397 (0x81ccae600)]: qmpoll_1 rpc to 1001 failed: 5: qmpoll_1: RPC: Timed out; netid=tcp fd=684 TO=8.0s TT=8.001s O=680b I=0b CN=4857938/1 VSID=-3 169.254.8.83:7816 00000074.0065ed38 243ba0d5 Thu Sep 26 2019 04:13:32 -06:00 [kern_mgwd:info:2284] qmpoll_1: RPC: Timed out; netid=tcp fd=684 TO=8.0s TT=8.001s O=680b I=0b CN=4857938/1 VSID=-3 169.254.8.83:7816 00000074.0065ed3c 243ba12a Thu Sep 26 2019 04:13:41 -06:00 [kern_mgwd:info:2284] W [src/rdb/quorum/rpccom.cc 397 (0x81ccad700)]: qmpoll_1 rpc to 1001 failed: 5: qmpoll_1: RPC: Timed out; netid=tcp fd=684 TO=8.0s TT=8.001s O=680b I=0b CN=4857939/1 VSID=-3 169.254.5.219:7816 00000074.0065ed3d 243ba12a Thu Sep 26 2019 04:13:41 -06:00 [kern_mgwd:info:2284] qmpoll_1: RPC: Timed out; netid=tcp fd=684 TO=8.0s TT=8.001s O=680b I=0b CN=4857939/1 VSID=-3 169.254.5.219:7816 00000074.0065ed40 243ba184 Thu Sep 26 2019 04:13:50 -06:00 [kern_mgwd:info:2284] W [src/rdb/quorum/rpccom.cc 397 (0x81ccaeb00)]: qmpoll_1 rpc to 1001 failed: 5: qmpoll_1: RPC: Timed out; netid=tcp fd=40 TO=8.0s TT=8.001s O=680b I=0b CN=4857940/1 VSID=-3 169.254.8.83:7816 00000074.0065ed41 243ba184 Thu Sep 26 2019 04:13:50 -06:00 [kern_mgwd:info:2284] qmpoll_1: RPC: Timed out; netid=tcp fd=40 TO=8.0s TT=8.001s O=680b I=0b CN=4857940/1 VSID=-3 169.254.8.83:7816 00000074.0065ed44 243ba1de Thu Sep 26 2019 04:13:59 -06:00 [kern_mgwd:info:2284] W [src/rdb/quorum/rpccom.cc 397 (0x81ccae100)]: qmpoll_1 rpc to 1001 failed: 5: qmpoll_1: RPC: Timed out; netid=tcp fd=40 TO=8.0s TT=8.000s O=680b I=0b CN=4857941/1 VSID=-3 169.254.5.219:7816 00000074.0065ed45 243ba1de Thu Sep 26 2019 04:13:59 -06:00 [kern_mgwd:info:2284] qmpoll_1: RPC: Timed out; netid=tcp fd=40 TO=8.0s TT=8.000s O=680b I=0b CN=4857941/1 VSID=-3 169.254.5.219:7816 00000074.0065ed48 243ba23e Thu Sep 26 2019 04:14:08 -06:00 [kern_mgwd:info:2284] W [src/rdb/quorum/rpccom.cc 397 (0x81d1df200)]: qmpoll_1 rpc to 1001 failed: 5: qmpoll_1: RPC: Timed out; netid=tcp fd=40 TO=8.0s TT=8.001s O=680b I=0b CN=4857943/1 VSID=-3 169.254.8.83:7816 00000074.0065ed49 243ba23e Thu Sep 26 2019 04:14:08 -06:00 [kern_mgwd:info:2284] qmpoll_1: RPC: Timed out; netid=tcp fd=40 TO=8.0s TT=8.001s O=680b I=0b CN=4857943/1 VSID=-3 169.254.8.83:7816 00000074.0065ed4d 243ba292 Thu Sep 26 2019 04:14:17 -06:00 [kern_mgwd:info:2284] W [src/rdb/quorum/rpccom.cc 397 (0x81ccadc00)]: qmpoll_1 rpc to 1001 failed: 5: qmpoll_1: RPC: Timed out; netid=tcp fd=40 TO=8.0s TT=8.001s O=680b I=0b CN=4857945/1 VSID=-3 169.254.5.219:7816 00000074.0065ed4e 243ba292 Thu Sep 26 2019 04:14:17 -06:00 [kern_mgwd:info:2284] qmpoll_1: RPC: Timed out; netid=tcp fd=40 TO=8.0s TT=8.001s O=680b I=0b CN=4857945/1 VSID=-3 169.254.5.219:7816 00000074.0065ed50 243ba2ec Thu Sep 26 2019 04:14:25 -06:00 [kern_mgwd:info:2284] dsmdb_get_imp_1() on node failed: 169.254.5.219{ffffffff|ffffffff} prog=536873488 server=mgwd: RPC: Timed out; netid=tcp fd=684 TO=25.0s TT=25.001s O=828b I=0b CN=4857944/1 VSID=-3 169.254.5.219:910 00000074.0065ed51 243ba2ec Thu Sep 26 2019 04:14:25 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. Timeout: Operation "node_iterator::get_imp()" took longer than 25 seconds to complete [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065ed52 243ba2ec Thu Sep 26 2019 04:14:26 -06:00 [kern_mgwd:info:2284] W [src/rdb/quorum/rpccom.cc 397 (0x81ccad200)]: qmpoll_1 rpc to 1001 failed: 5: qmpoll_1: RPC: Timed out; netid=tcp fd=40 TO=8.0s TT=8.000s O=680b I=0b CN=4857946/1 VSID=-3 169.254.8.83:7816 00000074.0065ed53 243ba2ec Thu Sep 26 2019 04:14:26 -06:00 [kern_mgwd:info:2284] qmpoll_1: RPC: Timed out; netid=tcp fd=40 TO=8.0s TT=8.000s O=680b I=0b CN=4857946/1 VSID=-3 169.254.8.83:7816 00000074.0065ed54 243ba346 Thu Sep 26 2019 04:14:35 -06:00 [kern_mgwd:info:2284] W [src/rdb/quorum/rpccom.cc 397 (0x81ccae600)]: qmpoll_1 rpc to 1001 failed: 5: qmpoll_1: RPC: Timed out; netid=tcp fd=40 TO=8.0s TT=8.001s O=680b I=0b CN=4857948/1 VSID=-3 169.254.5.219:7816 00000074.0065ed55 243ba346 Thu Sep 26 2019 04:14:35 -06:00 [kern_mgwd:info:2284] qmpoll_1: RPC: Timed out; netid=tcp fd=40 TO=8.0s TT=8.001s O=680b I=0b CN=4857948/1 VSID=-3 169.254.5.219:7816 00000074.0065ed56 243ba3a0 Thu Sep 26 2019 04:14:44 -06:00 [kern_mgwd:info:2284] W [src/rdb/quorum/rpccom.cc 397 (0x81ccad700)]: qmpoll_1 rpc to 1001 failed: 5: qmpoll_1: RPC: Timed out; netid=tcp fd=40 TO=8.0s TT=8.001s O=680b I=0b CN=4857949/1 VSID=-3 169.254.8.83:7816 00000074.0065ed57 243ba3a0 Thu Sep 26 2019 04:14:44 -06:00 [kern_mgwd:info:2284] qmpoll_1: RPC: Timed out; netid=tcp fd=40 TO=8.0s TT=8.001s O=680b I=0b CN=4857949/1 VSID=-3 169.254.8.83:7816 00000074.0065ed58 243ba3c7 Thu Sep 26 2019 04:14:48 -06:00 [kern_mgwd:info:2284] 0x81d1ea100: 86ffff0000000035: ERR: rdb_tran_glue: create: tid=0x81d1ea100 failed to create transaction for label='job_manager job tx loop': UNIT_OFFLINE 00000074.0065ed59 243ba3c7 Thu Sep 26 2019 04:14:48 -06:00 [kern_mgwd:info:2284] 0x81d1ea100: 86ffff0000000035: ERR: job_manager::rdb_util: create_rw_transaction:src/job_rec_int.cc:643 create_rw_transaction(job_manager job tx loop): Failed to get transaction. Node "nmg-fas8040-01" on ring "Management" is offline. Check the health of the cluster using the "cluster show" command. For further assistance, contact technical support. (393271) 00000074.0065ed5a 243ba3c7 Thu Sep 26 2019 04:14:48 -06:00 [kern_mgwd:info:2284] 0x81d1ea100: 86ffff0000000035: WARNING: job_manager::job_store: flush_caches:src/job_store_support.cc:428 rdb_transaction: flush_caches discarded as job_manager is_waiting_for_online_cb 00000074.0065ed5b 243ba3fa Thu Sep 26 2019 04:14:53 -06:00 [kern_mgwd:info:2284] W [src/rdb/quorum/rpccom.cc 397 (0x81ccaeb00)]: qmpoll_1 rpc to 1001 failed: 5: qmpoll_1: RPC: Timed out; netid=tcp fd=40 TO=8.0s TT=8.000s O=680b I=0b CN=4857950/1 VSID=-3 169.254.5.219:7816 00000074.0065ed5c 243ba3fa Thu Sep 26 2019 04:14:53 -06:00 [kern_mgwd:info:2284] qmpoll_1: RPC: Timed out; netid=tcp fd=40 TO=8.0s TT=8.000s O=680b I=0b CN=4857950/1 VSID=-3 169.254.5.219:7816 00000074.0065ed5d 243ba454 Thu Sep 26 2019 04:15:02 -06:00 [kern_mgwd:info:2284] W [src/rdb/quorum/rpccom.cc 397 (0x81ccae100)]: qmpoll_1 rpc to 1001 failed: 5: qmpoll_1: RPC: Timed out; netid=tcp fd=40 TO=8.0s TT=8.001s O=680b I=0b CN=4857951/1 VSID=-3 169.254.8.83:7816 00000074.0065ed5e 243ba454 Thu Sep 26 2019 04:15:02 -06:00 [kern_mgwd:info:2284] qmpoll_1: RPC: Timed out; netid=tcp fd=40 TO=8.0s TT=8.001s O=680b I=0b CN=4857951/1 VSID=-3 169.254.8.83:7816 00000074.0065ed5f 243ba4ae Thu Sep 26 2019 04:15:11 -06:00 [kern_mgwd:info:2284] W [src/rdb/quorum/rpccom.cc 397 (0x81d1df200)]: qmpoll_1 rpc to 1001 failed: 5: qmpoll_1: RPC: Timed out; netid=tcp fd=40 TO=8.0s TT=8.000s O=680b I=0b CN=4857954/1 VSID=-3 169.254.5.219:7816 00000074.0065ed60 243ba4ae Thu Sep 26 2019 04:15:11 -06:00 [kern_mgwd:info:2284] qmpoll_1: RPC: Timed out; netid=tcp fd=40 TO=8.0s TT=8.000s O=680b I=0b CN=4857954/1 VSID=-3 169.254.5.219:7816 00000074.0065ed61 243ba508 Thu Sep 26 2019 04:15:20 -06:00 [kern_mgwd:info:2284] W [src/rdb/quorum/rpccom.cc 397 (0x81ccadc00)]: qmpoll_1 rpc to 1001 failed: 5: qmpoll_1: RPC: Timed out; netid=tcp fd=40 TO=8.0s TT=8.001s O=680b I=0b CN=4857955/1 VSID=-3 169.254.8.83:7816 00000074.0065ed62 243ba508 Thu Sep 26 2019 04:15:20 -06:00 [kern_mgwd:info:2284] qmpoll_1: RPC: Timed out; netid=tcp fd=40 TO=8.0s TT=8.001s O=680b I=0b CN=4857955/1 VSID=-3 169.254.8.83:7816 00000074.0065ed63 243ba540 Thu Sep 26 2019 04:15:25 -06:00 [kern_mgwd:info:2284] dsmdb_get_imp_1() on node failed: 169.254.5.219{ffffffff|ffffffff} prog=536873488 server=mgwd: RPC: Timed out; netid=tcp fd=685 TO=25.0s TT=25.001s O=828b I=0b CN=4857953/1 VSID=-3 169.254.5.219:910 00000074.0065ed64 243ba540 Thu Sep 26 2019 04:15:25 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. Timeout: Operation "node_iterator::get_imp()" took longer than 25 seconds to complete [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065ed65 243ba562 Thu Sep 26 2019 04:15:29 -06:00 [kern_mgwd:info:2284] W [src/rdb/quorum/rpccom.cc 397 (0x81ccad200)]: qmpoll_1 rpc to 1001 failed: 5: qmpoll_1: RPC: Timed out; netid=tcp fd=40 TO=8.0s TT=8.001s O=680b I=0b CN=4857956/1 VSID=-3 169.254.5.219:7816 00000074.0065ed66 243ba562 Thu Sep 26 2019 04:15:29 -06:00 [kern_mgwd:info:2284] qmpoll_1: RPC: Timed out; netid=tcp fd=40 TO=8.0s TT=8.001s O=680b I=0b CN=4857956/1 VSID=-3 169.254.5.219:7816 00000074.0065ed67 243ba5bc Thu Sep 26 2019 04:15:38 -06:00 [kern_mgwd:info:2284] W [src/rdb/quorum/rpccom.cc 397 (0x81ccae600)]: qmpoll_1 rpc to 1001 failed: 5: qmpoll_1: RPC: Timed out; netid=tcp fd=40 TO=8.0s TT=8.000s O=680b I=0b CN=4857958/1 VSID=-3 169.254.8.83:7816 00000074.0065ed68 243ba5bc Thu Sep 26 2019 04:15:38 -06:00 [kern_mgwd:info:2284] qmpoll_1: RPC: Timed out; netid=tcp fd=40 TO=8.0s TT=8.000s O=680b I=0b CN=4857958/1 VSID=-3 169.254.8.83:7816 00000074.0065ed69 243ba616 Thu Sep 26 2019 04:15:47 -06:00 [kern_mgwd:info:2284] W [src/rdb/quorum/rpccom.cc 397 (0x81ccad700)]: qmpoll_1 rpc to 1001 failed: 5: qmpoll_1: RPC: Timed out; netid=tcp fd=40 TO=8.0s TT=8.001s O=680b I=0b CN=4857960/1 VSID=-3 169.254.5.219:7816 00000074.0065ed6a 243ba616 Thu Sep 26 2019 04:15:47 -06:00 [kern_mgwd:info:2284] qmpoll_1: RPC: Timed out; netid=tcp fd=40 TO=8.0s TT=8.001s O=680b I=0b CN=4857960/1 VSID=-3 169.254.5.219:7816 00000074.0065ed6b 243ba670 Thu Sep 26 2019 04:15:56 -06:00 [kern_mgwd:info:2284] W [src/rdb/quorum/rpccom.cc 397 (0x81ccaeb00)]: qmpoll_1 rpc to 1001 failed: 5: qmpoll_1: RPC: Timed out; netid=tcp fd=40 TO=8.0s TT=8.001s O=680b I=0b CN=4857961/1 VSID=-3 169.254.8.83:7816 00000074.0065ed6c 243ba670 Thu Sep 26 2019 04:15:56 -06:00 [kern_mgwd:info:2284] qmpoll_1: RPC: Timed out; netid=tcp fd=40 TO=8.0s TT=8.001s O=680b I=0b CN=4857961/1 VSID=-3 169.254.8.83:7816 00000074.0065ed6d 243ba6ca Thu Sep 26 2019 04:16:05 -06:00 [kern_mgwd:info:2284] W [src/rdb/quorum/rpccom.cc 397 (0x81ccae100)]: qmpoll_1 rpc to 1001 failed: 5: qmpoll_1: RPC: Timed out; netid=tcp fd=40 TO=8.0s TT=8.000s O=680b I=0b CN=4857963/1 VSID=-3 169.254.5.219:7816 00000074.0065ed6e 243ba6ca Thu Sep 26 2019 04:16:05 -06:00 [kern_mgwd:info:2284] qmpoll_1: RPC: Timed out; netid=tcp fd=40 TO=8.0s TT=8.000s O=680b I=0b CN=4857963/1 VSID=-3 169.254.5.219:7816 00000074.0065ed6f 243ba725 Thu Sep 26 2019 04:16:14 -06:00 [kern_mgwd:info:2284] W [src/rdb/quorum/rpccom.cc 397 (0x81d1df200)]: qmpoll_1 rpc to 1001 failed: 5: qmpoll_1: RPC: Timed out; netid=tcp fd=40 TO=8.0s TT=8.001s O=680b I=0b CN=4857965/1 VSID=-3 169.254.8.83:7816 00000074.0065ed70 243ba725 Thu Sep 26 2019 04:16:14 -06:00 [kern_mgwd:info:2284] qmpoll_1: RPC: Timed out; netid=tcp fd=40 TO=8.0s TT=8.001s O=680b I=0b CN=4857965/1 VSID=-3 169.254.8.83:7816 00000074.0065ed71 243ba77f Thu Sep 26 2019 04:16:23 -06:00 [kern_mgwd:info:2284] W [src/rdb/quorum/rpccom.cc 397 (0x81ccadc00)]: qmpoll_1 rpc to 1001 failed: 5: qmpoll_1: RPC: Timed out; netid=tcp fd=40 TO=8.0s TT=8.001s O=680b I=0b CN=4857966/1 VSID=-3 169.254.5.219:7816 00000074.0065ed72 243ba77f Thu Sep 26 2019 04:16:23 -06:00 [kern_mgwd:info:2284] qmpoll_1: RPC: Timed out; netid=tcp fd=40 TO=8.0s TT=8.001s O=680b I=0b CN=4857966/1 VSID=-3 169.254.5.219:7816 00000074.0065ed73 243ba798 Thu Sep 26 2019 04:16:25 -06:00 [kern_mgwd:info:2284] dsmdb_get_imp_1() on node failed: 169.254.5.219{ffffffff|ffffffff} prog=536873488 server=mgwd: RPC: Timed out; netid=tcp fd=685 TO=25.0s TT=25.001s O=828b I=0b CN=4857964/1 VSID=-3 169.254.5.219:910 00000074.0065ed74 243ba798 Thu Sep 26 2019 04:16:25 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. Timeout: Operation "node_iterator::get_imp()" took longer than 25 seconds to complete [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065ed75 243ba7d9 Thu Sep 26 2019 04:16:32 -06:00 [kern_mgwd:info:2284] W [src/rdb/quorum/rpccom.cc 397 (0x81ccad200)]: qmpoll_1 rpc to 1001 failed: 5: qmpoll_1: RPC: Timed out; netid=tcp fd=40 TO=8.0s TT=8.001s O=680b I=0b CN=4857968/1 VSID=-3 169.254.8.83:7816 00000074.0065ed76 243ba7d9 Thu Sep 26 2019 04:16:32 -06:00 [kern_mgwd:info:2284] qmpoll_1: RPC: Timed out; netid=tcp fd=40 TO=8.0s TT=8.001s O=680b I=0b CN=4857968/1 VSID=-3 169.254.8.83:7816 00000074.0065ed77 243ba833 Thu Sep 26 2019 04:16:41 -06:00 [kern_mgwd:info:2284] W [src/rdb/quorum/rpccom.cc 397 (0x81ccae600)]: qmpoll_1 rpc to 1001 failed: 5: qmpoll_1: RPC: Timed out; netid=tcp fd=40 TO=8.0s TT=8.001s O=680b I=0b CN=4857970/1 VSID=-3 169.254.5.219:7816 00000074.0065ed78 243ba833 Thu Sep 26 2019 04:16:41 -06:00 [kern_mgwd:info:2284] qmpoll_1: RPC: Timed out; netid=tcp fd=40 TO=8.0s TT=8.001s O=680b I=0b CN=4857970/1 VSID=-3 169.254.5.219:7816 00000074.0065ed79 243ba856 Thu Sep 26 2019 04:16:44 -06:00 [kern_mgwd:info:2284] dsmdb_get_imp_1() on vifmgr_get_blade_info failed: 127.0.0.1{fffffffd|ffffffff} prog=536873492 server=vifmgr: RPC: Timed out; netid=tcp fd=689 TO=25.0s TT=25.001s O=388b I=0b CN=4857967/1 VSID=-3 127.0.0.1:911 00000074.0065ed7b 243ba88d Thu Sep 26 2019 04:16:50 -06:00 [kern_mgwd:info:2284] W [src/rdb/quorum/rpccom.cc 397 (0x81ccad700)]: qmpoll_1 rpc to 1001 failed: 5: qmpoll_1: RPC: Timed out; netid=tcp fd=40 TO=8.0s TT=8.000s O=680b I=0b CN=4857971/1 VSID=-3 169.254.8.83:7816 00000074.0065ed7c 243ba88d Thu Sep 26 2019 04:16:50 -06:00 [kern_mgwd:info:2284] qmpoll_1: RPC: Timed out; netid=tcp fd=40 TO=8.0s TT=8.000s O=680b I=0b CN=4857971/1 VSID=-3 169.254.8.83:7816 00000074.0065ed7d 243ba8e7 Thu Sep 26 2019 04:16:59 -06:00 [kern_mgwd:info:2284] W [src/rdb/quorum/rpccom.cc 397 (0x81ccaeb00)]: qmpoll_1 rpc to 1001 failed: 5: qmpoll_1: RPC: Timed out; netid=tcp fd=40 TO=8.0s TT=8.001s O=680b I=0b CN=4857974/1 VSID=-3 169.254.5.219:7816 00000074.0065ed7e 243ba8e7 Thu Sep 26 2019 04:16:59 -06:00 [kern_mgwd:info:2284] qmpoll_1: RPC: Timed out; netid=tcp fd=40 TO=8.0s TT=8.001s O=680b I=0b CN=4857974/1 VSID=-3 169.254.5.219:7816 00000074.0065ed7f 243ba941 Thu Sep 26 2019 04:17:08 -06:00 [kern_mgwd:info:2284] W [src/rdb/quorum/rpccom.cc 397 (0x81ccae100)]: qmpoll_1 rpc to 1001 failed: 5: qmpoll_1: RPC: Timed out; netid=tcp fd=40 TO=8.0s TT=8.001s O=680b I=0b CN=4857976/1 VSID=-3 169.254.8.83:7816 00000074.0065ed80 243ba941 Thu Sep 26 2019 04:17:08 -06:00 [kern_mgwd:info:2284] qmpoll_1: RPC: Timed out; netid=tcp fd=40 TO=8.0s TT=8.001s O=680b I=0b CN=4857976/1 VSID=-3 169.254.8.83:7816 00000074.0065ed81 243ba99b Thu Sep 26 2019 04:17:17 -06:00 [kern_mgwd:info:2284] W [src/rdb/quorum/rpccom.cc 397 (0x81d1df200)]: qmpoll_1 rpc to 1001 failed: 5: qmpoll_1: RPC: Timed out; netid=tcp fd=40 TO=8.0s TT=8.000s O=680b I=0b CN=4857978/1 VSID=-3 169.254.5.219:7816 00000074.0065ed82 243ba99b Thu Sep 26 2019 04:17:17 -06:00 [kern_mgwd:info:2284] qmpoll_1: RPC: Timed out; netid=tcp fd=40 TO=8.0s TT=8.000s O=680b I=0b CN=4857978/1 VSID=-3 169.254.5.219:7816 00000074.0065ed83 243ba9f5 Thu Sep 26 2019 04:17:25 -06:00 [kern_mgwd:info:2284] dsmdb_get_imp_1() on node failed: 169.254.5.219{ffffffff|ffffffff} prog=536873488 server=mgwd: RPC: Timed out; netid=tcp fd=685 TO=25.0s TT=25.001s O=828b I=0b CN=4857977/1 VSID=-3 169.254.5.219:910 00000074.0065ed84 243ba9f5 Thu Sep 26 2019 04:17:25 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. Timeout: Operation "node_iterator::get_imp()" took longer than 25 seconds to complete [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065ed85 243ba9f5 Thu Sep 26 2019 04:17:26 -06:00 [kern_mgwd:info:2284] W [src/rdb/quorum/rpccom.cc 397 (0x81ccadc00)]: qmpoll_1 rpc to 1001 failed: 5: qmpoll_1: RPC: Timed out; netid=tcp fd=688 TO=8.0s TT=8.001s O=680b I=0b CN=4857980/1 VSID=-3 169.254.8.83:7816 00000074.0065ed86 243ba9f5 Thu Sep 26 2019 04:17:26 -06:00 [kern_mgwd:info:2284] qmpoll_1: RPC: Timed out; netid=tcp fd=688 TO=8.0s TT=8.001s O=680b I=0b CN=4857980/1 VSID=-3 169.254.8.83:7816 00000074.0065ed87 243baa4f Thu Sep 26 2019 04:17:35 -06:00 [kern_mgwd:info:2284] W [src/rdb/quorum/rpccom.cc 397 (0x81ccad200)]: qmpoll_1 rpc to 1001 failed: 5: qmpoll_1: RPC: Timed out; netid=tcp fd=684 TO=8.0s TT=8.001s O=680b I=0b CN=4857982/1 VSID=-3 169.254.5.219:7816 00000074.0065ed88 243baa4f Thu Sep 26 2019 04:17:35 -06:00 [kern_mgwd:info:2284] qmpoll_1: RPC: Timed out; netid=tcp fd=684 TO=8.0s TT=8.001s O=680b I=0b CN=4857982/1 VSID=-3 169.254.5.219:7816 00000074.0065ed89 243baaa9 Thu Sep 26 2019 04:17:44 -06:00 [kern_mgwd:info:2284] W [src/rdb/quorum/rpccom.cc 397 (0x81ccae600)]: qmpoll_1 rpc to 1001 failed: 5: qmpoll_1: RPC: Timed out; netid=tcp fd=684 TO=8.0s TT=8.001s O=680b I=0b CN=4857986/1 VSID=-3 169.254.8.83:7816 00000074.0065ed8a 243baaa9 Thu Sep 26 2019 04:17:44 -06:00 [kern_mgwd:info:2284] qmpoll_1: RPC: Timed out; netid=tcp fd=684 TO=8.0s TT=8.001s O=680b I=0b CN=4857986/1 VSID=-3 169.254.8.83:7816 00000074.0065ed8b 243bab03 Thu Sep 26 2019 04:17:53 -06:00 [kern_mgwd:info:2284] W [src/rdb/quorum/rpccom.cc 397 (0x81ccad700)]: qmpoll_1 rpc to 1001 failed: 5: qmpoll_1: RPC: Timed out; netid=tcp fd=684 TO=8.0s TT=8.001s O=680b I=0b CN=4857987/1 VSID=-3 169.254.5.219:7816 00000074.0065ed8c 243bab03 Thu Sep 26 2019 04:17:53 -06:00 [kern_mgwd:info:2284] qmpoll_1: RPC: Timed out; netid=tcp fd=684 TO=8.0s TT=8.001s O=680b I=0b CN=4857987/1 VSID=-3 169.254.5.219:7816 00000074.0065ed8d 243bab5d Thu Sep 26 2019 04:18:02 -06:00 [kern_mgwd:info:2284] W [src/rdb/quorum/rpccom.cc 397 (0x81ccaeb00)]: qmpoll_1 rpc to 1001 failed: 5: qmpoll_1: RPC: Timed out; netid=tcp fd=633 TO=8.0s TT=8.000s O=680b I=0b CN=4857988/1 VSID=-3 169.254.8.83:7816 00000074.0065ed8e 243bab5d Thu Sep 26 2019 04:18:02 -06:00 [kern_mgwd:info:2284] qmpoll_1: RPC: Timed out; netid=tcp fd=633 TO=8.0s TT=8.000s O=680b I=0b CN=4857988/1 VSID=-3 169.254.8.83:7816 00000074.0065ed8f 243babb7 Thu Sep 26 2019 04:18:11 -06:00 [kern_mgwd:info:2284] W [src/rdb/quorum/rpccom.cc 397 (0x81ccae100)]: qmpoll_1 rpc to 1001 failed: 5: qmpoll_1: RPC: Timed out; netid=tcp fd=633 TO=8.0s TT=8.001s O=680b I=0b CN=4857991/1 VSID=-3 169.254.5.219:7816 00000074.0065ed90 243babb7 Thu Sep 26 2019 04:18:11 -06:00 [kern_mgwd:info:2284] qmpoll_1: RPC: Timed out; netid=tcp fd=633 TO=8.0s TT=8.001s O=680b I=0b CN=4857991/1 VSID=-3 169.254.5.219:7816 00000074.0065ed93 243bac11 Thu Sep 26 2019 04:18:20 -06:00 [kern_mgwd:info:2284] W [src/rdb/quorum/rpccom.cc 397 (0x81d1df200)]: qmpoll_1 rpc to 1001 failed: 5: qmpoll_1: RPC: Timed out; netid=tcp fd=633 TO=8.0s TT=8.001s O=680b I=0b CN=4857992/1 VSID=-3 169.254.8.83:7816 00000074.0065ed94 243bac11 Thu Sep 26 2019 04:18:20 -06:00 [kern_mgwd:info:2284] qmpoll_1: RPC: Timed out; netid=tcp fd=633 TO=8.0s TT=8.001s O=680b I=0b CN=4857992/1 VSID=-3 169.254.8.83:7816 00000074.0065ed95 243bac48 Thu Sep 26 2019 04:18:25 -06:00 [kern_mgwd:info:2284] dsmdb_get_imp_1() on node failed: 169.254.5.219{ffffffff|ffffffff} prog=536873488 server=mgwd: RPC: Timed out; netid=tcp fd=684 TO=25.0s TT=25.001s O=828b I=0b CN=4857989/1 VSID=-3 169.254.5.219:910 00000074.0065ed96 243bac48 Thu Sep 26 2019 04:18:25 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. Timeout: Operation "node_iterator::get_imp()" took longer than 25 seconds to complete [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065ed97 243bac6b Thu Sep 26 2019 04:18:29 -06:00 [kern_mgwd:info:2284] W [src/rdb/quorum/rpccom.cc 397 (0x81ccadc00)]: qmpoll_1 rpc to 1001 failed: 5: qmpoll_1: RPC: Timed out; netid=tcp fd=633 TO=8.0s TT=8.001s O=680b I=0b CN=4857995/1 VSID=-3 169.254.5.219:7816 00000074.0065ed98 243bac6b Thu Sep 26 2019 04:18:29 -06:00 [kern_mgwd:info:2284] qmpoll_1: RPC: Timed out; netid=tcp fd=633 TO=8.0s TT=8.001s O=680b I=0b CN=4857995/1 VSID=-3 169.254.5.219:7816 00000074.0065ed99 243bacc5 Thu Sep 26 2019 04:18:38 -06:00 [kern_mgwd:info:2284] W [src/rdb/quorum/rpccom.cc 397 (0x81ccad200)]: qmpoll_1 rpc to 1001 failed: 5: qmpoll_1: RPC: Timed out; netid=tcp fd=633 TO=8.0s TT=8.001s O=680b I=0b CN=4857996/1 VSID=-3 169.254.8.83:7816 00000074.0065ed9a 243bacc5 Thu Sep 26 2019 04:18:38 -06:00 [kern_mgwd:info:2284] qmpoll_1: RPC: Timed out; netid=tcp fd=633 TO=8.0s TT=8.001s O=680b I=0b CN=4857996/1 VSID=-3 169.254.8.83:7816 00000074.0065ed9b 243bad1f Thu Sep 26 2019 04:18:47 -06:00 [kern_mgwd:info:2284] W [src/rdb/quorum/rpccom.cc 397 (0x81ccae600)]: qmpoll_1 rpc to 1001 failed: 5: qmpoll_1: RPC: Timed out; netid=tcp fd=633 TO=8.0s TT=8.001s O=680b I=0b CN=4857998/1 VSID=-3 169.254.5.219:7816 00000074.0065ed9c 243bad1f Thu Sep 26 2019 04:18:47 -06:00 [kern_mgwd:info:2284] qmpoll_1: RPC: Timed out; netid=tcp fd=633 TO=8.0s TT=8.001s O=680b I=0b CN=4857998/1 VSID=-3 169.254.5.219:7816 00000074.0065ed9d 243bad79 Thu Sep 26 2019 04:18:56 -06:00 [kern_mgwd:info:2284] W [src/rdb/quorum/rpccom.cc 397 (0x81ccad700)]: qmpoll_1 rpc to 1001 failed: 5: qmpoll_1: RPC: Timed out; netid=tcp fd=633 TO=8.0s TT=8.001s O=680b I=0b CN=4857999/1 VSID=-3 169.254.8.83:7816 00000074.0065ed9e 243bad79 Thu Sep 26 2019 04:18:56 -06:00 [kern_mgwd:info:2284] qmpoll_1: RPC: Timed out; netid=tcp fd=633 TO=8.0s TT=8.001s O=680b I=0b CN=4857999/1 VSID=-3 169.254.8.83:7816 00000074.0065ed9f 243badd3 Thu Sep 26 2019 04:19:05 -06:00 [kern_mgwd:info:2284] W [src/rdb/quorum/rpccom.cc 397 (0x81ccaeb00)]: qmpoll_1 rpc to 1001 failed: 5: qmpoll_1: RPC: Timed out; netid=tcp fd=633 TO=8.0s TT=8.001s O=680b I=0b CN=4858000/1 VSID=-3 169.254.5.219:7816 00000074.0065eda0 243badd3 Thu Sep 26 2019 04:19:05 -06:00 [kern_mgwd:info:2284] qmpoll_1: RPC: Timed out; netid=tcp fd=633 TO=8.0s TT=8.001s O=680b I=0b CN=4858000/1 VSID=-3 169.254.5.219:7816 00000074.0065eda2 243bae2d Thu Sep 26 2019 04:19:14 -06:00 [kern_mgwd:info:2284] W [src/rdb/quorum/rpccom.cc 397 (0x81ccae100)]: qmpoll_1 rpc to 1001 failed: 5: qmpoll_1: RPC: Timed out; netid=tcp fd=633 TO=8.0s TT=8.000s O=680b I=0b CN=4858004/1 VSID=-3 169.254.8.83:7816 00000074.0065eda3 243bae2d Thu Sep 26 2019 04:19:14 -06:00 [kern_mgwd:info:2284] qmpoll_1: RPC: Timed out; netid=tcp fd=633 TO=8.0s TT=8.000s O=680b I=0b CN=4858004/1 VSID=-3 169.254.8.83:7816 00000074.0065eda4 243bae87 Thu Sep 26 2019 04:19:23 -06:00 [kern_mgwd:info:2284] W [src/rdb/quorum/rpccom.cc 397 (0x81d1df200)]: qmpoll_1 rpc to 1001 failed: 5: qmpoll_1: RPC: Timed out; netid=tcp fd=633 TO=8.0s TT=8.000s O=680b I=0b CN=4858005/1 VSID=-3 169.254.5.219:7816 00000074.0065eda5 243bae87 Thu Sep 26 2019 04:19:23 -06:00 [kern_mgwd:info:2284] qmpoll_1: RPC: Timed out; netid=tcp fd=633 TO=8.0s TT=8.000s O=680b I=0b CN=4858005/1 VSID=-3 169.254.5.219:7816 00000074.0065eda6 243baea0 Thu Sep 26 2019 04:19:25 -06:00 [kern_mgwd:info:2284] dsmdb_get_imp_1() on node failed: 169.254.5.219{ffffffff|ffffffff} prog=536873488 server=mgwd: RPC: Timed out; netid=tcp fd=686 TO=25.0s TT=25.001s O=828b I=0b CN=4858001/1 VSID=-3 169.254.5.219:910 00000074.0065eda7 243baea0 Thu Sep 26 2019 04:19:25 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. Timeout: Operation "node_iterator::get_imp()" took longer than 25 seconds to complete [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065eda8 243baee1 Thu Sep 26 2019 04:19:32 -06:00 [kern_mgwd:info:2284] W [src/rdb/quorum/rpccom.cc 397 (0x81ccadc00)]: qmpoll_1 rpc to 1001 failed: 5: qmpoll_1: RPC: Timed out; netid=tcp fd=633 TO=8.0s TT=8.001s O=680b I=0b CN=4858006/1 VSID=-3 169.254.8.83:7816 00000074.0065eda9 243baee1 Thu Sep 26 2019 04:19:32 -06:00 [kern_mgwd:info:2284] qmpoll_1: RPC: Timed out; netid=tcp fd=633 TO=8.0s TT=8.001s O=680b I=0b CN=4858006/1 VSID=-3 169.254.8.83:7816 00000074.0065edaa 243baf3b Thu Sep 26 2019 04:19:41 -06:00 [kern_mgwd:info:2284] W [src/rdb/quorum/rpccom.cc 397 (0x81ccad200)]: qmpoll_1 rpc to 1001 failed: 5: qmpoll_1: RPC: Timed out; netid=tcp fd=40 TO=8.0s TT=8.001s O=680b I=0b CN=4858007/1 VSID=-3 169.254.5.219:7816 00000074.0065edab 243baf3b Thu Sep 26 2019 04:19:41 -06:00 [kern_mgwd:info:2284] qmpoll_1: RPC: Timed out; netid=tcp fd=40 TO=8.0s TT=8.001s O=680b I=0b CN=4858007/1 VSID=-3 169.254.5.219:7816 00000074.0065edac 243baf7f Thu Sep 26 2019 04:19:48 -06:00 [kern_mgwd:info:2284] 0x81d1ea100: 86ffff0000000035: ERR: rdb_tran_glue: create: tid=0x81d1ea100 failed to create transaction for label='job_manager job tx loop': UNIT_OFFLINE 00000074.0065edad 243baf7f Thu Sep 26 2019 04:19:48 -06:00 [kern_mgwd:info:2284] 0x81d1ea100: 86ffff0000000035: ERR: job_manager::rdb_util: create_rw_transaction:src/job_rec_int.cc:643 create_rw_transaction(job_manager job tx loop): Failed to get transaction. Node "nmg-fas8040-01" on ring "Management" is offline. Check the health of the cluster using the "cluster show" command. For further assistance, contact technical support. (393271) 00000074.0065edae 243baf7f Thu Sep 26 2019 04:19:48 -06:00 [kern_mgwd:info:2284] 0x81d1ea100: 86ffff0000000035: WARNING: job_manager::job_store: flush_caches:src/job_store_support.cc:428 rdb_transaction: flush_caches discarded as job_manager is_waiting_for_online_cb 00000074.0065edb1 243baf95 Thu Sep 26 2019 04:19:50 -06:00 [kern_mgwd:info:2284] W [src/rdb/quorum/rpccom.cc 397 (0x81ccae600)]: qmpoll_1 rpc to 1001 failed: 5: qmpoll_1: RPC: Timed out; netid=tcp fd=40 TO=8.0s TT=8.000s O=680b I=0b CN=4858009/1 VSID=-3 169.254.8.83:7816 00000074.0065edb2 243baf95 Thu Sep 26 2019 04:19:50 -06:00 [kern_mgwd:info:2284] qmpoll_1: RPC: Timed out; netid=tcp fd=40 TO=8.0s TT=8.000s O=680b I=0b CN=4858009/1 VSID=-3 169.254.8.83:7816 00000074.0065edb3 243bafef Thu Sep 26 2019 04:19:59 -06:00 [kern_mgwd:info:2284] W [src/rdb/quorum/rpccom.cc 397 (0x81ccad700)]: qmpoll_1 rpc to 1001 failed: 5: qmpoll_1: RPC: Timed out; netid=tcp fd=40 TO=8.0s TT=8.001s O=680b I=0b CN=4858010/1 VSID=-3 169.254.5.219:7816 00000074.0065edb4 243bafef Thu Sep 26 2019 04:19:59 -06:00 [kern_mgwd:info:2284] qmpoll_1: RPC: Timed out; netid=tcp fd=40 TO=8.0s TT=8.001s O=680b I=0b CN=4858010/1 VSID=-3 169.254.5.219:7816 00000074.0065edb5 243bb049 Thu Sep 26 2019 04:20:08 -06:00 [kern_mgwd:info:2284] W [src/rdb/quorum/rpccom.cc 397 (0x81ccaeb00)]: qmpoll_1 rpc to 1001 failed: 5: qmpoll_1: RPC: Timed out; netid=tcp fd=40 TO=8.0s TT=8.002s O=680b I=0b CN=4858011/1 VSID=-3 169.254.8.83:7816 00000074.0065edb6 243bb049 Thu Sep 26 2019 04:20:08 -06:00 [kern_mgwd:info:2284] qmpoll_1: RPC: Timed out; netid=tcp fd=40 TO=8.0s TT=8.002s O=680b I=0b CN=4858011/1 VSID=-3 169.254.8.83:7816 00000074.0065edba 243bb0ac Thu Sep 26 2019 04:20:17 -06:00 [kern_mgwd:info:2284] W [src/rdb/quorum/rpccom.cc 397 (0x81ccae100)]: qmpoll_1 rpc to 1001 failed: 5: qmpoll_1: RPC: Timed out; netid=tcp fd=40 TO=8.0s TT=8.001s O=680b I=0b CN=4858014/1 VSID=-3 169.254.5.219:7816 00000074.0065edbb 243bb0ac Thu Sep 26 2019 04:20:17 -06:00 [kern_mgwd:info:2284] qmpoll_1: RPC: Timed out; netid=tcp fd=40 TO=8.0s TT=8.001s O=680b I=0b CN=4858014/1 VSID=-3 169.254.5.219:7816 00000074.0065edbe 243bb0fd Thu Sep 26 2019 04:20:25 -06:00 [kern_mgwd:info:2284] dsmdb_get_imp_1() on node failed: 169.254.5.219{ffffffff|ffffffff} prog=536873488 server=mgwd: RPC: Timed out; netid=tcp fd=684 TO=25.0s TT=25.001s O=828b I=0b CN=4858012/1 VSID=-3 169.254.5.219:910 00000074.0065edbf 243bb0fd Thu Sep 26 2019 04:20:25 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. Timeout: Operation "node_iterator::get_imp()" took longer than 25 seconds to complete [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065edc1 243bb0fd Thu Sep 26 2019 04:20:26 -06:00 [kern_mgwd:info:2284] W [src/rdb/quorum/rpccom.cc 397 (0x81d1df200)]: qmpoll_1 rpc to 1001 failed: 5: qmpoll_1: RPC: Timed out; netid=tcp fd=40 TO=8.0s TT=8.002s O=680b I=0b CN=4858015/1 VSID=-3 169.254.8.83:7816 00000074.0065edc2 243bb0fd Thu Sep 26 2019 04:20:26 -06:00 [kern_mgwd:info:2284] qmpoll_1: RPC: Timed out; netid=tcp fd=40 TO=8.0s TT=8.002s O=680b I=0b CN=4858015/1 VSID=-3 169.254.8.83:7816 00000074.0065edc5 243bb157 Thu Sep 26 2019 04:20:35 -06:00 [kern_mgwd:info:2284] W [src/rdb/quorum/rpccom.cc 397 (0x81ccadc00)]: qmpoll_1 rpc to 1001 failed: 5: qmpoll_1: RPC: Timed out; netid=tcp fd=40 TO=8.0s TT=8.002s O=680b I=0b CN=4858016/1 VSID=-3 169.254.5.219:7816 00000074.0065edc6 243bb157 Thu Sep 26 2019 04:20:35 -06:00 [kern_mgwd:info:2284] qmpoll_1: RPC: Timed out; netid=tcp fd=40 TO=8.0s TT=8.002s O=680b I=0b CN=4858016/1 VSID=-3 169.254.5.219:7816 00000074.0065edc9 243bb1b1 Thu Sep 26 2019 04:20:44 -06:00 [kern_mgwd:info:2284] W [src/rdb/quorum/rpccom.cc 397 (0x81ccad200)]: qmpoll_1 rpc to 1001 failed: 5: qmpoll_1: RPC: Timed out; netid=tcp fd=40 TO=8.0s TT=8.001s O=680b I=0b CN=4858018/1 VSID=-3 169.254.8.83:7816 00000074.0065edca 243bb1b1 Thu Sep 26 2019 04:20:44 -06:00 [kern_mgwd:info:2284] qmpoll_1: RPC: Timed out; netid=tcp fd=40 TO=8.0s TT=8.001s O=680b I=0b CN=4858018/1 VSID=-3 169.254.8.83:7816 00000074.0065edcd 243bb215 Thu Sep 26 2019 04:20:53 -06:00 [kern_mgwd:info:2284] W [src/rdb/quorum/rpccom.cc 397 (0x81ccae600)]: qmpoll_1 rpc to 1001 failed: 5: qmpoll_1: RPC: Timed out; netid=tcp fd=40 TO=8.0s TT=8.001s O=680b I=0b CN=4858019/1 VSID=-3 169.254.5.219:7816 00000074.0065edce 243bb215 Thu Sep 26 2019 04:20:53 -06:00 [kern_mgwd:info:2284] qmpoll_1: RPC: Timed out; netid=tcp fd=40 TO=8.0s TT=8.001s O=680b I=0b CN=4858019/1 VSID=-3 169.254.5.219:7816 00000074.0065edd2 243bb265 Thu Sep 26 2019 04:21:02 -06:00 [kern_mgwd:info:2284] W [src/rdb/quorum/rpccom.cc 397 (0x81ccad700)]: qmpoll_1 rpc to 1001 failed: 5: qmpoll_1: RPC: Timed out; netid=tcp fd=40 TO=8.0s TT=8.001s O=680b I=0b CN=4858020/1 VSID=-3 169.254.8.83:7816 00000074.0065edd3 243bb265 Thu Sep 26 2019 04:21:02 -06:00 [kern_mgwd:info:2284] qmpoll_1: RPC: Timed out; netid=tcp fd=40 TO=8.0s TT=8.001s O=680b I=0b CN=4858020/1 VSID=-3 169.254.8.83:7816 00000074.0065edd6 243bb2bf Thu Sep 26 2019 04:21:11 -06:00 [kern_mgwd:info:2284] W [src/rdb/quorum/rpccom.cc 397 (0x81ccaeb00)]: qmpoll_1 rpc to 1001 failed: 5: qmpoll_1: RPC: Timed out; netid=tcp fd=40 TO=8.0s TT=8.000s O=680b I=0b CN=4858022/1 VSID=-3 169.254.5.219:7816 00000074.0065edd7 243bb2bf Thu Sep 26 2019 04:21:11 -06:00 [kern_mgwd:info:2284] qmpoll_1: RPC: Timed out; netid=tcp fd=40 TO=8.0s TT=8.000s O=680b I=0b CN=4858022/1 VSID=-3 169.254.5.219:7816 00000074.0065edda 243bb319 Thu Sep 26 2019 04:21:20 -06:00 [kern_mgwd:info:2284] W [src/rdb/quorum/rpccom.cc 397 (0x81ccae100)]: qmpoll_1 rpc to 1001 failed: 5: qmpoll_1: RPC: Timed out; netid=tcp fd=40 TO=8.0s TT=8.000s O=680b I=0b CN=4858024/1 VSID=-3 169.254.8.83:7816 00000074.0065eddb 243bb319 Thu Sep 26 2019 04:21:20 -06:00 [kern_mgwd:info:2284] qmpoll_1: RPC: Timed out; netid=tcp fd=40 TO=8.0s TT=8.000s O=680b I=0b CN=4858024/1 VSID=-3 169.254.8.83:7816 00000074.0065eddd 243bb355 Thu Sep 26 2019 04:21:25 -06:00 [kern_mgwd:info:2284] dsmdb_get_imp_1() on node failed: 169.254.5.219{ffffffff|ffffffff} prog=536873488 server=mgwd: RPC: Timed out; netid=tcp fd=684 TO=25.0s TT=25.000s O=828b I=0b CN=4858021/1 VSID=-3 169.254.5.219:910 00000074.0065edde 243bb355 Thu Sep 26 2019 04:21:25 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. Timeout: Operation "node_iterator::get_imp()" took longer than 25 seconds to complete [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065ede0 243bb373 Thu Sep 26 2019 04:21:29 -06:00 [kern_mgwd:info:2284] W [src/rdb/quorum/rpccom.cc 397 (0x81d1df200)]: qmpoll_1 rpc to 1001 failed: 5: qmpoll_1: RPC: Timed out; netid=tcp fd=40 TO=8.0s TT=8.000s O=680b I=0b CN=4858027/1 VSID=-3 169.254.5.219:7816 00000074.0065ede1 243bb373 Thu Sep 26 2019 04:21:29 -06:00 [kern_mgwd:info:2284] qmpoll_1: RPC: Timed out; netid=tcp fd=40 TO=8.0s TT=8.000s O=680b I=0b CN=4858027/1 VSID=-3 169.254.5.219:7816 00000074.0065ede2 243bb375 Thu Sep 26 2019 04:21:30 -06:00 [kern_mgwd:info:2284] Info: create_imp: d-blade upcall requestBreakQuorum, lif migrate 00000074.0065ede3 243bb375 Thu Sep 26 2019 04:21:30 -06:00 [kern_mgwd:info:2284] A [src/rdb/unit.cc 2802 (0x81b245100)]: requestBreakQuorum: failed node nmg-fas8040-02 00000074.0065f2e7 243bb37b Thu Sep 26 2019 04:21:30 -06:00 [kern_mgwd:info:2284] 0x81b6a7e00: 0: NOTICE: Tables:web: reconf_cluster_proxy_async (local): Reconfiguration is now in progress 00000074.0065f2ea 243bb37b Thu Sep 26 2019 04:21:30 -06:00 [kern_mgwd:info:2284] 0x81b6aab00: 0: NOTICE: Tables:web: Starting cluster proxy reconfig thread is_all_nodes=0 00000074.0065f2ee 243bb37b Thu Sep 26 2019 04:21:30 -06:00 [kern_mgwd:info:2284] 0x81b6aab00: 0: INFO: SFO_Ready|Cluster_Apps: wait_for_apps_online (waiter: RECONF_CLUSTER_PROXY_THREAD) apps: mgwd vldb vifmgr bcomd crs, maxTime 60 sec: starting 00000074.0065f2ef 243bb37b Thu Sep 26 2019 04:21:30 -06:00 [kern_mgwd:info:2284] 0x81b6aab00: 0: INFO: SFO_Ready|Cluster_Apps: wait_for_apps_online (RECONF_CLUSTER_PROXY_THREAD): vldb is online. Number of tries: 1. 00000074.0065f2fb 243bb37b Thu Sep 26 2019 04:21:30 -06:00 [kern_mgwd:info:2284] 0x81b6aab00: 0: INFO: SFO_Ready|Cluster_Apps: wait_for_apps_online (RECONF_CLUSTER_PROXY_THREAD): bcomd is online. Number of tries: 1. 00000074.0065f30a 243bb37b Thu Sep 26 2019 04:21:30 -06:00 [kern_mgwd:info:2284] 0x81b6aab00: 0: INFO: SFO_Ready|Cluster_Apps: wait_for_apps_online (RECONF_CLUSTER_PROXY_THREAD): crs is online. Number of tries: 1. 00000074.0065f313 243bb37b Thu Sep 26 2019 04:21:30 -06:00 [kern_mgwd:info:2284] A [src/rdb/TM.cc 4705 (0x81b6a8300)]: requestBreakQuorum: destinations 1 src 1000 _localId 1000 failedId 1001 _epoch 0 00000074.0065f339 243bb37c Thu Sep 26 2019 04:21:30 -06:00 [kern_mgwd:info:2284] A [src/rdb/TM.cc 4712 (0x81b6a8300)]: QM status 55 (UNIT_OFFLINE) on '_qmP->getQuorumSnapshot(_epoch, &masterId, NULL)' 00000074.0065f33e 243bb37c Thu Sep 26 2019 04:21:30 -06:00 [kern_mgwd:info:2284] E [src/rdb/TM.cc 4714 (0x81b6a8300)]: requestBreakQuorum: getQuorumSnapshot failed UNIT_OFFLINE _epoch 0 00000074.0065f44c 243bb3a6 Thu Sep 26 2019 04:21:30 -06:00 [kern_mgwd:info:2284] 0x81b6a8300: 0: ERR: RPCServer: mgwd_xml_start_1_svc: Called for asup_pathname(/mroot/etc/log/autosupport/201909260421.0.files) 00000074.0065f44d 243bb3a6 Thu Sep 26 2019 04:21:30 -06:00 [kern_mgwd:info:2284] 0x81b6a8300: 0: ERR: RPCServer: mgwd_xml_start_1_svc: current_asup_xml exists. State: (2) 00000074.0065f44e 243bb3a6 Thu Sep 26 2019 04:21:30 -06:00 [kern_mgwd:info:2284] 0x81b6a8300: 0: ERR: RPCServer: mgwd_xml_start_1_svc: ASUP Started SUCCESS 00000074.0065f458 243bb3a6 Thu Sep 26 2019 04:21:32 -06:00 [kern_mgwd:info:2284] Info: create_imp: d-blade upcall requestBreakQuorum, lif migrate 00000074.0065f459 243bb3a6 Thu Sep 26 2019 04:21:32 -06:00 [kern_mgwd:info:2284] A [src/rdb/unit.cc 2802 (0x81b6aba00)]: requestBreakQuorum: failed node nmg-fas8040-02 00000074.0065f462 243bb3a6 Thu Sep 26 2019 04:21:32 -06:00 [kern_mgwd:info:2284] A [src/rdb/TM.cc 4705 (0x81b244c00)]: requestBreakQuorum: destinations 1 src 1000 _localId 1000 failedId 1001 _epoch 0 00000074.0065f463 243bb3a6 Thu Sep 26 2019 04:21:32 -06:00 [kern_mgwd:info:2284] A [src/rdb/TM.cc 4712 (0x81b244c00)]: QM status 55 (UNIT_OFFLINE) on '_qmP->getQuorumSnapshot(_epoch, &masterId, NULL)' 00000074.0065f464 243bb3a6 Thu Sep 26 2019 04:21:32 -06:00 [kern_mgwd:info:2284] E [src/rdb/TM.cc 4714 (0x81b244c00)]: requestBreakQuorum: getQuorumSnapshot failed UNIT_OFFLINE _epoch 0 00000074.0065f46b 243bb3a6 Thu Sep 26 2019 04:21:32 -06:00 [kern_mgwd:info:2284] 0x81ccadc00: 0: NOTICE: RpcConnectionCache: markFailure: markFailure: New Quarantine for 169.254.8.83:536874273(rdb_management_qm)/1[tcp]{fffffffd|ffffffff} with timeout(2.000s) Reason:: RPC: Remote system error - Operation timed out 00000074.0065f488 243bb3a7 Thu Sep 26 2019 04:21:34 -06:00 [kern_mgwd:info:2284] A [src/rdb/HAM.cc 1567 (0x81d1dfc00)]: HAM: Entering HA-active. 00000074.0065f48a 243bb3a7 Thu Sep 26 2019 04:21:35 -06:00 [kern_mgwd:info:2284] A [src/rdb/quorum/qm_states/qm_out_waiting_for_votes.cc 81 (0x81d1df700)]: WaitingForVotesState::state2: WS_WaitingForVotes -> WS_BecomingMaster 00000074.0065f48b 243bb3a7 Thu Sep 26 2019 04:21:35 -06:00 [kern_mgwd:info:2284] A [src/rdb/quorum/qm_states/qm_out_replying_out_of_quorum.cc 222 (0x81d1df700)]: ReplyingOutOfQuorumState::stateUp2ReplyingOutOfQuorum: WS_WaitingForVotes -> WS_BecomingMaster 00000074.0065f48c 243bb3a7 Thu Sep 26 2019 04:21:35 -06:00 [kern_mgwd:info:2284] A [src/rdb/quorum/qm_states/qm_out_out_of_quorum.cc 61 (0x81d1df700)]: OutOfQuorumState::stateUp2OutOfQuorum: WS_WaitingForVotes -> WS_BecomingMaster 00000074.0065f48d 243bb3a7 Thu Sep 26 2019 04:21:35 -06:00 [kern_mgwd:info:2284] 0x81ccad200: 0: NOTICE: RpcConnectionCache: markFailure: markFailure: New Quarantine for 169.254.5.219:536874273(rdb_management_qm)/1[tcp]{fffffffd|ffffffff} with timeout(2.000s) Reason:: RPC: Remote system error - Operation timed out 00000074.0065f48e 243bb3a7 Thu Sep 26 2019 04:21:35 -06:00 [kern_mgwd:info:2284] A [src/rdb/quorum/qm_states/qm_state.cc 552 (0x81d1df700)]: stateTrans: WS_WaitingForVotes -> WS_BecomingMaster at: 60789238s 00000074.0065f48f 243bb3a7 Thu Sep 26 2019 04:21:35 -06:00 [kern_mgwd:info:2284] A [src/rdb/quorum/quorumimpl.cc 2214 (0x81d1df700)]: masterNewEpochUpcall QM Upcall status: Offline ==> Master Epoch: 5 => 6 isFastPath 1 isFastPathOverride 0 membershipDisabled: 0 00000074.0065f490 243bb3a7 Thu Sep 26 2019 04:21:35 -06:00 [kern_mgwd:info:2284] A [src/rdb/quorum/qm_states/qm_in_becoming_master.cc 103 (0x81d1df700)]: BecomingMasterState::state2: WS_BecomingMaster -> WS_HoldingQuorum 00000074.0065f491 243bb3a7 Thu Sep 26 2019 04:21:35 -06:00 [kern_mgwd:info:2284] A [src/rdb/quorum/qm_states/qm_state.cc 552 (0x81d1df700)]: stateTrans: WS_BecomingMaster -> WS_HoldingQuorum at: 60789238s 00000074.0065f492 243bb3a7 Thu Sep 26 2019 04:21:35 -06:00 [kern_mgwd:info:2284] A [src/rdb/unit_local.cc 1547 (0x81ccacd00)]: setEpoch: unit file epoch 5 => 6 00000074.0065f493 243bb3a7 Thu Sep 26 2019 04:21:35 -06:00 [kern_mgwd:info:2284] A [src/rdb/RM.cc 877 (0x81d1e0100)]: RM 1000: Recovery begins for epoch 6. 00000074.0065f494 243bb3a7 Thu Sep 26 2019 04:21:35 -06:00 [kern_mgwd:info:2284] A [src/rdb/cluster_events.cc 78 (0x81d1e0100)]: Cluster event: cluster-event, epoch 6, site 1000 [distributed recovery begins]. 00000074.0065f495 243bb3a7 Thu Sep 26 2019 04:21:35 -06:00 [kern_mgwd:info:2284] A [src/rdb/unit_local.cc 935 (0x81d1e0100)]: LU: Attempt to establish quiescent state for recovery. 00000074.0065f496 243bb3a7 Thu Sep 26 2019 04:21:35 -06:00 [kern_mgwd:info:2284] A [src/rdb/unit_local.cc 957 (0x81d1e0100)]: LU: Successfully quiesced the local unit for recovery. 00000074.0065f497 243bb3a7 Thu Sep 26 2019 04:21:35 -06:00 [kern_mgwd:info:2284] A [src/rdb/RM.cc 1402 (0x81d1e0100)]: RM 1000: Master running recovery in epoch 6; local version <5,981471>, target quorum version <5,981471>. 00000074.0065f498 243bb3a7 Thu Sep 26 2019 04:21:35 -06:00 [kern_mgwd:info:2284] A [src/rdb/RM.cc 1743 (0x81d1e0100)]: RM 1000: distributeDBSet<5,981471> to quorum members, running recovery 1. 00000074.0065f499 243bb3a7 Thu Sep 26 2019 04:21:35 -06:00 [kern_mgwd:info:2284] A [src/rdb/cluster_events.cc 78 (0x81d1e0100)]: Cluster event: cluster-event, epoch 6, site 1000 [prepared to become master under HA-active]. 00000074.0065f49a 243bb3a7 Thu Sep 26 2019 04:21:35 -06:00 [kern_mgwd:info:2284] A [src/rdb/cluster_events.cc 78 (0x81d1e0100)]: Cluster event: cluster-event, epoch 6, site 1000 [distributed recovery succeeded]. 00000074.0065f49b 243bb3a7 Thu Sep 26 2019 04:21:35 -06:00 [kern_mgwd:info:2284] A [src/rdb/TM.cc 1721 (0x81d1e0100)]: TM 1000: change role at epoch 6 to 0x120 recovery transaction number 0 00000074.0065f49c 243bb3a7 Thu Sep 26 2019 04:21:35 -06:00 [kern_mgwd:info:2284] A [src/rdb/TM.cc 1480 (0x81d1e0100)]: TM 1000: Report UNIT_IS_MASTER (epoch 6, master 1000). 00000074.0065f49d 243bb3a7 Thu Sep 26 2019 04:21:35 -06:00 [kern_mgwd:info:2284] A [src/rdb/TM.cc 1491 (0x81d1e0100)]: FAILOVER rdb: Local unit Management online 00000074.0065f49e 243bb3a7 Thu Sep 26 2019 04:21:35 -06:00 [kern_mgwd:info:2284] A [src/rdb/cluster_events.cc 78 (0x81d1e0100)]: Cluster event: node-event, epoch 6, site 1000 [local node online (master)]. 00000074.0065f49f 243bb3a7 Thu Sep 26 2019 04:21:35 -06:00 [kern_mgwd:info:2284] A [src/rdb/cluster_events.cc 78 (0x81d1e0100)]: Cluster event: cluster-quorum-begins, epoch 6, site 1000 []. 00000074.0065f4a0 243bb3a7 Thu Sep 26 2019 04:21:35 -06:00 [kern_mgwd:info:2284] Notice: online_status_callback: RDB unit is online as Master 00000074.0065f4a1 243bb3a7 Thu Sep 26 2019 04:21:35 -06:00 [kern_mgwd:info:2284] A [src/rdb/cluster_events.cc 78 (0x81d1e0100)]: Cluster event: node-online, epoch 6, site 1000 [Healthy/Total: 1/2]. 00000074.0065f4a2 243bb3a7 Thu Sep 26 2019 04:21:35 -06:00 [kern_mgwd:info:2284] 0x81d1e0600: 0: INFO: RDB::callback::registrar: callback:src/rdb/rdb_online_registrar.cc:81 rdb_callbacks::ONLINE::BEGIN:: 60789247145 00000074.0065f4a3 243bb3a7 Thu Sep 26 2019 04:21:35 -06:00 [kern_mgwd:info:2284] 0x81d1e0600: 0: INFO: RDB::callback::registrar: callback:src/rdb/rdb_online_registrar.cc:106 rdb_callbacks::ONLINE::END:: 60789247145 00000074.0065f4a4 243bb3a7 Thu Sep 26 2019 04:21:35 -06:00 [kern_mgwd:info:2284] 0x81d1e1f00: 0: INFO: EMS::MgwdNdTableSync: mgwd_nd_table_synchronizer::update_notifyd_table: re-sync'ing all tables in notifyd... 00000074.0065f4a5 243bb3a7 Thu Sep 26 2019 04:21:35 -06:00 [kern_mgwd:info:2284] 0x81a9f1d00: 0: INFO: license_v2: onlineInitCallback: RDB online callback, status= 0 00000074.0065f4bb 243bb3a7 Thu Sep 26 2019 04:21:35 -06:00 [kern_mgwd:info:2284] 0x81d1e1f00: 0: INFO: EMS::MgwdNdTableSync: mgwd_nd_table_synchronizer::clearNdTables: all tables in notifyd successfully cleared. 00000074.0065f4bc 243bb3a7 Thu Sep 26 2019 04:21:35 -06:00 [kern_mgwd:info:2284] 0x81d1e1f00: 0: INFO: EMS::DEST_CALLBACK: ems_nd_event_destination_synchronizer::update_notifyd_table: re-sync'ing notifyd table. 00000074.0065f4bd 243bb3a7 Thu Sep 26 2019 04:21:35 -06:00 [kern_mgwd:info:2284] 0x81d1e1f00: 0: INFO: EMS::DEST_CALLBACK: ems_nd_event_destination_synchronizer::update_notifyd_table: Updating snmp-traphost 00000074.0065f4c2 243bb3a7 Thu Sep 26 2019 04:21:35 -06:00 [kern_mgwd:info:2284] 0x81d1e1f00: 0: INFO: EMS::DEST_CALLBACK: ems_nd_event_destination_synchronizer::update_notifyd_table: Successfully updated notifyd table. 00000074.0065f4c3 243bb3a7 Thu Sep 26 2019 04:21:35 -06:00 [kern_mgwd:info:2284] 0x81d1e1f00: 0: INFO: EMS::FILTER_CALLBACK: ems_nd_event_filter_synchronizer::update_notifyd_table: re-sync'ing notifyd tables. 00000074.0065f4c8 243bb3a7 Thu Sep 26 2019 04:21:35 -06:00 [kern_mgwd:info:2284] 0x81d1e1f00: 0: INFO: EMS::FILTER_CALLBACK: ems_nd_event_filter_synchronizer::update_notifyd_table: Successfully updated notifyd table. 00000074.0065f4c9 243bb3a7 Thu Sep 26 2019 04:21:35 -06:00 [kern_mgwd:info:2284] 0x81d1e1f00: 0: INFO: EMS::NOTIFICATION_CALLBACK: ems_nd_event_notification_synchronizer::update_notifyd_table: re-sync'ing notifyd table. 00000074.0065f4cf 243bb3a7 Thu Sep 26 2019 04:21:35 -06:00 [kern_mgwd:info:2284] 0x81d1e1f00: 0: INFO: EMS::NOTIFICATION_CALLBACK: ems_nd_event_notification_synchronizer::update_notifyd_table: Successfully updated notifyd table. 00000074.0065f4d0 243bb3a7 Thu Sep 26 2019 04:21:35 -06:00 [kern_mgwd:info:2284] 0x81d1e1f00: 0: INFO: EMS::router_tables: ems_notifyd_log_config_synchronizer::update_notifyd_table: re-sync'ing notifyd table. 00000074.0065f4d3 243bb3a7 Thu Sep 26 2019 04:21:35 -06:00 [kern_mgwd:info:2284] 0x81d1e1f00: 0: INFO: EMS::router_tables: ems_notifyd_log_config_synchronizer::update_notifyd_table: Successfully updated notifyd table. 00000074.0065f4d4 243bb3a7 Thu Sep 26 2019 04:21:35 -06:00 [kern_mgwd:info:2284] 0x81d1e1f00: 0: INFO: EMS::MgwdNdTableSync: mgwd_nd_table_synchronizer::performResync: all tables in notifyd re-sync'ed successfully. 00000074.0065f4d5 243bb3a7 Thu Sep 26 2019 04:21:35 -06:00 [kern_mgwd:info:2284] 0x81a9f1d00: 0: ERR: license_v2: failed to register upgrade check for check_node_capacity_licenses 00000074.0065f4d6 243bb3a7 Thu Sep 26 2019 04:21:35 -06:00 [kern_mgwd:info:2284] 0x81a9f1d00: 0: ERR: license_v2: failed to register upgrade check for check_node_capacity_licenses 00000074.0065f4d7 243bb3a7 Thu Sep 26 2019 04:21:35 -06:00 [kern_mgwd:info:2284] 0x81a9f1d00: 0: ERR: license_v2: failed to register upgrade check for check_node_capacity_licenses 00000074.0065f4d8 243bb3a7 Thu Sep 26 2019 04:21:35 -06:00 [kern_mgwd:info:2284] 0x81a9f1d00: 0: ERR: license_v2: failed to register upgrade check for check_node_capacity_downgrade_licenses 00000074.0065f4d9 243bb3a7 Thu Sep 26 2019 04:21:35 -06:00 [kern_mgwd:info:2284] 0x81a9f1d00: 0: ERR: license_v2: failed to register upgrade check for check_node_subscription_licenses 00000074.0065f4da 243bb3a7 Thu Sep 26 2019 04:21:35 -06:00 [kern_mgwd:info:2284] 0x81a9f1d00: 0: ERR: license_v2: failed to register upgrade check for check_node_subscription_licenses 00000074.0065f4db 243bb3a7 Thu Sep 26 2019 04:21:35 -06:00 [kern_mgwd:info:2284] ASUP_CLUSTER_INFO: update_request(online callback: status:0) 00000074.0065f4dc 243bb3a7 Thu Sep 26 2019 04:21:35 -06:00 [kern_mgwd:info:2284] 0x81a9f1d00: 0: INFO: nonshared_clus_online_cb: join_unjoin_work:src/cluster_setup/nonshared_clus_online_cb.cc:238 Not a nonshared ha platform, nothing to do 00000074.0065f4dd 243bb3a7 Thu Sep 26 2019 04:21:35 -06:00 [kern_mgwd:info:2284] 0x81a9f1d00: 0: INFO: nonshared_clus_online_cb: eligibility_change_work:src/cluster_setup/nonshared_clus_online_cb.cc:271 Eligibility work: Not a nonshared ha platform, nothing to do 00000074.0065f4de 243bb3a7 Thu Sep 26 2019 04:21:35 -06:00 [kern_mgwd:info:2284] Debug: sync_rdb_and_cdb_iters: Calling next() on rdb and cdb iterators 00000074.0065f4df 243bb3a7 Thu Sep 26 2019 04:21:35 -06:00 [kern_mgwd:info:2284] Debug: sync_rdb_and_cdb_iters: Empty_rdb=false rdb_cmp_cdb=0 00000074.0065f4e0 243bb3a7 Thu Sep 26 2019 04:21:35 -06:00 [kern_mgwd:info:2284] Debug: sync_rdb_and_cdb_iters: Calling next() on rdb and cdb iterators 00000074.0065f4e1 243bb3a7 Thu Sep 26 2019 04:21:35 -06:00 [kern_mgwd:info:2284] Debug: sync_rdb_and_cdb_iters: Empty_rdb=false rdb_cmp_cdb=0 00000074.0065f4e2 243bb3a7 Thu Sep 26 2019 04:21:35 -06:00 [kern_mgwd:info:2284] Debug: sync_rdb_and_cdb_iters: Calling next() on rdb and cdb iterators 00000074.0065f4e3 243bb3a7 Thu Sep 26 2019 04:21:35 -06:00 [kern_mgwd:info:2284] Debug: sync_rdb_and_cdb_iters: Empty_rdb=false rdb_cmp_cdb=0 00000074.0065f4e4 243bb3a7 Thu Sep 26 2019 04:21:35 -06:00 [kern_mgwd:info:2284] Debug: sync_rdb_and_cdb_iters: Calling next() on rdb and cdb iterators 00000074.0065f4e5 243bb3a7 Thu Sep 26 2019 04:21:35 -06:00 [kern_mgwd:info:2284] 0x81a9f1d00: 0: ERR: MGWD::DNS: src/tables/name_services/dns.cc:1756:update_disablesoa_bootarg ERROR: failed to set kenv "bootarg.nameservices.DNSLB_Disable_SOA" to NULL due to No such file or directory 00000074.0065f4e6 243bb3a7 Thu Sep 26 2019 04:21:35 -06:00 [kern_mgwd:info:2284] 0x81a9f1d00: 0: INFO: Autosupport::Config: Successfully updated ASUP cert-directory to (/mroot/etc/vserver_4294967295/certificates/ssl/serverCa) for the node nmg-fas8040-01 00000074.0065f4e7 243bb3a7 Thu Sep 26 2019 04:21:35 -06:00 [kern_mgwd:info:2284] 0x81a9f1d00: 0: INFO: capability_kernel: online status callback capability_kernel status=0 00000074.0065f4e8 243bb3a7 Thu Sep 26 2019 04:21:35 -06:00 [kern_mgwd:info:2284] 0x81a9f1d00: 0: INFO: capability_kernel: Updating kernel with available capabilities 00000074.0065f4ed 243bb3b2 Thu Sep 26 2019 04:21:35 -06:00 [kern_mgwd:info:2284] 0x81b6a9200: 0: INFO: capability_kernel: Updating DATA_ONTAP.8.2.0 state 00000074.0065f4ee 243bb3b2 Thu Sep 26 2019 04:21:35 -06:00 [kern_mgwd:info:2284] 0x81b6a9200: 0: INFO: capability_kernel: Successfully updated DATA_ONTAP.8.2.0 state 00000074.0065f4ef 243bb3b2 Thu Sep 26 2019 04:21:35 -06:00 [kern_mgwd:info:2284] 0x81b6a9200: 0: INFO: capability_kernel: Updating DATA_ONTAP.8.2.1 state 00000074.0065f4f0 243bb3b2 Thu Sep 26 2019 04:21:35 -06:00 [kern_mgwd:info:2284] 0x81b6a9200: 0: INFO: capability_kernel: Successfully updated DATA_ONTAP.8.2.1 state 00000074.0065f4f1 243bb3b2 Thu Sep 26 2019 04:21:35 -06:00 [kern_mgwd:info:2284] 0x81b6a9200: 0: INFO: capability_kernel: Updating DATA_ONTAP.8.2.2 state 00000074.0065f4f2 243bb3b2 Thu Sep 26 2019 04:21:35 -06:00 [kern_mgwd:info:2284] 0x81b6a9200: 0: INFO: capability_kernel: Successfully updated DATA_ONTAP.8.2.2 state 00000074.0065f4f3 243bb3b2 Thu Sep 26 2019 04:21:35 -06:00 [kern_mgwd:info:2284] 0x81b6a9200: 0: INFO: capability_kernel: Updating DATA_ONTAP.8.2.3 state 00000074.0065f4f4 243bb3b2 Thu Sep 26 2019 04:21:35 -06:00 [kern_mgwd:info:2284] 0x81b6a9200: 0: INFO: capability_kernel: Successfully updated DATA_ONTAP.8.2.3 state 00000074.0065f4f5 243bb3b2 Thu Sep 26 2019 04:21:35 -06:00 [kern_mgwd:info:2284] 0x81b6a9200: 0: INFO: capability_kernel: Updating DATA_ONTAP.8.2.4 state 00000074.0065f4f6 243bb3b2 Thu Sep 26 2019 04:21:35 -06:00 [kern_mgwd:info:2284] 0x81b6a9200: 0: INFO: capability_kernel: Successfully updated DATA_ONTAP.8.2.4 state 00000074.0065f4f7 243bb3b2 Thu Sep 26 2019 04:21:35 -06:00 [kern_mgwd:info:2284] 0x81b6a9200: 0: INFO: capability_kernel: Updating DATA_ONTAP.8.3.0 state 00000074.0065f4f8 243bb3b2 Thu Sep 26 2019 04:21:35 -06:00 [kern_mgwd:info:2284] 0x81b6a9200: 0: INFO: capability_kernel: Successfully updated DATA_ONTAP.8.3.0 state 00000074.0065f4f9 243bb3b2 Thu Sep 26 2019 04:21:35 -06:00 [kern_mgwd:info:2284] 0x81b6a9200: 0: INFO: capability_kernel: Updating DATA_ONTAP.8.3.0I1 state 00000074.0065f4fa 243bb3b2 Thu Sep 26 2019 04:21:35 -06:00 [kern_mgwd:info:2284] 0x81b6a9200: 0: INFO: capability_kernel: Successfully updated DATA_ONTAP.8.3.0I1 state 00000074.0065f4fb 243bb3b2 Thu Sep 26 2019 04:21:35 -06:00 [kern_mgwd:info:2284] 0x81b6a9200: 0: INFO: capability_kernel: Updating DATA_ONTAP.8.3.1 state 00000074.0065f4fc 243bb3b2 Thu Sep 26 2019 04:21:35 -06:00 [kern_mgwd:info:2284] 0x81b6a9200: 0: INFO: capability_kernel: Successfully updated DATA_ONTAP.8.3.1 state 00000074.0065f4fd 243bb3b2 Thu Sep 26 2019 04:21:35 -06:00 [kern_mgwd:info:2284] 0x81b6a9200: 0: INFO: capability_kernel: Updating DATA_ONTAP.8.3.2 state 00000074.0065f4ff 243bb3b2 Thu Sep 26 2019 04:21:35 -06:00 [kern_mgwd:info:2284] 0x81b6a9200: 0: INFO: capability_kernel: Successfully updated DATA_ONTAP.8.3.2 state 00000074.0065f500 243bb3b2 Thu Sep 26 2019 04:21:35 -06:00 [kern_mgwd:info:2284] 0x81b6a9200: 0: INFO: capability_kernel: Updating DATA_ONTAP.8.3.3 state 00000074.0065f501 243bb3b2 Thu Sep 26 2019 04:21:35 -06:00 [kern_mgwd:info:2284] 0x81b6a9200: 0: INFO: capability_kernel: Successfully updated DATA_ONTAP.8.3.3 state 00000074.0065f502 243bb3b2 Thu Sep 26 2019 04:21:35 -06:00 [kern_mgwd:info:2284] 0x81b6a9200: 0: INFO: capability_kernel: Updating DATA_ONTAP.8.4.0 state 00000074.0065f503 243bb3b2 Thu Sep 26 2019 04:21:35 -06:00 [kern_mgwd:info:2284] A [src/rdb/HAM.cc 1233 (0x81a9f1d00)]: checkHASFOConfigVerbose: haConfigured: True, result HA_AGENT_CONFIGURED. 00000074.0065f504 243bb3b2 Thu Sep 26 2019 04:21:35 -06:00 [kern_mgwd:info:2284] 0x81da81100: 0: ALERT: Table::vserver: flush_clusfs_cache 2404 mgwd online notification sent to clusfs. Action: 2, vsID: -1, name: nmg-fas8040, length: 14 00000074.0065f505 243bb3b2 Thu Sep 26 2019 04:21:35 -06:00 [kern_mgwd:debug:2284] upgrademgr_event_callback::database_online_callback - invoked; [ANDU_LOG at src/tables/cluster_image.cc:6583 in 'database_online_callback'] 00000074.0065f506 243bb3b2 Thu Sep 26 2019 04:21:35 -06:00 [kern_mgwd:info:2284] upgrademgr_event_callback::run - UNIT_IS_MASTER; [ANDU_LOG at src/tables/cluster_image.cc:6339 in 'run'] 00000074.0065f507 243bb3b2 Thu Sep 26 2019 04:21:35 -06:00 [kern_mgwd:info:2284] upgrademgr_event_callback::run - txn.create() returned: success { ANDU_LOG in run() at src/tables/cluster_image.cc:6355 } 00000074.0065f508 243bb3b2 Thu Sep 26 2019 04:21:35 -06:00 [kern_mgwd:info:2284] upgrademgr_event_callback::run - Created the transaction. { ANDU_LOG in run() at src/tables/cluster_image.cc:6368 } 00000074.0065f509 243bb3b2 Thu Sep 26 2019 04:21:35 -06:00 [kern_mgwd:info:2284] 0x81b6a9200: 0: INFO: capability_kernel: Successfully updated DATA_ONTAP.8.4.0 state 00000074.0065f50a 243bb3b2 Thu Sep 26 2019 04:21:35 -06:00 [kern_mgwd:info:2284] 0x81b6a9200: 0: INFO: capability_kernel: Updating DATA_ONTAP.8.4.1 state 00000074.0065f50b 243bb3b2 Thu Sep 26 2019 04:21:35 -06:00 [kern_mgwd:info:2284] isLocalNodeMgmtRingMaster: Local node is rdb ring master, returning true { ANDU_LOG in isLocalNodeOnlineAndMgmtRingMaster() at src/tables/cluster_image.cc:6285 } 00000074.0065f50c 243bb3b2 Thu Sep 26 2019 04:21:35 -06:00 [kern_mgwd:info:2284] upgrademgr_event_callback::run - Local node is online and Mgmt Ring Master { ANDU_LOG in run() at src/tables/cluster_image.cc:6374 } 00000074.0065f50d 243bb3b2 Thu Sep 26 2019 04:21:35 -06:00 [kern_mgwd:info:2284] upgrademgr_event_callback::run - updated the MUM node info { ANDU_LOG in run() at src/tables/cluster_image.cc:6397 } 00000074.0065f50e 243bb3b2 Thu Sep 26 2019 04:21:35 -06:00 [kern_mgwd:info:2284] 0x81b6a9200: 0: INFO: capability_kernel: Successfully updated DATA_ONTAP.8.4.1 state 00000074.0065f50f 243bb3b2 Thu Sep 26 2019 04:21:35 -06:00 [kern_mgwd:info:2284] 0x81b6a9200: 0: INFO: capability_kernel: Updating DATA_ONTAP.9.0.0 state 00000074.0065f510 243bb3b2 Thu Sep 26 2019 04:21:35 -06:00 [kern_mgwd:debug:2284] upgrademgr_event_callback::database_update_callback - invoked; [ANDU_LOG at src/tables/cluster_image.cc:6529 in 'database_update_callback'] 00000074.0065f511 243bb3b2 Thu Sep 26 2019 04:21:35 -06:00 [kern_mgwd:info:2284] 0x81b6a9200: 0: INFO: capability_kernel: Successfully updated DATA_ONTAP.9.0.0 state 00000074.0065f512 243bb3b2 Thu Sep 26 2019 04:21:35 -06:00 [kern_mgwd:info:2284] upgrademgr_event_callback::run - transaction committed. { ANDU_LOG in run() at src/tables/cluster_image.cc:6399 } 00000074.0065f513 243bb3b2 Thu Sep 26 2019 04:21:35 -06:00 [kern_mgwd:info:2284] 0x81b6a9200: 0: INFO: capability_kernel: Updating DATA_ONTAP.9.1.0.RC2 state 00000074.0065f514 243bb3b2 Thu Sep 26 2019 04:21:35 -06:00 [kern_mgwd:info:2284] 0x81b6a9200: 0: INFO: capability_kernel: Successfully updated DATA_ONTAP.9.1.0.RC2 state 00000074.0065f515 243bb3b2 Thu Sep 26 2019 04:21:35 -06:00 [kern_mgwd:info:2284] 0x81b6a9200: 0: INFO: capability_kernel: Updating DATA_ONTAP.9.2.0 state 00000074.0065f516 243bb3b2 Thu Sep 26 2019 04:21:35 -06:00 [kern_mgwd:info:2284] 0x81b6a9200: 0: INFO: capability_kernel: Successfully updated DATA_ONTAP.9.2.0 state 00000074.0065f517 243bb3b2 Thu Sep 26 2019 04:21:35 -06:00 [kern_mgwd:info:2284] upgrademgr_event_callback::database_update_callback - event: TableName: upgrade_manager_rdb RowIdentifier: Operation: 0; [ANDU_LOG at src/tables/cluster_image.cc:6569 in 'database_update_callback'] 00000074.0065f51c 243bb3b2 Thu Sep 26 2019 04:21:35 -06:00 [kern_mgwd:info:2284] upgrademgr_event_callback::run Created new event TableName: upgrade_manager_rdb RowIdentifier: Operation: 0 { ANDU_LOG in run() at src/tables/cluster_image.cc:6507 } 00000074.0065f52a 243bb3b2 Thu Sep 26 2019 04:21:36 -06:00 [kern_mgwd:info:2284] 0x81da83900: 0: NOTICE: RpcConnectionCache: markFailure: markFailure: New Quarantine for 169.254.5.219:536873488(mgwd)/1[tcp]{fffffffd|4} with timeout(5.000s) Reason:: RPC: Remote system error - Operation timed out 00000074.0065f545 243bb3b2 Thu Sep 26 2019 04:21:36 -06:00 [kern_mgwd:info:2284] 0x81b6aba00: 0: NOTICE: Tables:web: reconf_cluster_proxy_async (local): Reconfiguration is already in progress 00000074.0065f546 243bb3b2 Thu Sep 26 2019 04:21:36 -06:00 [kern_mgwd:info:2284] 0x81b6aab00: 0: INFO: SFO_Ready|Cluster_Apps: wait_for_apps_online (RECONF_CLUSTER_PROXY_THREAD): mgwd is online. Number of tries: 4. 00000074.0065f5b7 243bb3b2 Thu Sep 26 2019 04:21:36 -06:00 [kern_mgwd:info:2284] 0x81a9f1d00: 0: DEBUG: ntpd: signal_ntp_peer_update:1356 00000074.0065f5b8 243bb3b2 Thu Sep 26 2019 04:21:36 -06:00 [kern_mgwd:info:2284] 0x81a9f1d00: 0: DEBUG: ntpd: signal_ntp_update:1328 signal_ntp_update 00000074.0065f5b9 243bb3b2 Thu Sep 26 2019 04:21:36 -06:00 [kern_mgwd:info:2284] 0x81b147800: 0: DEBUG: ntpd: updateNtpConf:922 called 00000074.0065f5ba 243bb3b2 Thu Sep 26 2019 04:21:36 -06:00 [kern_mgwd:info:2284] 0x81b147800: 0: DEBUG: ntpd: updateNtpConf:932 evaluate_ntp_address: 0 00000074.0065f5bb 243bb3b2 Thu Sep 26 2019 04:21:36 -06:00 [kern_mgwd:info:2284] 0x81b147800: 0: DEBUG: ntpd: find_desired_config:752 old mapping 10.0.0.2 to 10.0.0.2 00000074.0065f5bc 243bb3b2 Thu Sep 26 2019 04:21:36 -06:00 [kern_mgwd:info:2284] 0x81b147800: 0: DEBUG: ntpd: updateNtpConf:984 no changes 00000074.0065f5bd 243bb3b2 Thu Sep 26 2019 04:21:36 -06:00 [kern_mgwd:info:2284] 0x81b147800: 0: DEBUG: ntpd: startNtpDaemon:295 Checking/starting NTPd 00000074.0065f5be 243bb3b2 Thu Sep 26 2019 04:21:36 -06:00 [kern_mgwd:info:2284] Info: online_status_callback: sp user refresh - online status = 0 00000074.0065f5bf 243bb3b2 Thu Sep 26 2019 04:21:36 -06:00 [kern_mgwd:info:2284] Info: online_status_callback: sp user refresh - db versions are same 00000074.0065f5c2 243bb3b2 Thu Sep 26 2019 04:21:36 -06:00 [kern_mgwd:info:2284] 0x81b147800: 0: DEBUG: ntpd: startNtpDaemon:326 spm state: 1 00000074.0065f5c3 243bb3b2 Thu Sep 26 2019 04:21:36 -06:00 [kern_mgwd:info:2284] 0x81b147800: 0: DEBUG: ntpd: startNtpDaemon:336 NTPd is 'running', OKAY 00000074.0065f5d7 243bb3b2 Thu Sep 26 2019 04:21:36 -06:00 [kern_mgwd:info:2284] 0x81a9f1d00: 0: ERR: tables::exports_cache: online_callback:src/tables/exports_cache.cc:1396 Failed to get mgwd exports ngbyhost rdb iter 00000074.0065f5d8 243bb3b2 Thu Sep 26 2019 04:21:36 -06:00 [kern_mgwd:info:2284] 0x81da83400: 0: WARNING: job_manager::job_store: flush_caches:src/job_store_support.cc:428 rdb_transaction: flush_caches discarded as job_manager is_waiting_for_online_cb 00000074.0065f5d9 243bb3b2 Thu Sep 26 2019 04:21:36 -06:00 [kern_mgwd:info:2284] 0x81a9f1d00: 0: ERR: tables::exports_cache: online_callback:src/tables/exports_cache.cc:2580 Failed to get exports journal setting rdb iter 00000074.0065f5da 243bb3b2 Thu Sep 26 2019 04:21:36 -06:00 [kern_mgwd:info:2284] 0x81a9f1d00: 0: ERR: FlexCache: **************online status callback status=0********** 00000074.0065f5db 243bb3b2 Thu Sep 26 2019 04:21:36 -06:00 [kern_mgwd:info:2284] 0x81b141900: 0: NOTICE: mgwd: [hashdReplayInternal][entry][no-retry-run] index-mask: [0001] 00000074.0065f5dc 243bb3b2 Thu Sep 26 2019 04:21:36 -06:00 [kern_mgwd:info:2284] 0x81b141900: 0: NOTICE: mgwd: [virtual bool HashdReplayInfo::replayAtBoot()] destination is latest; no operation to do 00000074.0065f5dd 243bb3b2 Thu Sep 26 2019 04:21:36 -06:00 [kern_mgwd:info:2284] 0x81b141900: 0: NOTICE: mgwd: [hashdReplayInternal][ exit][no-retry-run] index-mask: [0000], result: [success] 00000074.0065f5de 243bb3b2 Thu Sep 26 2019 04:21:36 -06:00 [kern_mgwd:info:2284] 0x81b6af100: 0: NOTICE: tables::fpolicy_replay: [virtual bool FpolicyReplayInfo::replayAtBoot()] destination is latest,refreshing mirror only 00000074.0065f5df 243bb3b2 Thu Sep 26 2019 04:21:36 -06:00 [kern_mgwd:info:2284] 0x81b141900: 0: NOTICE: mgwd: [hashdReplayInternal][entry][retry-run] index-mask: [0000] 00000074.0065f5e0 243bb3b2 Thu Sep 26 2019 04:21:36 -06:00 [kern_mgwd:info:2284] 0x81b141900: 0: NOTICE: mgwd: [hashdReplayInternal][ exit][retry-run] index-mask: [0000], result: [success] 00000074.0065f5e6 243bb3b2 Thu Sep 26 2019 04:21:36 -06:00 [kern_mgwd:info:2284] 0x81b6af100: 0: NOTICE: tables::fpolicy_replay: [virtual bool FpolicyReplayInfo::replayAtBoot()] destination is latest,refreshing mirror only 00000074.0065f5e7 243bb3b2 Thu Sep 26 2019 04:21:36 -06:00 [kern_mgwd:info:2284] 0x81da83400: 0: NOTICE: epsilon_transition_job: queue_epsilon_transition_job:src/tables/cluster_management/epsilon_transition.cc:183 The job was queued successfully with id 6bc6f38a-e047-11e9-93b8-00a09857ee8f. 00000074.0065f5e8 243bb3b2 Thu Sep 26 2019 04:21:36 -06:00 [kern_mgwd:info:2284] 0x81d1e3d00: 0: WARNING: job_manager::job_sched: process_add:src/job_sched.cc:373 UIID:8853 UUID:6bc6f38a-e047-11e9-93b8-00a09857ee8f name:Epsilon Transition Job rc:1 Cannot process cluster job as RDB is offline last_owner=00000000-0000-0000-0000-000000000000 00000074.0065f5e9 243bb3b2 Thu Sep 26 2019 04:21:36 -06:00 [kern_mgwd:info:2284] 0x81b6af100: 0: NOTICE: tables::fpolicy_replay: [virtual bool FpolicyReplayInfo::replayAtBoot()] destination is latest,refreshing mirror only 00000074.0065f5ea 243bb3ca Thu Sep 26 2019 04:21:36 -06:00 [kern_mgwd:info:2284] 0x81b6af100: 0: NOTICE: tables::fpolicy_replay: [virtual bool FpolicyReplayInfo::replayAtBoot()] destination is latest,refreshing mirror only 00000074.0065f5eb 243bb3ca Thu Sep 26 2019 04:21:36 -06:00 [kern_mgwd:info:2284] 0x81b6af100: 0: NOTICE: tables::fpolicy_replay: [virtual bool FpolicyReplayInfo::replayAtBoot()] destination is latest,refreshing mirror only 00000074.0065f5ec 243bb3ca Thu Sep 26 2019 04:21:36 -06:00 [kern_mgwd:info:2284] 0x81b6af100: 0: NOTICE: tables::fpolicy_replay: [virtual bool FPolicyKSMFReplayInfo::replayAtBoot()] destination is latest; no operation to do 00000074.0065f5ed 243bb3ca Thu Sep 26 2019 04:21:36 -06:00 [kern_mgwd:info:2284] 0x81b6af100: 0: NOTICE: tables::fpolicy_replay: [virtual bool FPolicyKSMFReplayInfo::replayAtBoot()] destination is latest; no operation to do 00000074.0065f5ee 243bb3ca Thu Sep 26 2019 04:21:36 -06:00 [kern_mgwd:info:2284] 0x81b6af100: 0: NOTICE: tables::fpolicy_replay: [virtual bool FPolicyKSMFReplayInfo::replayAtBoot()] destination is latest; no operation to do 00000074.0065f5ef 243bb3ca Thu Sep 26 2019 04:21:36 -06:00 [kern_mgwd:info:2284] 0x81b6af100: 0: NOTICE: tables::fpolicy_replay: [virtual bool FPolicyKSMFReplayInfo::replayAtBoot()] destination is latest; no operation to do 00000074.0065f5f0 243bb3ca Thu Sep 26 2019 04:21:36 -06:00 [kern_mgwd:info:2284] 0x81b6af100: 0: NOTICE: tables::fpolicy_replay: [virtual bool FPolicyKSMFReplayInfo::replayAtBoot()] destination is latest; no operation to do 00000074.0065f5f1 243bb3ca Thu Sep 26 2019 04:21:36 -06:00 [kern_mgwd:info:2284] 0x81b6af100: 0: NOTICE: tables::fpolicy_replay: [virtual bool FPolicyKSMFReplayInfo::replayAtBoot()] destination is latest; no operation to do 00000074.0065f5f2 243bb3ca Thu Sep 26 2019 04:21:36 -06:00 [kern_mgwd:info:2284] 0x81b6af100: 0: NOTICE: tables::fpolicy_replay: [virtual bool FPolicyKSMFReplayInfo::replayAtBoot()] destination is latest; no operation to do 00000074.0065f5f3 243bb3ca Thu Sep 26 2019 04:21:36 -06:00 [kern_mgwd:info:2284] 0x81b6af100: 0: NOTICE: tables::fpolicy_replay: [virtual bool FPolicyKSMFReplayInfo::replayAtBoot()] destination is latest; no operation to do 00000074.0065f5f4 243bb3ca Thu Sep 26 2019 04:21:36 -06:00 [kern_mgwd:info:2284] 0x81b6af100: 0: NOTICE: tables::fpolicy_replay: [virtual bool FPolicyKSMFReplayInfo::replayAtBoot()] destination is latest; no operation to do 00000074.0065f5f9 243bb3ca Thu Sep 26 2019 04:21:36 -06:00 [kern_mgwd:info:2284] 0x81a9f1d00: 0: NOTICE: misc_node_info: src/tables/misc_node_info_view.cc:onlineEvent:167 misc_node_info onlineCallback 00000074.0065f5fa 243bb3ca Thu Sep 26 2019 04:21:36 -06:00 [kern_mgwd:info:2284] 0x81a9f1d00: 0: NOTICE: Net::Vserver: NetVserver::online_status_callback: taking ownership of NetVserverQueue. 00000074.0065f5fb 243bb3ca Thu Sep 26 2019 04:21:36 -06:00 [kern_mgwd:info:2284] 0x81a9f1d00: 0: NOTICE: Net::Vserver: NetVserver::refresh_status_local: scheduling a full refresh. 00000074.0065f5fc 243bb3ca Thu Sep 26 2019 04:21:36 -06:00 [kern_mgwd:info:2284] 0x81da81600: 0: WARNING: job_manager::job_store: flush_caches:src/job_store_support.cc:428 rdb_transaction: flush_caches discarded as job_manager is_waiting_for_online_cb 00000074.0065f5fd 243bb3ca Thu Sep 26 2019 04:21:36 -06:00 [kern_mgwd:info:2284] 0x81a9f1d00: 0: NOTICE: Net::Vserver: NetVserverQueue::schedule_refresh: scheduled a refresh for 0 vservers. 00000074.0065f5fe 243bb3ca Thu Sep 26 2019 04:21:36 -06:00 [kern_mgwd:info:2284] 0x81a9f1d00: 0: NOTICE: Net::Vserver: NetVserverQueue::schedule_refresh: skipping refresh for 1 vservers with status missing. 00000074.0065f5ff 243bb3ca Thu Sep 26 2019 04:21:36 -06:00 [kern_mgwd:info:2284] A [src/rdb/TM.cc 3094 (0x81d1eab00)]: RW-transaction TID <6,6,6> held by client 1000 for 8 seconds (created: 60789240s, now: 60789248s) (label 'job_manager job enqueue'). 00000074.0065f606 243bb3cb Thu Sep 26 2019 04:21:36 -06:00 [kern_mgwd:info:2284] 0x81a9f1d00: 0: NOTICE: Net::Vserver: NetVserver::refresh_status_local: ERROR: failed to schedule a full refresh: The operational status of 1 vserver(s) could not be determined. All LIFs belonging to those vservers will maintain their current state. 00000074.0065f607 243bb3cb Thu Sep 26 2019 04:21:36 -06:00 [kern_mgwd:info:2284] 0x81a9f1d00: 0: INFO: Net::: switchless cluster online callback: unit is master 00000074.0065f608 243bb3cb Thu Sep 26 2019 04:21:36 -06:00 [kern_mgwd:info:2284] 0x81a9f1d00: 0: ERR: mf_usage: Feature NFS already has a registered callback, unregister first before re-registering 00000074.0065f609 243bb3cb Thu Sep 26 2019 04:21:36 -06:00 [kern_mgwd:info:2284] 0x81da81b00: 0: INFO: Net::: static void *netopts_switchless_cluster_iterator::kernel_to_rdb(void *): kernel switchless is currently disabled and bootarg is set to false. Setting kernel to disabled 00000074.0065f60a 243bb3cb Thu Sep 26 2019 04:21:36 -06:00 [kern_mgwd:info:2284] 0x81a9f1d00: 0: NOTICE: TABLES::qos: Resetting QoS configuration state 00000074.0065f60b 243bb3cb Thu Sep 26 2019 04:21:36 -06:00 [kern_mgwd:info:2284] 0x81a9f1d00: 0: ERR: SAN::AIX_SUPPORT: src/tables/san/san_aix_support_capability.cc:Check:218 capability not enabled on every node of the cluster 00000074.0065f60c 243bb3cb Thu Sep 26 2019 04:21:36 -06:00 [kern_mgwd:info:2284] snapshot_policy: online status callback status=0 00000074.0065f60f 243bb3cb Thu Sep 26 2019 04:21:36 -06:00 [kern_mgwd:info:2284] 0x81b6ad300: 0: ERR: job_manager::job_mgr_job_ops: action:src/job_mgr_job_ops.cc:115 job: 65643957-b79d-11e7-9b07-00a09857ee8f: kick returned 19 00000074.0065f610 243bb3cb Thu Sep 26 2019 04:21:36 -06:00 [kern_mgwd:info:2284] 0x81b6ad300: 0: ERR: tables:snapmirror: snapmirror_utils::startServiceJobOnRdbOnline: queued and kicked SnapMirror Service Job. 00000074.0065f612 243bb3cb Thu Sep 26 2019 04:21:36 -06:00 [kern_mgwd:info:2284] A [src/rdb/TM.cc 3094 (0x81da89800)]: RW-transaction TID <6,8,8> held by client 1000 for 8 seconds (created: 60789240s, now: 60789248s) (label 'SP: rdb-info-update lock'). 00000074.0065f627 243bb3cb Thu Sep 26 2019 04:21:36 -06:00 [kern_mgwd:info:2284] rebaseline_stream:Thu Sep 26 04:21:36 2019:src/tables/vserverdr/common/synthetic_method_handling.cc:76 (thr_id:0x81a9f1d00) 0x81a9f1d00: online_callback, Entry 00000074.0065f629 243bb3cb Thu Sep 26 2019 04:21:36 -06:00 [kern_mgwd:info:2284] rebaseline_stream:Thu Sep 26 04:21:36 2019:src/tables/vserverdr/common/synthetic_method_handling.cc:76 (thr_id:0x81a9f1d00) 0x81a9f1d00: checkMasterAndSpawnThread, Entry 00000074.0065f62c 243bb3cb Thu Sep 26 2019 04:21:36 -06:00 [kern_mgwd:info:2284] rebaseline_stream:Thu Sep 26 04:21:36 2019:src/tables/vserverdr/common/synthetic_method_handling.cc:76 (thr_id:0x81a9f1d00) 0x81a9f1d00: checkMasterAndSpawnThread, No Entries in the trigger_baseline_generation RDB 00000074.0065f62d 243bb3cb Thu Sep 26 2019 04:21:36 -06:00 [kern_mgwd:info:2284] 0x81b6ace00: 0: ERR: fabricdatacollector::storage_switch: not creating fdc job, ishaoscmcc: false, ishaoscmcc check err = success {in onlineCallbackWorkerThread() at src/tables/storage_switch.cc:9264} 00000074.0065f65d 243bb3cb Thu Sep 26 2019 04:21:36 -06:00 [kern_mgwd:info:2284] 0x81da81600: 0: WARNING: job_manager::sched_db: get_next_scheduler:src/sched_db.cc:442 Unable to retrieve next scheduler (by name) weekly with vserver nmg-fas8040, owner nmg-fas8040, clusterid: 635f71dd-b79d-11e7-9b07-00a09857ee8f: entry doesn't exist 00000074.0065f65e 243bb3cb Thu Sep 26 2019 04:21:36 -06:00 [kern_mgwd:info:2284] 0x81d1eab00: 0: NOTICE: Net::Vserver: NetVserverQueue::UpdateTask::_updateNode: returning immediately: success 00000074.0065f65f 243bb3cb Thu Sep 26 2019 04:21:36 -06:00 [kern_mgwd:info:2284] 0x81d1eab00: 0: NOTICE: Net::Vserver: NetVserverQueue::UpdateTask::_updateNode: skipping node nmg-fas8040-02 because it is offline 00000074.0065f660 243bb3cb Thu Sep 26 2019 04:21:36 -06:00 [kern_mgwd:info:2284] 0x81da89800: 0: WARNING: job_manager::job_store: flush_caches:src/job_store_support.cc:428 rdb_transaction: flush_caches discarded as job_manager is_waiting_for_online_cb 00000074.0065f661 243bb3cb Thu Sep 26 2019 04:21:36 -06:00 [kern_mgwd:info:2284] 0x81da89800: 0: WARNING: tables::job_proxy: failed to queue cluster-affinity SP Certificate Expiry Check Job job: Job exists 00000074.0065f662 243bb3cb Thu Sep 26 2019 04:21:36 -06:00 [kern_mgwd:info:2284] 0x81da89800: 0: ERR: MGWD:sp_mgmt: queue_spCertVfy_thread: sp_cert: Cannot queue sp certificate expiry verification job. Error : Job exists(6). 00000074.0065f663 243bb3cb Thu Sep 26 2019 04:21:36 -06:00 [kern_mgwd:debug:2284] online_callback: Failed: VMHOSTINFO failed with error - could not read sysctl 'hw.smbios.uuid'. 00000074.0065f664 243bb3cb Thu Sep 26 2019 04:21:36 -06:00 [kern_mgwd:info:2284] 0x81a9f1d00: 0: ERR: RBAC::login: src/tables/vs_userprofile.cc:2843 calling online_callback status 0 00000074.0065f666 243bb3cb Thu Sep 26 2019 04:21:36 -06:00 [kern_mgwd:info:2284] 0x81a9f1d00: 0: ERR: RBAC::login: killall xinetd happened 00000074.0065f667 243bb3cb Thu Sep 26 2019 04:21:36 -06:00 [kern_mgwd:info:2284] 0x81a9f1d00: 0: DEBUG: function_start_end_time_log: Start online_callback: 00000074.0065f668 243bb3cb Thu Sep 26 2019 04:21:36 -06:00 [kern_mgwd:info:2284] 0x81a9f1d00: 0: INFO: VserverStackConfig: void (anonymous namespace)::get_kernel_vsid_set(std::set &): found vsid: 4, 4294967280, 4294967289, 4294967292, 4294967293, 4294967294, 4294967295, 00000074.0065f669 243bb3cb Thu Sep 26 2019 04:21:36 -06:00 [kern_mgwd:info:2284] 0x81a9f1d00: 0: INFO: VserverStackConfig: void (anonymous namespace)::add_stack_vsid(uint32_t, uint32_t, smdb_type_vstype): successfully added vsid 4294967293, ipsid 4294967294 to stack 00000074.0065f672 243bb3cb Thu Sep 26 2019 04:21:36 -06:00 [kern_mgwd:info:2284] 0x81a9f1d00: 0: DEBUG: function_start_end_time_log: End online_callback: total elapsed time in milliseconds is 7 00000074.0065f677 243bb3cb Thu Sep 26 2019 04:21:36 -06:00 [kern_mgwd:info:2284] 0x81a9f1d00: 0: INFO: vserverdr_failover: src/tables/vserverdr/svmdr/vserverdr_failover.cc:87 on_online_status_cb In online callback 00000074.0065f678 243bb3cb Thu Sep 26 2019 04:21:36 -06:00 [kern_mgwd:info:2284] 0x81b6ad300: 0: ALERT: Table::vserver: flush_clusfs_cache 2399 mgwd online notification sent to clusfs. Action: 4 00000074.0065f679 243bb3cb Thu Sep 26 2019 04:21:36 -06:00 [kern_mgwd:info:2284] 0x81a9f1d00: 0: NOTICE: Tables:web: Synchronizing the web server configuration from the cluster to the nodes 00000074.0065f67a 243bb3cb Thu Sep 26 2019 04:21:36 -06:00 [kern_mgwd:info:2284] 0x81b6af600: 0: INFO: vserverdr_failover: src/tables/vserverdr/svmdr/vserverdr_failover.cc:129 spawn_failover_thread Master node: nmg-fas8040-01 is healthy 00000074.0065f67b 243bb3cb Thu Sep 26 2019 04:21:36 -06:00 [kern_mgwd:info:2284] 0x81b6af600: 0: INFO: vserverdr_failover: src/tables/vserverdr/svmdr/vserverdr_failover.cc:148 spawn_failover_thread Node nmg-fas8040-02 went offline 00000074.0065f67c 243bb3cb Thu Sep 26 2019 04:21:36 -06:00 [kern_mgwd:info:2284] 0x81da87f00: 0: ERR: metrocluster::utils: mccDRCOperation get() failed - entry doesn't exist {in isClusterInSbRecovery() at src/tables/metrocluster_utils.cc:2376} 00000074.0065f67d 243bb3cb Thu Sep 26 2019 04:21:36 -06:00 [kern_mgwd:info:2284] 0x81da87f00: 0: ERR: Table::vserver: has_remote_cluster_done_switchover failed with err = Internal error: Unable to determine waiting-for-switchback mode - entry doesn't exist 00000074.0065f67e 243bb3cb Thu Sep 26 2019 04:21:36 -06:00 [kern_mgwd:info:2284] 0x81da87f00: 0: ERR: Net::Vserver: NetVserver::refresh_status: ERROR: failed to schedule refresh for target node NULL: Failed to contact remote application mgmt: Reason Process is not quorum master. 00000074.0065f67f 243bb3cb Thu Sep 26 2019 04:21:36 -06:00 [kern_mgwd:info:2284] 0x81da87f00: 0: ERR: Table::vserver: vserver_operational src/tables/vservermgmt/vserver.cc:1012Network Start/Stop Scheduled: Failed to contact remote application mgmt: Reason Process is not quorum master. 00000074.0065f680 243bb3cb Thu Sep 26 2019 04:21:36 -06:00 [kern_mgwd:info:2284] vserver_operational:Thu Sep 26 04:21:36 2019:src/tables/vservermgmt/vserver.cc:722 (thr_id:0x81da87f00) Setting operational state in online callback 00000074.0065f681 243bb3cb Thu Sep 26 2019 04:21:36 -06:00 [kern_mgwd:info:2284] vserver_operational:Thu Sep 26 04:21:36 2019:src/tables/vserverdr/common/clusterRebootHandler.cc:93 (thr_id:0x81da87f00) Getting cluster reboot info:success 00000074.0065f682 243bb3cb Thu Sep 26 2019 04:21:36 -06:00 [kern_mgwd:info:2284] vserver_operational:Thu Sep 26 04:21:36 2019:src/tables/vservermgmt/vserver.cc:805 (thr_id:0x81da87f00) Vserver operational state changed. Vserver Main_SVM state: running 00000074.0065f683 243bb3cb Thu Sep 26 2019 04:21:36 -06:00 [kern_mgwd:info:2284] vserver_operational:Thu Sep 26 04:21:36 2019:src/tables/vservermgmt/vserver.cc:1012 (thr_id:0x81da87f00) Network Start/Stop Scheduled: Failed to contact remote application mgmt: Reason Process is not quorum master. 00000074.0065f684 243bb3cb Thu Sep 26 2019 04:21:36 -06:00 [kern_mgwd:info:2284] publickey_rdb: online status callback status=0 00000074.0065f685 243bb3cb Thu Sep 26 2019 04:21:37 -06:00 [kern_mgwd:info:2284] Warning: "vserver services name-service unix-group file show" will not be accessible. 00000074.0065f686 243bb3cb Thu Sep 26 2019 04:21:37 -06:00 [kern_mgwd:info:2284] Set the access to "all" if you want to allow it. 00000074.0065f687 243bb3cb Thu Sep 26 2019 04:21:37 -06:00 [kern_mgwd:info:2284] Warning: "vserver services name-service unix-user file show" will not be accessible. 00000074.0065f688 243bb3cb Thu Sep 26 2019 04:21:37 -06:00 [kern_mgwd:info:2284] Set the access to "all" if you want to allow it. 00000074.0065f689 243bb3cb Thu Sep 26 2019 04:21:37 -06:00 [kern_mgwd:info:2284] 0x81b24b000: 0: ERR: RBAC::Roles: Stored version 9_2_0 : Current version 9_2_0. File : src/tables/vserverrbac/vs_profile.cc 00000074.0065f68a 243bb3cb Thu Sep 26 2019 04:21:38 -06:00 [kern_mgwd:info:2284] 0x81b244200: 0: NOTICE: RpcConnectionCache: markFailure: markFailure: New Quarantine for 169.254.5.219:536873508(kernel)/1[tcp]{fffffffd|4} with timeout(5.000s) Reason:: RPC: Remote system error - Operation timed out 00000074.0065f68b 243bb3e6 Thu Sep 26 2019 04:21:39 -06:00 [kern_mgwd:info:2284] 0x81b13f100: 0: NOTICE: QOS::rpc: QoS reset: processing: 6 policy groups 00000074.0065f68c 243bb3e6 Thu Sep 26 2019 04:21:39 -06:00 [kern_mgwd:info:2284] 0x81b13f100: 0: NOTICE: QOS::rpc: QoS ksmf - 6 policy groups were sent (trans 1) to kernel 00000074.0065f68d 243bb3e6 Thu Sep 26 2019 04:21:39 -06:00 [kern_mgwd:info:2284] 0x81b13f100: 0: NOTICE: QOS::rpc: QoS reset: processing: 36 workloads 00000074.0065f68e 243bb3e6 Thu Sep 26 2019 04:21:39 -06:00 [kern_mgwd:info:2284] 0x81b13f100: 0: NOTICE: QOS::rpc: QoS ksmf - 36 workloads were sent (trans 1) to kernel 00000074.0065f6e0 243bb3e6 Thu Sep 26 2019 04:21:40 -06:00 [kern_mgwd:info:2284] 0x81b6aab00: 0: INFO: SFO_Ready|Cluster_Apps: wait_for_apps_online (RECONF_CLUSTER_PROXY_THREAD): vifmgr is online. Number of tries: 6. 00000074.0065f6e1 243bb3e6 Thu Sep 26 2019 04:21:40 -06:00 [kern_mgwd:info:2284] 0x81b6aab00: 0: INFO: SFO_Ready|Cluster_Apps: wait_for_apps_online (RECONF_CLUSTER_PROXY_THREAD): vifmgr is in running state. Number of tries: 6. 00000074.0065f6e2 243bb3e6 Thu Sep 26 2019 04:21:40 -06:00 [kern_mgwd:info:2284] 0x81b6aab00: 0: INFO: SFO_Ready|Cluster_Apps: wait_for_apps_online (waiter: RECONF_CLUSTER_PROXY_THREAD): Finished after 5 tries. 00000074.0065f6e3 243bb3e6 Thu Sep 26 2019 04:21:40 -06:00 [kern_mgwd:info:2284] 0x81b6aab00: 0: NOTICE: Tables:web: SMF DSMDB service ready 00000074.0065f704 243bb3e6 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] 0x81da83900: 0: NOTICE: RpcConnectionCache: markFailure: markFailure: New Quarantine for 169.254.8.83:536873488(mgwd)/1[tcp]{fffffffd|4} with timeout(5.000s) Reason:: RPC: Remote system error - Operation timed out 00000074.0065f705 243bb3e6 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Remote system error [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f706 243bb3e6 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f707 243bb3e6 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f708 243bb3e6 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f709 243bb3e6 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f70a 243bb3e6 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f70b 243bb3e6 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f70c 243bb3e6 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f70d 243bb3e6 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f70e 243bb3e6 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f70f 243bb3e6 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f710 243bb3e6 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f711 243bb3e6 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f712 243bb3e6 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f713 243bb3e6 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f714 243bb3e6 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f715 243bb3e6 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f716 243bb3e6 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f717 243bb3e6 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f718 243bb3e6 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f719 243bb3e6 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f71a 243bb3e6 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f71b 243bb3e6 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f71c 243bb3e6 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f71d 243bb3e6 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f71e 243bb3e6 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f71f 243bb3e6 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f720 243bb3e6 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f721 243bb3e6 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f722 243bb3e6 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f723 243bb3e6 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f724 243bb3e6 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f725 243bb3e6 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f726 243bb3e6 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f727 243bb3e6 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f728 243bb3e6 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f729 243bb3e6 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f72a 243bb3e6 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f72b 243bb3e6 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f72c 243bb3e6 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f72d 243bb3e6 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f72e 243bb3e6 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f72f 243bb3e6 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f730 243bb3e6 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f731 243bb3e6 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f732 243bb3e6 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f733 243bb3e6 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f734 243bb3e6 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f735 243bb3e6 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f736 243bb3e6 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f737 243bb3e6 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f738 243bb3e6 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f739 243bb3e6 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f73a 243bb3e6 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f73b 243bb3e6 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f73c 243bb3e6 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f73d 243bb3e6 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f73e 243bb3e6 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f73f 243bb3e6 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f740 243bb3e6 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f741 243bb3e6 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f742 243bb3e6 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f743 243bb3e6 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f744 243bb3e6 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f745 243bb3e6 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f746 243bb3e6 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f747 243bb3e6 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f748 243bb3e6 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f749 243bb3e6 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f74a 243bb3e6 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f74b 243bb3e6 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f74c 243bb3e6 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f74d 243bb3e6 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f74e 243bb3e6 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f74f 243bb3e6 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f750 243bb3e6 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f751 243bb3e6 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f752 243bb3e6 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f753 243bb3e6 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f754 243bb3e6 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f755 243bb3e6 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f756 243bb3e6 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f757 243bb3e6 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f758 243bb3e6 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f759 243bb3e6 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f75a 243bb3e6 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f75b 243bb3e6 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f75c 243bb3e6 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f75d 243bb3e6 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f75e 243bb3e6 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f75f 243bb3e6 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f760 243bb3e6 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f761 243bb3e6 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f762 243bb3e6 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f763 243bb3e6 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] 0x81b244c00: 0: NOTICE: RpcConnectionCache: markFailure: markFailure: New Quarantine for 169.254.5.219:536873492(vifmgr)/1[tcp]{fffffffd|4} with timeout(5.000s) Reason:: RPC: Remote system error - Operation timed out 00000074.0065f764 243bb3e6 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f765 243bb3e6 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f766 243bb3e6 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f767 243bb3e6 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f768 243bb3e6 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f769 243bb3e6 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f76a 243bb3e6 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f76b 243bb3e6 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f76c 243bb3e6 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f76d 243bb3e6 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f76e 243bb3e6 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f76f 243bb3e6 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f770 243bb3e6 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f771 243bb3e6 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f772 243bb3e6 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f773 243bb3e6 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Remote system error [from mgwd on node "nmg-fas8040-01" (VSID: -3) to mgwd at 169.254.5.219] 00000074.0065f774 243bb3e6 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to mgwd at 169.254.5.219] 00000074.0065f775 243bb3e6 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] 0x81a9f1d00: 0: NOTICE: Tables:web: The web server configuration has been synchronized from the cluster to the nodes 00000074.0065f776 243bb3e6 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] 0x81a9f1d00: 0: NOTICE: Tables:web: reconf_cluster_proxy_async (local): Reconfiguration is already in progress 00000074.0065f777 243bb3e6 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] 0x81a9f1d00: 0: NOTICE: Tables:web: web_server_config online callback: Updating the proxy server 00000074.0065f778 243bb3e6 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f779 243bb3e6 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] 0x81a9f1d00: 0: INFO: license_v2: RDB online callback. status=0 00000074.0065f77a 243bb3e6 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] 0x81a9f1d00: 0: INFO: license_v2: onlineHandlerThread created to do work 00000074.0065f77b 243bb3e6 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] 0x81da88900: 0: INFO: license_v2: License online handler thread started 00000074.0065f77c 243bb3e6 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] A [src/rdb/TM.cc 3094 (0x81da84300)]: RW-transaction TID <6,18,18> held by client 1000 for 8 seconds (created: 60789245s, now: 60789253s) (label 'web_svc_ports_online'). 00000074.0065f77d 243bb3e6 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] Setting has been changed. 00000074.0065f77e 243bb3e6 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] Setting has been changed. 00000074.0065f77f 243bb3e6 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] 0x81a9f1d00: 0: INFO: MGWD::NDO: Processing RDB online callback. Online status is Master. 00000074.0065f780 243bb3e6 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] 0x81b6a9c00: 0: INFO: MGWD::NDO: Recived ONLINE event for NDO-Master. 00000074.0065f781 243bb3e6 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] 0x81a9f1d00: 0: WARNING: job_manager::job_ext: on_online_status_cb:src/job_ext.cc:512 on_online_status_cb 00000074.0065f782 243bb3e6 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] 0x81a9f1d00: 0: WARNING: job_manager::job_q: on_online_status_cb:src/job_q.cc:702 on_online_status_cb 00000074.0065f783 243bb3e6 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] 0x81a9f1d00: 0: WARNING: job_manager::job_sched: on_online_status_cb:src/job_sched.cc:1203 on_online_status_cb (0) 00000074.0065f784 243bb3e6 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] 0x81da88400: 0: NOTICE: Tables:web: Committed WSDB changes to web service ports 00000074.0065f785 243bb3e6 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] 0x81a9f1d00: 0: WARNING: job_manager::job_sched: on_online_status_cb:src/job_sched.cc:1241 found 12 pre-existing cluster jobs locally 00000074.0065f786 243bb3e6 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] 0x81a9f1d00: 0: WARNING: job_manager::job_sched: on_online_status_cb:src/job_sched.cc:1289 skipping job 176c861b-b79e-11e7-9b07-00a09857ee8f since we still own it 00000074.0065f787 243bb3e6 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] 0x81b6a9c00: 0: INFO: MGWD::NDO: Updating master entry in RDB. 00000074.0065f788 243bb3e6 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] 0x81a9f1d00: 0: WARNING: job_manager::job_sched: on_online_status_cb:src/job_sched.cc:1289 skipping job 4be41253-b85f-11e7-9b07-00a09857ee8f since we still own it 00000074.0065f789 243bb3e6 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] 0x81a9f1d00: 0: WARNING: job_manager::job_sched: on_online_status_cb:src/job_sched.cc:1289 skipping job 65643957-b79d-11e7-9b07-00a09857ee8f since we still own it 00000074.0065f78a 243bb3e6 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] 0x81a9f1d00: 0: WARNING: job_manager::job_sched: on_online_status_cb:src/job_sched.cc:1289 skipping job 6bcaefff-e047-11e9-93b8-00a09857ee8f since we still own it 00000074.0065f78b 243bb3e6 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] 0x81a9f1d00: 0: WARNING: job_manager::job_sched: on_online_status_cb:src/job_sched.cc:1325 potentially quiescing 0 jobs 00000074.0065f78c 243bb400 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] 0x81a9f1d00: 0: WARNING: job_manager::job_sched: on_online_status_cb:src/job_sched.cc:1335 potentially deleting 0 jobs 00000074.0065f78d 243bb400 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] 0x81a9f1d00: 0: WARNING: job_manager::job_sched: on_online_status_cb:src/job_sched.cc:1350 modifying 8 jobs 00000074.0065f78e 243bb400 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] 0x81a9f1d00: 0: WARNING: job_manager::job_sched: on_online_status_cb:src/job_sched.cc:1355 modifying job 176baaab-b79e-11e7-9b07-00a09857ee8f 00000074.0065f78f 243bb400 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] 0x81a9f1d00: 0: WARNING: job_manager::job_sched: on_online_status_cb:src/job_sched.cc:1355 modifying job 176c80e9-b79e-11e7-9b07-00a09857ee8f 00000074.0065f790 243bb400 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] 0x81a9f1d00: 0: WARNING: job_manager::job_sched: on_online_status_cb:src/job_sched.cc:1355 modifying job 489d5bff-b80c-11e7-964b-00a098573067 00000074.0065f791 243bb400 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] 0x81a9f1d00: 0: WARNING: job_manager::job_sched: on_online_status_cb:src/job_sched.cc:1355 modifying job 659699fb-b79d-11e7-9b07-00a09857ee8f 00000074.0065f792 243bb400 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] 0x81a9f1d00: 0: WARNING: job_manager::job_sched: on_online_status_cb:src/job_sched.cc:1355 modifying job adade7cf-b79d-11e7-9b07-00a09857ee8f 00000074.0065f793 243bb400 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] 0x81b6a9c00: 0: INFO: MGWD::NDO: Successfully updated NDO master. 00000074.0065f794 243bb400 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] 0x81a9f1d00: 0: WARNING: job_manager::job_sched: on_online_status_cb:src/job_sched.cc:1355 modifying job adaed760-b79d-11e7-9b07-00a09857ee8f 00000074.0065f795 243bb400 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] 0x81a9f1d00: 0: WARNING: job_manager::job_sched: on_online_status_cb:src/job_sched.cc:1355 modifying job adaf71a9-b79d-11e7-9b07-00a09857ee8f 00000074.0065f796 243bb400 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] 0x81a9f1d00: 0: WARNING: job_manager::job_sched: on_online_status_cb:src/job_sched.cc:1355 modifying job d9549764-b91b-11e7-8fa8-00a098573067 00000074.0065f797 243bb400 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] 0x81d1e0600: 0: INFO: MGWD::NDO: Processing RDB update callback for : 00000074.0065f798 243bb400 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] ^I Table Name - ndo_manager_rdb 00000074.0065f799 243bb400 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] ^I Operation Identifier - 0 00000074.0065f79a 243bb400 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] ^I Node - 00000074.0065f79b 243bb400 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] ^I Phase - 2 00000074.0065f79c 243bb400 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] ^I Phase Status - 10 00000074.0065f79d 243bb400 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] ^I Payload - . 00000074.0065f79e 243bb400 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] 0x81b6a9c00: 0: INFO: MGWD::NDO: Received UPDATE event for NDO-Master. 00000074.0065f79f 243bb400 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] 0x81b6a9c00: 0: INFO: MGWD::NDO: Checking whether any operation is initialized. 00000074.0065f7a0 243bb400 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] 0x81a9f1d00: 0: WARNING: job_manager::job_sched: on_online_status_cb:src/job_sched.cc:1365 adding 9 jobs 00000074.0065f7a1 243bb400 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f7a2 243bb400 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] 0x81a9f1d00: 0: WARNING: job_manager::job_sched: on_online_status_cb:src/job_sched.cc:1390 finished processing online cb 00000074.0065f7a3 243bb400 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] A [src/rdb/TM.cc 3094 (0x81d1e4200)]: RW-transaction TID <6,20,20> held by client 1000 for 8 seconds (created: 60789245s, now: 60789253s) (label 'job_manager job_sched check claimable'). 00000074.0065f7a4 243bb400 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] 0x81a9f1d00: 0: INFO: CPS: CPS server acquiring master duties {in acquire_master_duties() at src/cps/cps_server.cc:279} 00000074.0065f7a5 243bb400 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f7a6 243bb400 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] 0x81a9f1d00: 0: DEBUG: CPS: Successfully created CPS Notification thread {in start_notification_thread() at src/cps/cps_notification.cc:628} 00000074.0065f7a7 243bb400 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] 0x81a9f1d00: 0: DEBUG: CPS: Successfully activated the notification thread {in activate_notification_thread() at src/cps/cps_notification.cc:609} 00000074.0065f7a8 243bb400 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] 0x81a9f1d00: 0: DEBUG: CPS: Activating CPS worker thread {in startup() at src/cps/cps_server.cc:381} 00000074.0065f7a9 243bb400 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] imageVersion: 9.2, imageGeneration: 9, imageMajor: 2, imageMinor: 0; [ANDU_LOG at src/tables/cluster_image_utils.cc:399 in 'extractVersion'] 00000074.0065f7aa 243bb400 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f7ab 243bb400 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] 0x81b6ace00: 0: DEBUG: CPS_RDB_LOCK: lock Locking 00000074.0065f7ac 243bb400 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] 0x81b6ace00: 0: DEBUG: CPS_RDB_LOCK: unlock UnLocking 00000074.0065f7ad 243bb400 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] 0x81b6ace00: 0: INFO: CPS: Creating new CPS groups. {in create_new_groups() at src/cps/cps_server.cc:864} 00000074.0065f7ae 243bb400 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f7af 243bb400 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] 0x81b6ace00: 0: DEBUG: CPS: Capability cps.configuration_v1: enabled {in is_configuration_enabled() at src/cps/cps_server.cc:3888} 00000074.0065f7b0 243bb400 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] 0x81a9f1d00: 0: DEBUG: CPS: Successfully created worker thread {in start_worker_thread() at src/cps/cps_server.cc:2834} 00000074.0065f7b1 243bb400 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] 0x81b6ace00: 0: DEBUG: CPS: Creating groups for capability cps.configuration_v1 {in create_new_groups() at src/cps/cps_server.cc:877} 00000074.0065f7b2 243bb400 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] 0x81a9f1d00: 0: DEBUG: CPS: Successfully signalled worker thread {in activate_worker_thread() at src/cps/cps_server.cc:2869} 00000074.0065f7b3 243bb400 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] 0x81a9f1d00: 0: INFO: CPS: CPS server acquired master duties {in acquire_master_duties() at src/cps/cps_server.cc:286} 00000074.0065f7b4 243bb400 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] 0x81a9f1d00: 0: WARNING: FileReplication: FRS cross cluster agent acquiring master duties 00000074.0065f7b5 243bb400 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] 0x81a9f1d00: 0: WARNING: FileReplication: FRS cross cluster agent acquired master duties 00000074.0065f7b6 243bb400 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] Info: online_status_callback: sp user refresh - online status = 0 00000074.0065f7b7 243bb400 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] Info: online_status_callback: sp user refresh - db versions are same 00000074.0065f7b8 243bb400 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] 0x81b6afb00: 0: ERR: CR::Policy: Successfully initialized constituent scanner configuration 00000074.0065f7b9 243bb400 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] 0x81b6ace00: 0: DEBUG: CPS: Creating group config-replication-store {in create_group() at src/cps/cps_server.cc:967} 00000074.0065f7ba 243bb400 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] 0x81da89800: 0: ERR: CR::Policy: Successfully pushed notification logger configuration to Nblade 00000074.0065f7bb 243bb400 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] 0x81b6ace00: 0: ERR: rdb_glue: create_imp: duplicate key for 'cps_storage_area_group' 00000074.0065f7bc 243bb400 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f7bd 243bb400 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f7be 243bb400 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f7bf 243bb400 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] 0x81b6ace00: 0: ERR: rdb_glue: create_imp: duplicate key for 'cps_storage_area' 00000074.0065f7c0 243bb400 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] 0x81b6ace00: 0: ERR: rdb_glue: create_imp: duplicate key for 'cps_storage_area' 00000074.0065f7c1 243bb400 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f7c2 243bb400 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f7c3 243bb400 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f7c4 243bb400 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f7c5 243bb400 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f7c6 243bb400 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f7c7 243bb400 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f7c8 243bb400 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f7c9 243bb400 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f7ca 243bb400 Thu Sep 26 2019 04:21:41 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f7cb 243bb400 Thu Sep 26 2019 04:21:42 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f7cc 243bb400 Thu Sep 26 2019 04:21:42 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f7cd 243bb400 Thu Sep 26 2019 04:21:42 -06:00 [kern_mgwd:info:2284] 0x81b6ace00: 0: ERR: rdb_glue: create_imp: duplicate key for 'cps_storage_area' 00000074.0065f7ce 243bb400 Thu Sep 26 2019 04:21:42 -06:00 [kern_mgwd:info:2284] 0x81b6ace00: 0: ERR: rdb_glue: create_imp: duplicate key for 'cps_storage_area' 00000074.0065f7cf 243bb400 Thu Sep 26 2019 04:21:42 -06:00 [kern_mgwd:info:2284] 0x81b6ace00: 0: DEBUG: CPS: Creating group test-pre-registration-group {in create_group() at src/cps/cps_server.cc:967} 00000074.0065f7d0 243bb400 Thu Sep 26 2019 04:21:42 -06:00 [kern_mgwd:info:2284] 0x81b6ace00: 0: DEBUG: CPS: Creating group test-post-registration-group {in create_group() at src/cps/cps_server.cc:967} 00000074.0065f7d1 243bb400 Thu Sep 26 2019 04:21:42 -06:00 [kern_mgwd:info:2284] 0x81b6ace00: 0: DEBUG: CPS_RDB_LOCK: _init Locking 00000074.0065f7d2 243bb400 Thu Sep 26 2019 04:21:42 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f7d3 243bb400 Thu Sep 26 2019 04:21:42 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f7d4 243bb400 Thu Sep 26 2019 04:21:42 -06:00 [kern_mgwd:info:2284] 0x81b6ace00: 0: DEBUG: CPS: Check and do work - validate the active path for group config-replication-store {in check_and_do_work() at src/cps/cps_server.cc:4867} 00000074.0065f7d5 243bb400 Thu Sep 26 2019 04:21:42 -06:00 [kern_mgwd:info:2284] 0x81b6ace00: 0: DEBUG: CPS: Returning 1 from process check area status {in validate_active_path() at src/cps/cps_server_group.cc:3480} 00000074.0065f7d6 243bb400 Thu Sep 26 2019 04:21:42 -06:00 [kern_mgwd:info:2284] 0x81b6ace00: 0: DEBUG: CPS_RDB_LOCK: ~CpsRdbMonitor UnLocking 00000074.0065f7d7 243bb400 Thu Sep 26 2019 04:21:42 -06:00 [kern_mgwd:info:2284] 0x81b6ace00: 0: DEBUG: CPS: Returning DONE from check_and_do_work {in check_and_do_work() at src/cps/cps_server.cc:4892} 00000074.0065f7d8 243bb400 Thu Sep 26 2019 04:21:42 -06:00 [kern_mgwd:info:2284] 0x81b6ace00: 0: DEBUG: CPS_RDB_LOCK: lock Locking 00000074.0065f7d9 243bb400 Thu Sep 26 2019 04:21:42 -06:00 [kern_mgwd:info:2284] 0x81b6ace00: 0: DEBUG: CPS: Nothing to be done in worker thread {in worker() at src/cps/cps_server.cc:2921} 00000074.0065f7da 243bb400 Thu Sep 26 2019 04:21:42 -06:00 [kern_mgwd:info:2284] 0x81b6ace00: 0: DEBUG: CPS_RDB_LOCK: unlock UnLocking 00000074.0065f7db 243bb400 Thu Sep 26 2019 04:21:42 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f7dc 243bb400 Thu Sep 26 2019 04:21:42 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f7dd 243bb400 Thu Sep 26 2019 04:21:42 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f7de 243bb400 Thu Sep 26 2019 04:21:42 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f7df 243bb400 Thu Sep 26 2019 04:21:42 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f7e0 243bb400 Thu Sep 26 2019 04:21:42 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f7e1 243bb400 Thu Sep 26 2019 04:21:42 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f7e2 243bb400 Thu Sep 26 2019 04:21:42 -06:00 [kern_mgwd:info:2284] 0x81b13f100: 0: NOTICE: QOS::rpc: set_workloads_ksmf pg/workload reset end.Workload maintainer signaled. 00000074.0065f7e3 243bb400 Thu Sep 26 2019 04:21:42 -06:00 [kern_mgwd:info:2284] 0x81da85700: 0: NOTICE: QOS::rpc: Syncing user/auto qos workload data attributes 00000074.0065f7e4 243bb400 Thu Sep 26 2019 04:21:42 -06:00 [kern_mgwd:info:2284] 0x81da85700: 0: NOTICE: QOS::rpc: qos_workload_data_object_sync_driver: VLDB online. Resyncing data object configuration 00000074.0065f7e5 243bb400 Thu Sep 26 2019 04:21:42 -06:00 [kern_mgwd:info:2284] 0x81da85700: 0: NOTICE: QOS::rpc: qos_workload_data_object_sync_driver: Processing workloads for data object attribute sync 00000074.0065f7e6 243bb400 Thu Sep 26 2019 04:21:42 -06:00 [kern_mgwd:info:2284] 0x81da85700: 0: NOTICE: QOS::rpc: qos_workload_data_object_sync_driver: Sent 5 workload dobj updates to kernel 00000074.0065f7e7 243bb400 Thu Sep 26 2019 04:21:42 -06:00 [kern_mgwd:info:2284] 0x81da85700: 0: NOTICE: QOS::rpc: qos_workload_maintainer: QoS workload data object info sync succesful 00000074.0065f7e8 243bb400 Thu Sep 26 2019 04:21:43 -06:00 [kern_mgwd:info:2284] 0x81b244200: 0: NOTICE: RpcConnectionCache: markFailure: markFailure: New Quarantine for 169.254.8.83:536873508(kernel)/1[tcp]{fffffffd|4} with timeout(5.000s) Reason:: RPC: Remote system error - Operation timed out 00000074.0065f7ec 243bb43d Thu Sep 26 2019 04:21:44 -06:00 [kern_mgwd:info:2284] dsmdb_get_imp_1() on vifmgr_get_blade_info failed: 127.0.0.1{fffffffd|ffffffff} prog=536873492 server=vifmgr: RPC: Timed out; netid=tcp fd=693 TO=25.0s TT=25.000s O=388b I=0b CN=4858026/1 VSID=-3 127.0.0.1:911 00000074.0065f7ee 243bb43d Thu Sep 26 2019 04:21:45 -06:00 [kern_mgwd:info:2284] ASUP_CLUSTER_INFO: Cache update complete. Next timeout is 86400 seconds 00000074.0065f7ef 243bb43d Thu Sep 26 2019 04:21:45 -06:00 [kern_mgwd:info:2284] 0x81da87a00: 0: ERR: Tables:web: web_proxy_cluster_lifs: problem getting cluster_cj_status_view iterator 00000074.0065f7f3 243bb43d Thu Sep 26 2019 04:21:46 -06:00 [kern_mgwd:info:2284] 0x81d1e7400: 8603e80000297347: NOTICE: Net::Vserver: NetVserverQueue::schedule_refresh: scheduled a refresh for 1 vservers. 00000074.0065f7f4 243bb43d Thu Sep 26 2019 04:21:46 -06:00 [kern_mgwd:info:2284] A [src/rdb/TM.cc 3094 (0x81d1e7400)]: RW-transaction TID <6,29,29> held by client 1000 for 8 seconds (created: 60789249s, now: 60789257s) (label 'network recovery update'). 00000074.0065f7f5 243bb43d Thu Sep 26 2019 04:21:46 -06:00 [kern_mgwd:info:2284] 0x81d1eab00: 0: NOTICE: Net::Vserver: NetVserverQueue::UpdateTask::_updateNode: updating vserver status for vifmgr on node nmg-fas8040-01 00000074.0065f7f7 243bb43d Thu Sep 26 2019 04:21:46 -06:00 [kern_mgwd:info:2284] 0x81d1eab00: 0: NOTICE: Net::Vserver: NetVserverQueue::UpdateTask::_updateNode: returning immediately: success 00000074.0065f7f8 243bb43d Thu Sep 26 2019 04:21:46 -06:00 [kern_mgwd:info:2284] 0x81d1eab00: 0: NOTICE: Net::Vserver: NetVserverQueue::UpdateTask::_updateNode: skipping node nmg-fas8040-02 because it is offline 00000074.0065f7f9 243bb43d Thu Sep 26 2019 04:21:46 -06:00 [kern_mgwd:info:2284] 0x81d1e7400: 8603e80000297347: NOTICE: Net::Recovery: RecoveryWrapper::execute: recovery successful: action=vserver-refresh-all, id=0, name=-, version=4 00000074.0065f7fa 243bb43d Thu Sep 26 2019 04:21:46 -06:00 [kern_mgwd:info:2284] ZSM: shttpc_connect failed: Operation timed out [TO=4s TRT=4.001s =>169.254.5.219:951 CN=11012/1] {na_zsm_socket_open:575} 00000074.0065f7fb 243bb43d Thu Sep 26 2019 04:21:46 -06:00 [kern_mgwd:info:2284] ZSM: KSMF REQ FAILED: sf-status - kSMF alternate path failed to host 169.254.5.219 with a kSMF ERROR: RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to kernel at 169.254.5.219] [TO=20s =>169.254.5.219:951 CN=11012/2] {ksmf_invoke:314} 00000074.0065f7fc 243bb43d Thu Sep 26 2019 04:21:46 -06:00 [kern_mgwd:info:2284] ZAPI sf-status failed. Host: 169.254.5.219, Status: 1, Reason: ZSM - failed, status code = 572, extra = kSMF alternate path failed to host 169.254.5.219 with a kSMF ERROR: RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to kernel at 169.254.5.219], max 20s [169.254.5.219:951], Error: 13057 00000074.0065f7fd 243bb43d Thu Sep 26 2019 04:21:46 -06:00 [kern_mgwd:info:2284] 0x81da83900: 0: ERR: perf::perf_asup_info: _validateCounterMapCache: asup store enabled - caching only mhost objects 00000074.0065f7fe 243bb43d Thu Sep 26 2019 04:21:46 -06:00 [kern_mgwd:info:2284] 0x81da83900: 0: ERR: perf::perf_asup_info: _validateCounterMapCache: asup store enabled - caching only mhost objects 00000074.0065f800 243bb43d Thu Sep 26 2019 04:21:46 -06:00 [kern_mgwd:info:2284] 0x81da83900: 0: ERR: perf::perf_asup_info: _validateCounterMapCache: asup store enabled - caching only mhost objects 00000074.0065f801 243bb43d Thu Sep 26 2019 04:21:46 -06:00 [kern_mgwd:info:2284] 0x81da83900: 0: ERR: perf::perf_asup_info: _validateCounterMapCache: asup store enabled - caching only mhost objects 00000074.0065f802 243bb43d Thu Sep 26 2019 04:21:46 -06:00 [kern_mgwd:info:2284] 0x81da83900: 0: ERR: perf::perf_asup_info: _validateCounterMapCache: asup store enabled - caching only mhost objects 00000074.0065f804 243bb43d Thu Sep 26 2019 04:21:46 -06:00 [kern_mgwd:info:2284] 0x81da83900: 0: ERR: perf::perf_asup_info: _validateCounterMapCache: asup store enabled - caching only mhost objects 00000074.0065f806 243bb43d Thu Sep 26 2019 04:21:46 -06:00 [kern_mgwd:info:2284] 0x81da83900: 0: ERR: perf::perf_asup_info: _validateCounterMapCache: asup store enabled - caching only mhost objects 00000074.0065f808 243bb43d Thu Sep 26 2019 04:21:46 -06:00 [kern_mgwd:info:2284] 0x81da83900: 0: ERR: perf::perf_asup_info: _validateCounterMapCache: asup store enabled - caching only mhost objects 00000074.0065f80a 243bb43d Thu Sep 26 2019 04:21:46 -06:00 [kern_mgwd:info:2284] 0x81da83900: 0: ERR: perf::perf_asup_info: _validateCounterMapCache: asup store enabled - caching only mhost objects 00000074.0065f80b 243bb43d Thu Sep 26 2019 04:21:46 -06:00 [kern_mgwd:info:2284] 0x81da83900: 0: ERR: perf::perf_asup_info: _validateCounterMapCache: asup store enabled - caching only mhost objects 00000074.0065f80c 243bb43d Thu Sep 26 2019 04:21:46 -06:00 [kern_mgwd:info:2284] 0x81b6ad300: 0: ERR: Tables:web: web_proxy_cluster_lifs: problem getting cluster_cj_status_view iterator 00000074.0065f80d 243bb43d Thu Sep 26 2019 04:21:46 -06:00 [kern_mgwd:info:2284] 0x81b6aab00: 0: NOTICE: Tables:web: Updated the proxy server on node nmg-fas8040-01 00000074.0065f80e 243bb43d Thu Sep 26 2019 04:21:46 -06:00 [kern_mgwd:info:2284] 0x81b6aab00: 0: NOTICE: Tables:web: Completed cluster proxy reconfig thread 00000074.0065f80f 243bb43d Thu Sep 26 2019 04:21:46 -06:00 [kern_mgwd:info:2284] 0x81da83900: 0: ERR: perf::perf_asup_info: _validateCounterMapCache: asup store enabled - caching only mhost objects 00000074.0065f811 243bb43d Thu Sep 26 2019 04:21:46 -06:00 [kern_mgwd:info:2284] 0x81b6aa100: 0: ERR: misc_node_info: src/tables/misc_node_info_view.cc:push:257 Failed to update node: 'nmg-fas8040-01' about misc_node_info for node: 'nmg-fas8040-02': RPC: Remote system error [from mgwd on node "nmg-fas8040-01" (VSID: -3) to kernel at 169.254.5.219] 00000074.0065f812 243bb43d Thu Sep 26 2019 04:21:46 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to mgwd at 169.254.5.219] 00000074.0065f813 243bb43d Thu Sep 26 2019 04:21:46 -06:00 [kern_mgwd:info:2284] 0x81b6aa100: 0: ERR: misc_node_info: src/tables/misc_node_info_view.cc:push:264 Error iterating misc_node_info_view: RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to mgwd at 169.254.5.219] 00000074.0065f814 243bb43d Thu Sep 26 2019 04:21:46 -06:00 [kern_mgwd:info:2284] 0x81b244c00: 0: NOTICE: RpcConnectionCache: markFailure: markFailure: New Quarantine for 169.254.8.83:536873492(vifmgr)/1[tcp]{fffffffd|4} with timeout(5.000s) Reason:: RPC: Remote system error - Operation timed out 00000074.0065f815 243bb43d Thu Sep 26 2019 04:21:46 -06:00 [kern_mgwd:info:2284] vifmgr_virtual_interface.get_imp() returns: RPC: Remote system error [from mgwd on node "nmg-fas8040-01" (VSID: -3) to vifmgr at 169.254.5.219] (latency: 10.016140s) [nmg-fas8040-02,1027,-,-,-,-,-,-,-,-,-,-,-,-,-,-,-,-,-,-,-,-,-,-,-,-,-,-,-,-,-,-,-,-,-,-,-,-,-,-,-,-,-,-,-,-,-,-,-,-,-,-,-,-,-,-,-] (memory: 8280 net, 75906 max, 88986 allocated, 80706 freed, 116 allocations) 00000074.0065f816 243bb43d Thu Sep 26 2019 04:21:46 -06:00 [kern_mgwd:info:2284] ZSM: KSMF REQ FAILED: sf-status - kSMF alternate path failed to host 169.254.5.219 with a kSMF ERROR: RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to kernel at 169.254.5.219] [TO=20s =>169.254.5.219:951 CN=11013/1] {ksmf_invoke:314} 00000074.0065f817 243bb43d Thu Sep 26 2019 04:21:46 -06:00 [kern_mgwd:info:2284] ZAPI sf-status failed. Host: 169.254.5.219, Status: 1, Reason: ZSM - failed, status code = 572, extra = kSMF alternate path failed to host 169.254.5.219 with a kSMF ERROR: RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to kernel at 169.254.5.219], max 20s [169.254.5.219:951], Error: 13057 00000074.0065f818 243bb43d Thu Sep 26 2019 04:21:46 -06:00 [kern_mgwd:info:2284] 0x81d1e0600: 0: ERR: svcmgr::PolicyAgent: failed to force process reconcile job to run. Not found 00000074.0065f819 243bb43d Thu Sep 26 2019 04:21:46 -06:00 [kern_mgwd:info:2284] 0x81d1e0600: 0: ERR: svcmgr::svcmgr: failed to post service reconciliation event to run. Result too large 00000074.0065f81a 243bb43d Thu Sep 26 2019 04:21:46 -06:00 [kern_mgwd:info:2284] 0x81d1e0600: 0: ERR: svcmgr::PolicyAgent: failed to force process reconcile job to run. Not found 00000074.0065f81b 243bb43d Thu Sep 26 2019 04:21:46 -06:00 [kern_mgwd:info:2284] 0x81d1e0600: 0: ERR: svcmgr::svcmgr: failed to post service reconciliation event to run. Result too large 00000074.0065f81c 243bb43d Thu Sep 26 2019 04:21:46 -06:00 [kern_mgwd:info:2284] 0x81d1e0600: 0: ERR: svcmgr::PolicyAgent: failed to force process reconcile job to run. Not found 00000074.0065f81d 243bb43d Thu Sep 26 2019 04:21:46 -06:00 [kern_mgwd:info:2284] 0x81d1e0600: 0: ERR: svcmgr::svcmgr: failed to post service reconciliation event to run. Result too large 00000074.0065f81e 243bb43d Thu Sep 26 2019 04:21:46 -06:00 [kern_mgwd:info:2284] 0x81d1e0600: 0: ERR: svcmgr::PolicyAgent: failed to force process reconcile job to run. Not found 00000074.0065f81f 243bb43d Thu Sep 26 2019 04:21:46 -06:00 [kern_mgwd:info:2284] 0x81d1e0600: 0: ERR: svcmgr::svcmgr: failed to post service reconciliation event to run. Result too large 00000074.0065f824 243bb43d Thu Sep 26 2019 04:21:47 -06:00 [kern_mgwd:info:2284] SSTEST: got diagnosis callback for process schmd state start 00000074.0065f829 243bb43d Thu Sep 26 2019 04:21:47 -06:00 [kern_mgwd:info:2284] SSTEST: got diagnosis callback for process cphmd state start 00000074.0065f82e 243bb43d Thu Sep 26 2019 04:21:47 -06:00 [kern_mgwd:info:2284] SSTEST: got diagnosis callback for process shmd state start 00000074.0065f82f 243bb43d Thu Sep 26 2019 04:21:47 -06:00 [kern_mgwd:info:2284] Info: HM asup thread create succeeded at shmd start 00000074.0065f830 243bb43d Thu Sep 26 2019 04:21:47 -06:00 [kern_mgwd:info:2284] Info: HM asup thread starting 00000074.0065f835 243bb43d Thu Sep 26 2019 04:21:47 -06:00 [kern_mgwd:info:2284] SSTEST: got diagnosis callback for process cshmd state start 00000074.0065f8e8 243bb463 Thu Sep 26 2019 04:21:51 -06:00 [kern_mgwd:info:2284] 0x81da83900: 0: NOTICE: RpcConnectionCache: markFailure: markFailure: New Quarantine for 169.254.5.219:536873504(bcomd)/1[tcp]{fffffffd|4} with timeout(5.000s) Reason:: RPC: Remote system error - Operation timed out 00000074.0065f8ec 243bb463 Thu Sep 26 2019 04:21:51 -06:00 [kern_mgwd:info:2284] 0x81b244c00: 0: NOTICE: Tables:web: reconf_cluster_proxy_async (all nodes): Reconfiguration is now in progress 00000074.0065f8ed 243bb463 Thu Sep 26 2019 04:21:51 -06:00 [kern_mgwd:info:2284] 0x81da8a200: 0: NOTICE: Tables:web: Starting cluster proxy reconfig thread is_all_nodes=1 00000074.0065f8ee 243bb463 Thu Sep 26 2019 04:21:51 -06:00 [kern_mgwd:info:2284] 0x81da8a200: 0: INFO: SFO_Ready|Cluster_Apps: wait_for_apps_online (waiter: RECONF_CLUSTER_PROXY_THREAD) apps: mgwd vldb vifmgr bcomd crs, maxTime 60 sec: starting 00000074.0065f8ef 243bb463 Thu Sep 26 2019 04:21:51 -06:00 [kern_mgwd:info:2284] 0x81da8a200: 0: INFO: SFO_Ready|Cluster_Apps: wait_for_apps_online (RECONF_CLUSTER_PROXY_THREAD): mgwd is online. Number of tries: 1. 00000074.0065f8f3 243bb463 Thu Sep 26 2019 04:21:51 -06:00 [kern_mgwd:info:2284] 0x81da8a200: 0: INFO: SFO_Ready|Cluster_Apps: wait_for_apps_online (RECONF_CLUSTER_PROXY_THREAD): vldb is online. Number of tries: 1. 00000074.0065f8f4 243bb463 Thu Sep 26 2019 04:21:51 -06:00 [kern_mgwd:info:2284] 0x81da8a200: 0: INFO: SFO_Ready|Cluster_Apps: wait_for_apps_online (RECONF_CLUSTER_PROXY_THREAD): vifmgr is online. Number of tries: 1. 00000074.0065f8f5 243bb463 Thu Sep 26 2019 04:21:51 -06:00 [kern_mgwd:info:2284] 0x81da8a200: 0: INFO: SFO_Ready|Cluster_Apps: wait_for_apps_online (RECONF_CLUSTER_PROXY_THREAD): vifmgr is in running state. Number of tries: 1. 00000074.0065f8f6 243bb463 Thu Sep 26 2019 04:21:51 -06:00 [kern_mgwd:info:2284] 0x81da8a200: 0: INFO: SFO_Ready|Cluster_Apps: wait_for_apps_online (RECONF_CLUSTER_PROXY_THREAD): bcomd is online. Number of tries: 1. 00000074.0065f8f7 243bb463 Thu Sep 26 2019 04:21:51 -06:00 [kern_mgwd:info:2284] 0x81da8a200: 0: INFO: SFO_Ready|Cluster_Apps: wait_for_apps_online (RECONF_CLUSTER_PROXY_THREAD): crs is online. Number of tries: 1. 00000074.0065f8f8 243bb463 Thu Sep 26 2019 04:21:51 -06:00 [kern_mgwd:info:2284] 0x81da8a200: 0: INFO: SFO_Ready|Cluster_Apps: wait_for_apps_online (waiter: RECONF_CLUSTER_PROXY_THREAD): Finished after 0 tries. 00000074.0065f8f9 243bb463 Thu Sep 26 2019 04:21:51 -06:00 [kern_mgwd:info:2284] 0x81da8a200: 0: NOTICE: Tables:web: SMF DSMDB service ready 00000074.0065f8fa 243bb463 Thu Sep 26 2019 04:21:51 -06:00 [kern_mgwd:info:2284] 0x81b6aba00: 0: NOTICE: Net::Vserver: NetVserverQueue::schedule_refresh: scheduled a refresh for 1 vservers on node nmg-fas8040-01 00000074.0065f8fb 243bb463 Thu Sep 26 2019 04:21:51 -06:00 [kern_mgwd:info:2284] A [src/rdb/TM.cc 3094 (0x81d1eab00)]: RW-transaction TID <6,36,36> held by client 1000 for 8 seconds (created: 60789255s, now: 60789263s) (label 'network recovery cancel'). 00000074.0065f8fc 243bb463 Thu Sep 26 2019 04:21:52 -06:00 [kern_mgwd:info:2284] 0x81d1eab00: 0: NOTICE: Net::Vserver: NetVserverQueue::UpdateTask::_updateNode: updating vserver status for vifmgr on node nmg-fas8040-01 00000074.0065f8fe 243bb463 Thu Sep 26 2019 04:21:52 -06:00 [kern_mgwd:info:2284] 0x81d1eab00: 0: NOTICE: Net::Vserver: NetVserverQueue::UpdateTask::_updateNode: returning immediately: success 00000074.0065f900 243bb463 Thu Sep 26 2019 04:21:52 -06:00 [kern_mgwd:info:2284] 0x81da85c00: 0: ERR: Tables:web: web_proxy_cluster_lifs: problem getting cluster_cj_status_view iterator 00000074.0065f901 243bb463 Thu Sep 26 2019 04:21:52 -06:00 [kern_mgwd:info:2284] 0x81da81100: 0: ERR: Tables:web: web_proxy_cluster_lifs: problem getting cluster_cj_status_view iterator 00000074.0065f902 243bb463 Thu Sep 26 2019 04:21:52 -06:00 [kern_mgwd:info:2284] 0x81da8a200: 0: NOTICE: Tables:web: Updated the proxy server on node nmg-fas8040-01 00000074.0065f903 243bb463 Thu Sep 26 2019 04:21:53 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to mgwd at 169.254.5.219] 00000074.0065f904 243bb463 Thu Sep 26 2019 04:21:53 -06:00 [kern_mgwd:info:2284] 0x81da8a200: 0: NOTICE: Tables:web: Completed cluster proxy reconfig thread 00000074.0065f905 243bb463 Thu Sep 26 2019 04:21:53 -06:00 [kern_mgwd:info:2284] ZSM: shttpc_connect failed: Operation timed out [TO=4s TRT=4.001s =>169.254.5.219:951 CN=11014/1] {na_zsm_socket_open:575} 00000074.0065f906 243bb492 Thu Sep 26 2019 04:21:56 -06:00 [kern_mgwd:info:2284] 0x81da83900: 0: NOTICE: RpcConnectionCache: markFailure: markFailure: New Quarantine for 169.254.8.83:536873504(bcomd)/1[tcp]{fffffffd|4} with timeout(5.000s) Reason:: RPC: Remote system error - Operation timed out 00000074.0065f907 243bb492 Thu Sep 26 2019 04:21:56 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries for bcomd on node "nmg-fas8040-02": RPC: Remote system error [from mgwd on node "nmg-fas8040-01" (VSID: -1) to bcomd at 169.254.5.219]. 00000074.0065f909 243bb492 Thu Sep 26 2019 04:21:57 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f90d 243bb492 Thu Sep 26 2019 04:21:58 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f90f 243bb492 Thu Sep 26 2019 04:21:58 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f910 243bb492 Thu Sep 26 2019 04:21:58 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-01. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f911 243bb4c3 Thu Sep 26 2019 04:22:00 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries for kernel on node "nmg-fas8040-02": RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to kernel at 169.254.5.219]. 00000074.0065f912 243bb4c3 Thu Sep 26 2019 04:22:00 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f913 243bb4c3 Thu Sep 26 2019 04:22:00 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f914 243bb4c3 Thu Sep 26 2019 04:22:00 -06:00 [kern_mgwd:info:2284] 0x81da83900: 0: ERR: perf::perf_asup_info: _validateCounterMapCache: asup store enabled - caching only mhost objects 00000074.0065f915 243bb4c3 Thu Sep 26 2019 04:22:00 -06:00 [kern_mgwd:info:2284] 0x81da83900: 0: ERR: perf::perf_asup_info: _validateCounterMapCache: asup store enabled - caching only mhost objects 00000074.0065f917 243bb4c3 Thu Sep 26 2019 04:22:00 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f918 243bb4c3 Thu Sep 26 2019 04:22:00 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f919 243bb4c3 Thu Sep 26 2019 04:22:01 -06:00 [kern_mgwd:info:2284] 0x81b6aa100: 0: ERR: misc_node_info: src/tables/misc_node_info_view.cc:push:257 Failed to update node: 'nmg-fas8040-01' about misc_node_info for node: 'nmg-fas8040-02': RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to kernel at 169.254.5.219] 00000074.0065f91a 243bb4c3 Thu Sep 26 2019 04:22:01 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to mgwd at 169.254.5.219] 00000074.0065f91b 243bb4c3 Thu Sep 26 2019 04:22:01 -06:00 [kern_mgwd:info:2284] 0x81b6aa100: 0: ERR: misc_node_info: src/tables/misc_node_info_view.cc:push:264 Error iterating misc_node_info_view: RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to mgwd at 169.254.5.219] 00000074.0065f92a 243bb513 Thu Sep 26 2019 04:22:11 -06:00 [kern_mgwd:info:2284] 0x81d1e3d00: 8603e80000297350: WARNING: job_manager::job_sched: process_modify:src/job_sched.cc:487 UIID:8853 UUID:6bc6f38a-e047-11e9-93b8-00a09857ee8f name:Epsilon Transition Job rc:1 Doing nothing in modify callback for job, since it's pending cleanup 00000074.0065f92c 243bb54d Thu Sep 26 2019 04:22:16 -06:00 [kern_mgwd:info:2284] 0x81b6aa100: 0: ERR: misc_node_info: src/tables/misc_node_info_view.cc:push:257 Failed to update node: 'nmg-fas8040-01' about misc_node_info for node: 'nmg-fas8040-02': RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to kernel at 169.254.5.219] 00000074.0065f92d 243bb564 Thu Sep 26 2019 04:22:18 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to mgwd at 169.254.5.219] 00000074.0065f92e 243bb564 Thu Sep 26 2019 04:22:18 -06:00 [kern_mgwd:info:2284] 0x81b6aa100: 0: ERR: misc_node_info: src/tables/misc_node_info_view.cc:push:264 Error iterating misc_node_info_view: RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to mgwd at 169.254.5.219] 00000074.0065f93a 243bb60d Thu Sep 26 2019 04:22:35 -06:00 [kern_mgwd:info:2284] 0x81b6aa100: 0: ERR: misc_node_info: src/tables/misc_node_info_view.cc:push:257 Failed to update node: 'nmg-fas8040-01' about misc_node_info for node: 'nmg-fas8040-02': RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to kernel at 169.254.5.219] 00000074.0065f93b 243bb60d Thu Sep 26 2019 04:22:35 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to mgwd at 169.254.5.219] 00000074.0065f93c 243bb60e Thu Sep 26 2019 04:22:35 -06:00 [kern_mgwd:info:2284] 0x81b6aa100: 0: ERR: misc_node_info: src/tables/misc_node_info_view.cc:push:264 Error iterating misc_node_info_view: RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to mgwd at 169.254.5.219] 00000074.0065f959 243bb6a1 Thu Sep 26 2019 04:22:50 -06:00 [kern_mgwd:info:2284] 0x81b6aa100: 0: ERR: misc_node_info: src/tables/misc_node_info_view.cc:push:257 Failed to update node: 'nmg-fas8040-01' about misc_node_info for node: 'nmg-fas8040-02': RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to kernel at 169.254.5.219] 00000074.0065f95a 243bb6b5 Thu Sep 26 2019 04:22:52 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to mgwd at 169.254.5.219] 00000074.0065f95b 243bb6b5 Thu Sep 26 2019 04:22:52 -06:00 [kern_mgwd:info:2284] 0x81b6aa100: 0: ERR: misc_node_info: src/tables/misc_node_info_view.cc:push:264 Error iterating misc_node_info_view: RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to mgwd at 169.254.5.219] 00000074.0065f95f 243bb706 Thu Sep 26 2019 04:23:00 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f960 243bb706 Thu Sep 26 2019 04:23:00 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f96b 243bb760 Thu Sep 26 2019 04:23:09 -06:00 [kern_mgwd:info:2284] 0x81b6aa100: 0: ERR: misc_node_info: src/tables/misc_node_info_view.cc:push:257 Failed to update node: 'nmg-fas8040-01' about misc_node_info for node: 'nmg-fas8040-02': RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to kernel at 169.254.5.219] 00000074.0065f96c 243bb760 Thu Sep 26 2019 04:23:09 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to mgwd at 169.254.5.219] 00000074.0065f96d 243bb760 Thu Sep 26 2019 04:23:09 -06:00 [kern_mgwd:info:2284] 0x81b6aa100: 0: ERR: misc_node_info: src/tables/misc_node_info_view.cc:push:264 Error iterating misc_node_info_view: RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to mgwd at 169.254.5.219] 00000074.0065f973 243bb7f6 Thu Sep 26 2019 04:23:24 -06:00 [kern_mgwd:info:2284] 0x81b6aa100: 0: ERR: misc_node_info: src/tables/misc_node_info_view.cc:push:257 Failed to update node: 'nmg-fas8040-01' about misc_node_info for node: 'nmg-fas8040-02': RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to kernel at 169.254.5.219] 00000074.0065f976 243bb80d Thu Sep 26 2019 04:23:26 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to mgwd at 169.254.5.219] 00000074.0065f977 243bb80d Thu Sep 26 2019 04:23:26 -06:00 [kern_mgwd:info:2284] 0x81b6aa100: 0: ERR: misc_node_info: src/tables/misc_node_info_view.cc:push:264 Error iterating misc_node_info_view: RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to mgwd at 169.254.5.219] 00000074.0065f980 243bb8b4 Thu Sep 26 2019 04:23:43 -06:00 [kern_mgwd:info:2284] 0x81b6aa100: 0: ERR: misc_node_info: src/tables/misc_node_info_view.cc:push:257 Failed to update node: 'nmg-fas8040-01' about misc_node_info for node: 'nmg-fas8040-02': RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to kernel at 169.254.5.219] 00000074.0065f981 243bb8b4 Thu Sep 26 2019 04:23:43 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to mgwd at 169.254.5.219] 00000074.0065f982 243bb8b4 Thu Sep 26 2019 04:23:43 -06:00 [kern_mgwd:info:2284] 0x81b6aa100: 0: ERR: misc_node_info: src/tables/misc_node_info_view.cc:push:264 Error iterating misc_node_info_view: RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to mgwd at 169.254.5.219] 00000074.0065f986 243bb903 Thu Sep 26 2019 04:23:49 -06:00 [kern_mgwd:info:2284] 0x81b244200: 0: ERR: RPCServer: mgwd_xml_start_1_svc: Called for asup_pathname(/mroot/etc/log/autosupport/201909260423.2.files) 00000074.0065f987 243bb903 Thu Sep 26 2019 04:23:49 -06:00 [kern_mgwd:info:2284] 0x81b244200: 0: ERR: RPCServer: mgwd_xml_start_1_svc: current_asup_xml exists. State: (4) 00000074.0065f988 243bb903 Thu Sep 26 2019 04:23:49 -06:00 [kern_mgwd:info:2284] 0x81b244200: 0: ERR: RPCServer: mgwd_xml_start_1_svc: ASUP Started SUCCESS 00000074.0065f989 243bb903 Thu Sep 26 2019 04:23:49 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f98a 243bb903 Thu Sep 26 2019 04:23:49 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f98b 243bb903 Thu Sep 26 2019 04:23:49 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f98c 243bb903 Thu Sep 26 2019 04:23:49 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f98d 243bb903 Thu Sep 26 2019 04:23:49 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f98e 243bb903 Thu Sep 26 2019 04:23:49 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f98f 243bb903 Thu Sep 26 2019 04:23:49 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f990 243bb903 Thu Sep 26 2019 04:23:49 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f991 243bb903 Thu Sep 26 2019 04:23:49 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f992 243bb903 Thu Sep 26 2019 04:23:49 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f993 243bb903 Thu Sep 26 2019 04:23:49 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f994 243bb903 Thu Sep 26 2019 04:23:49 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f995 243bb903 Thu Sep 26 2019 04:23:49 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f996 243bb903 Thu Sep 26 2019 04:23:49 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f997 243bb903 Thu Sep 26 2019 04:23:49 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f998 243bb903 Thu Sep 26 2019 04:23:49 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f999 243bb903 Thu Sep 26 2019 04:23:49 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f99a 243bb903 Thu Sep 26 2019 04:23:49 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f99b 243bb903 Thu Sep 26 2019 04:23:49 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f99c 243bb903 Thu Sep 26 2019 04:23:49 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f99d 243bb903 Thu Sep 26 2019 04:23:49 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f99e 243bb903 Thu Sep 26 2019 04:23:49 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f99f 243bb903 Thu Sep 26 2019 04:23:49 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f9a0 243bb903 Thu Sep 26 2019 04:23:49 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f9a1 243bb903 Thu Sep 26 2019 04:23:49 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f9a2 243bb903 Thu Sep 26 2019 04:23:49 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f9a3 243bb903 Thu Sep 26 2019 04:23:49 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f9a4 243bb903 Thu Sep 26 2019 04:23:49 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f9a5 243bb903 Thu Sep 26 2019 04:23:49 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f9a6 243bb903 Thu Sep 26 2019 04:23:49 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f9a7 243bb903 Thu Sep 26 2019 04:23:49 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f9a8 243bb903 Thu Sep 26 2019 04:23:49 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f9a9 243bb903 Thu Sep 26 2019 04:23:49 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f9aa 243bb903 Thu Sep 26 2019 04:23:49 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f9ab 243bb903 Thu Sep 26 2019 04:23:49 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f9ac 243bb903 Thu Sep 26 2019 04:23:49 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f9ad 243bb903 Thu Sep 26 2019 04:23:49 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f9ae 243bb903 Thu Sep 26 2019 04:23:49 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f9af 243bb903 Thu Sep 26 2019 04:23:49 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f9b0 243bb903 Thu Sep 26 2019 04:23:49 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f9b1 243bb903 Thu Sep 26 2019 04:23:50 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f9b2 243bb903 Thu Sep 26 2019 04:23:50 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f9b3 243bb903 Thu Sep 26 2019 04:23:50 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f9b4 243bb903 Thu Sep 26 2019 04:23:50 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f9b5 243bb903 Thu Sep 26 2019 04:23:50 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f9b6 243bb903 Thu Sep 26 2019 04:23:50 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f9b7 243bb903 Thu Sep 26 2019 04:23:50 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f9b8 243bb903 Thu Sep 26 2019 04:23:50 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f9b9 243bb903 Thu Sep 26 2019 04:23:50 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f9ba 243bb903 Thu Sep 26 2019 04:23:50 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f9bb 243bb903 Thu Sep 26 2019 04:23:50 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f9bc 243bb903 Thu Sep 26 2019 04:23:50 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f9bd 243bb903 Thu Sep 26 2019 04:23:50 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f9be 243bb903 Thu Sep 26 2019 04:23:50 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f9bf 243bb903 Thu Sep 26 2019 04:23:50 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f9c0 243bb903 Thu Sep 26 2019 04:23:50 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f9c1 243bb903 Thu Sep 26 2019 04:23:50 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f9c2 243bb903 Thu Sep 26 2019 04:23:50 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f9c3 243bb903 Thu Sep 26 2019 04:23:50 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f9c4 243bb903 Thu Sep 26 2019 04:23:50 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f9c5 243bb903 Thu Sep 26 2019 04:23:50 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f9c6 243bb903 Thu Sep 26 2019 04:23:50 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f9c7 243bb903 Thu Sep 26 2019 04:23:50 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f9c8 243bb903 Thu Sep 26 2019 04:23:50 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f9c9 243bb903 Thu Sep 26 2019 04:23:50 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f9ca 243bb903 Thu Sep 26 2019 04:23:50 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f9cb 243bb903 Thu Sep 26 2019 04:23:50 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f9cc 243bb903 Thu Sep 26 2019 04:23:50 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f9cd 243bb903 Thu Sep 26 2019 04:23:50 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f9ce 243bb903 Thu Sep 26 2019 04:23:50 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f9cf 243bb903 Thu Sep 26 2019 04:23:50 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f9d0 243bb903 Thu Sep 26 2019 04:23:50 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f9d1 243bb903 Thu Sep 26 2019 04:23:50 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f9d2 243bb903 Thu Sep 26 2019 04:23:50 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f9d3 243bb903 Thu Sep 26 2019 04:23:50 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f9d4 243bb903 Thu Sep 26 2019 04:23:50 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f9d5 243bb903 Thu Sep 26 2019 04:23:50 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f9d6 243bb903 Thu Sep 26 2019 04:23:50 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f9d7 243bb903 Thu Sep 26 2019 04:23:50 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f9d8 243bb903 Thu Sep 26 2019 04:23:50 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f9d9 243bb903 Thu Sep 26 2019 04:23:50 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f9da 243bb903 Thu Sep 26 2019 04:23:50 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f9db 243bb903 Thu Sep 26 2019 04:23:50 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f9dc 243bb903 Thu Sep 26 2019 04:23:50 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f9dd 243bb903 Thu Sep 26 2019 04:23:50 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f9de 243bb903 Thu Sep 26 2019 04:23:50 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f9df 243bb903 Thu Sep 26 2019 04:23:50 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f9e0 243bb903 Thu Sep 26 2019 04:23:50 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f9e1 243bb903 Thu Sep 26 2019 04:23:50 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f9e2 243bb903 Thu Sep 26 2019 04:23:50 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f9e3 243bb903 Thu Sep 26 2019 04:23:50 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f9e4 243bb903 Thu Sep 26 2019 04:23:50 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f9e5 243bb903 Thu Sep 26 2019 04:23:50 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f9e6 243bb903 Thu Sep 26 2019 04:23:50 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f9e7 243bb903 Thu Sep 26 2019 04:23:50 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f9e8 243bb903 Thu Sep 26 2019 04:23:50 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f9e9 243bb903 Thu Sep 26 2019 04:23:50 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f9ea 243bb903 Thu Sep 26 2019 04:23:50 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f9eb 243bb903 Thu Sep 26 2019 04:23:50 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f9ec 243bb903 Thu Sep 26 2019 04:23:50 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f9ed 243bb903 Thu Sep 26 2019 04:23:50 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f9ee 243bb903 Thu Sep 26 2019 04:23:50 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f9ef 243bb903 Thu Sep 26 2019 04:23:50 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f9f0 243bb903 Thu Sep 26 2019 04:23:50 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f9f1 243bb903 Thu Sep 26 2019 04:23:50 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f9f2 243bb903 Thu Sep 26 2019 04:23:50 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f9f3 243bb903 Thu Sep 26 2019 04:23:50 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f9f4 243bb903 Thu Sep 26 2019 04:23:50 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f9f5 243bb903 Thu Sep 26 2019 04:23:50 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f9f6 243bb903 Thu Sep 26 2019 04:23:50 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f9f7 243bb903 Thu Sep 26 2019 04:23:50 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f9f8 243bb903 Thu Sep 26 2019 04:23:50 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f9f9 243bb903 Thu Sep 26 2019 04:23:50 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f9fa 243bb903 Thu Sep 26 2019 04:23:50 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f9fb 243bb903 Thu Sep 26 2019 04:23:50 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f9fc 243bb903 Thu Sep 26 2019 04:23:50 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f9fd 243bb903 Thu Sep 26 2019 04:23:50 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f9fe 243bb903 Thu Sep 26 2019 04:23:50 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065f9ff 243bb903 Thu Sep 26 2019 04:23:50 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fa00 243bb903 Thu Sep 26 2019 04:23:50 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fa01 243bb903 Thu Sep 26 2019 04:23:50 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fa02 243bb903 Thu Sep 26 2019 04:23:50 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fa03 243bb903 Thu Sep 26 2019 04:23:50 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fa04 243bb903 Thu Sep 26 2019 04:23:50 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fa05 243bb903 Thu Sep 26 2019 04:23:50 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fa06 243bb903 Thu Sep 26 2019 04:23:50 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fa07 243bb903 Thu Sep 26 2019 04:23:50 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fa08 243bb903 Thu Sep 26 2019 04:23:50 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fa09 243bb903 Thu Sep 26 2019 04:23:50 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fa0a 243bb903 Thu Sep 26 2019 04:23:50 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fa0b 243bb903 Thu Sep 26 2019 04:23:50 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fa0c 243bb903 Thu Sep 26 2019 04:23:50 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fa0d 243bb903 Thu Sep 26 2019 04:23:50 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fa0e 243bb903 Thu Sep 26 2019 04:23:50 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fa0f 243bb903 Thu Sep 26 2019 04:23:50 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fa10 243bb903 Thu Sep 26 2019 04:23:51 -06:00 [kern_mgwd:info:2284] get_next_imp(): owner_get_names() returned: Owner lookup failed. Name Service Switch (NSS) configuration not found for Vserver "Main_SVM". 00000074.0065fa11 243bb903 Thu Sep 26 2019 04:23:51 -06:00 [kern_mgwd:info:2284] get_next_imp(): owner_get_names() returned: Owner lookup failed. Name Service Switch (NSS) configuration not found for Vserver "Main_SVM". 00000074.0065fa12 243bb903 Thu Sep 26 2019 04:23:51 -06:00 [kern_mgwd:info:2284] get_next_imp(): owner_get_names() returned: Owner lookup failed. Name Service Switch (NSS) configuration not found for Vserver "Main_SVM". 00000074.0065fa13 243bb903 Thu Sep 26 2019 04:23:51 -06:00 [kern_mgwd:info:2284] get_next_imp(): owner_get_names() returned: Owner lookup failed. Name Service Switch (NSS) configuration not found for Vserver "Main_SVM". 00000074.0065fa14 243bb903 Thu Sep 26 2019 04:23:51 -06:00 [kern_mgwd:info:2284] get_next_imp(): owner_get_names() returned: Owner lookup failed. Name Service Switch (NSS) configuration not found for Vserver "Main_SVM". 00000074.0065fa15 243bb903 Thu Sep 26 2019 04:23:51 -06:00 [kern_mgwd:info:2284] 0x81da83400: 0: WARNING: VOPL::DbladeZapiServerConnection: fillVolAttrs 3305 failed to get creation-time 00000074.0065fa16 243bb903 Thu Sep 26 2019 04:23:51 -06:00 [kern_mgwd:info:2284] 0x81da83400: 0: WARNING: VOPL::DbladeZapiServerConnection: fillVolAttrs 3716 failed fo get snaplock type 00000074.0065fa17 243bb903 Thu Sep 26 2019 04:23:51 -06:00 [kern_mgwd:info:2284] 0x81da83400: 0: WARNING: VOPL::DbladeZapiServerConnection: fillVolAttrs 3305 failed to get creation-time 00000074.0065fa18 243bb903 Thu Sep 26 2019 04:23:51 -06:00 [kern_mgwd:info:2284] 0x81da83400: 0: WARNING: VOPL::DbladeZapiServerConnection: fillVolAttrs 3716 failed fo get snaplock type 00000074.0065fa19 243bb903 Thu Sep 26 2019 04:23:51 -06:00 [kern_mgwd:info:2284] 0x81da83400: 0: INFO: SFO_Ready|Cluster_Apps: wait_for_apps_online (waiter: VReport) apps: vldb, maxTime 5 sec: starting 00000074.0065fa1a 243bb903 Thu Sep 26 2019 04:23:51 -06:00 [kern_mgwd:info:2284] 0x81da83400: 0: INFO: SFO_Ready|Cluster_Apps: wait_for_apps_online (VReport): vldb is online. Number of tries: 1. 00000074.0065fa1b 243bb903 Thu Sep 26 2019 04:23:51 -06:00 [kern_mgwd:info:2284] 0x81da83400: 0: INFO: SFO_Ready|Cluster_Apps: wait_for_apps_online (waiter: VReport): Finished after 0 tries. 00000074.0065fa1c 243bb903 Thu Sep 26 2019 04:23:51 -06:00 [kern_mgwd:info:2284] 0x81da83400: 0: INFO: SFO_Ready|Cluster_Apps: wait_for_apps_online (waiter: VReport) apps: vldb, maxTime 5 sec: starting 00000074.0065fa1d 243bb903 Thu Sep 26 2019 04:23:51 -06:00 [kern_mgwd:info:2284] 0x81da83400: 0: INFO: SFO_Ready|Cluster_Apps: wait_for_apps_online (VReport): vldb is online. Number of tries: 1. 00000074.0065fa1e 243bb903 Thu Sep 26 2019 04:23:51 -06:00 [kern_mgwd:info:2284] 0x81da83400: 0: INFO: SFO_Ready|Cluster_Apps: wait_for_apps_online (waiter: VReport): Finished after 0 tries. 00000074.0065fa1f 243bb92f Thu Sep 26 2019 04:23:55 -06:00 [kern_mgwd:info:2284] ZSM: shttpc_connect failed: Operation timed out [TO=4s TRT=4.001s =>169.254.5.219:951 CN=11018/1] {na_zsm_socket_open:575} 00000074.0065fa20 243bb92f Thu Sep 26 2019 04:23:55 -06:00 [kern_mgwd:info:2284] ZSM: KSMF REQ FAILED: system-get-version - kSMF alternate path failed to host 169.254.5.219 with a kSMF ERROR: RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to kernel at 169.254.5.219] [TO=110s =>169.254.5.219:951 CN=11018/2] {ksmf_invoke:314} 00000074.0065fa21 243bb92f Thu Sep 26 2019 04:23:55 -06:00 [kern_mgwd:info:2284] 0x81da83400: 0: ERR: tables::vreport: zapi_system_get_version to host: nmg-fas8040-02 returned error: 13057, reason: ZSM - failed, status code = 572, extra = kSMF alternate path failed to host 169.254.5.219 with a kSMF ERROR: RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to kernel at 169.254.5.219], max 110s [169.254.5.219:951] 00000074.0065fa22 243bb92f Thu Sep 26 2019 04:23:55 -06:00 [kern_mgwd:info:2284] 0x81da83400: 0: WARNING: tables::vreport: skipping unreachable node: nmg-fas8040-02 00000074.0065fa23 243bb92f Thu Sep 26 2019 04:23:55 -06:00 [kern_mgwd:info:2284] 0x81da83400: 0: WARNING: tables::vreport: Skipping unreachable node: nmg-fas8040-02 00000074.0065fa24 243bb92f Thu Sep 26 2019 04:23:55 -06:00 [kern_mgwd:info:2284] 0x81da83400: 0: WARNING: MGWD::volume_cache: populateCache SetVolumeCache 546 d_volume_list_info_iter_next with nextTag: cookie=0,desired_attrs=name,owning-vserver-uuid,is-home,extent-size,dsid,msid,state,vol-access,language-code,containing-aggregate,mirror-types,containing-aggregate-uuid,data-version,uuid,clone-parent,is-cluster-volume,fc-cache-policy-idx,transition,iv-constituent-role,creation-time,snaplock,flexgroup-index,flexgroup-msid,flexgroup-uuid,ondisk-quiesced,encrypt,key-id,encryption-blob,key-generation,buftree-id,btuuid response from node: 169.254.23.82 is: 00000074.0065fa25 243bb92f Thu Sep 26 2019 04:23:55 -06:00 [kern_mgwd:info:2284] 0x81da83400: 0: WARNING: MGWD::volume_cache: populateCache SetVolumeCache 546 d_volume_list_info_iter_next with nextTag: cookie=f26ab847-ca47-11e7-8fa8-00a098573067,desired_attrs=name,owning-vserver-uuid,is-home,extent-size,dsid,msid,state,vol-access,language-code,containing-aggregate,mirror-types,containing-aggregate-uuid,data-version,uuid,clone-parent,is-cluster-volume,fc-cache-policy-idx,transition,iv-constituent-role,creation-time,snaplock,flexgroup-index,flexgroup-msid,flexgroup-uuid,ondisk-quiesced,encrypt,key-id,encryption-blob,key-generation,buftree-id,btuuid response from node: 169.254.23.82 is: 00000074.0065fa26 243bb92f Thu Sep 26 2019 04:23:55 -06:00 [kern_mgwd:info:2284] 0x81da83400: 0: ERR: tables::vreport: Object Name not found in vReport cache. 00000074.0065fa27 243bb92f Thu Sep 26 2019 04:23:55 -06:00 [kern_mgwd:info:2284] 0x81da83400: 0: WARNING: tables::vreport: Following Nodes were not reachable: nmg-fas8040-02 00000074.0065fa28 243bb92f Thu Sep 26 2019 04:23:55 -06:00 [kern_mgwd:info:2284] Warning: Vreport could NOT retrieve required information from the following nodes in the cluster: nmg-fas8040-02. 00000074.0065fa29 243bb92f Thu Sep 26 2019 04:23:55 -06:00 [kern_mgwd:info:2284] Some discrepancies may not be reported by Vreport. 00000074.0065fa2a 243bb92f Thu Sep 26 2019 04:23:55 -06:00 [kern_mgwd:info:2284] 0x81da83400: 0: ERR: tables::vreport: isMCCPostHealRoots: Cannot get metrocluster state. Error: entry doesn't exist 00000074.0065fa3d 243bb98d Thu Sep 26 2019 04:23:57 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fa3e 243bb98d Thu Sep 26 2019 04:23:57 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fa3f 243bb98d Thu Sep 26 2019 04:23:57 -06:00 [kern_mgwd:info:2284] 0x81da83400: 0: ERR: MGWD::VsMSID: src/vreport/vreport_junction.h 125: toStr(): vsName and vsid are both empty. 00000074.0065fa40 243bb98d Thu Sep 26 2019 04:23:57 -06:00 [kern_mgwd:info:2284] 0x81da83400: 0: ERR: MGWD::VsMSID: src/vreport/vreport_junction.h 134: toStr(): volName and volMsid are both empty. The object is 00000074.0065fa41 243bb98d Thu Sep 26 2019 04:23:57 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fa42 243bb98d Thu Sep 26 2019 04:23:57 -06:00 [kern_mgwd:info:2284] 0x81da83400: 0: ERR: MGWD::VsMSID: src/vreport/vreport_junction.h 125: toStr(): vsName and vsid are both empty. 00000074.0065fa43 243bb98d Thu Sep 26 2019 04:23:57 -06:00 [kern_mgwd:info:2284] 0x81da83400: 0: ERR: MGWD::VsMSID: src/vreport/vreport_junction.h 134: toStr(): volName and volMsid are both empty. The object is 00000074.0065fa44 243bb98d Thu Sep 26 2019 04:23:57 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fa45 243bb98d Thu Sep 26 2019 04:23:57 -06:00 [kern_mgwd:info:2284] Info: WAFL and VLDB volume/aggregate records are consistent for all responding nodes. 00000074.0065fa46 243bb98d Thu Sep 26 2019 04:23:58 -06:00 [kern_mgwd:info:2284] 0x81da83400: 0: ERR: AggrEfficiency: src/tables/aggr_efficiency.cc:smdb_error aggr_efficiency_iterator::_getAggrDetails(const smdb_type_aggr_name &, smdb_type_Uuid &, smdb_type_filerid &):122 Failed to get aggregate information from VLDB for aggregate , Reason: entry doesn't exist 00000074.0065fa47 243bb98d Thu Sep 26 2019 04:23:58 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fa48 243bb98d Thu Sep 26 2019 04:23:58 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fa49 243bb98d Thu Sep 26 2019 04:23:58 -06:00 [kern_mgwd:info:2284] ZSM: KSMF REQ FAILED: storage-initiator-errors-list-info - kSMF alternate path failed to host 169.254.5.219 with a kSMF ERROR: RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to kernel at 169.254.5.219] [TO=110s TRT=0.001s =>169.254.5.219:951 CN=11019/1] {ksmf_invoke:314} 00000074.0065fa4a 243bb98d Thu Sep 26 2019 04:23:58 -06:00 [kern_mgwd:info:2284] ZSM: KSMF REQ FAILED: storage-disk-get-iter - kSMF alternate path failed to host 169.254.5.219 with a kSMF ERROR: RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to kernel at 169.254.5.219] [TO=110s TRT=0.001s =>169.254.5.219:951 CN=11020/1] {ksmf_invoke:314} 00000074.0065fa4b 243bb98d Thu Sep 26 2019 04:23:58 -06:00 [kern_mgwd:info:2284] 0x81da83400: 0: NOTICE: TABLES::disk: Added 84 disk recs to the shared reference cache (size 84) 00000074.0065fa4c 243bb98d Thu Sep 26 2019 04:23:58 -06:00 [kern_mgwd:info:2284] 0x81da83400: 0: ERR: TABLES::disk: _getDisks: Node nmg-fas8040-02 not healthy, Not gathering disk attributes from this node. 00000074.0065fa4d 243bb98d Thu Sep 26 2019 04:23:58 -06:00 [kern_mgwd:info:2284] 0x81da83400: 0: ERR: TABLES::disk: _getDisks: Node nmg-fas8040-02 not healthy, Not gathering disk attributes from this node. 00000074.0065fa4e 243bb98d Thu Sep 26 2019 04:23:58 -06:00 [kern_mgwd:info:2284] 0x81b6aa100: 0: ERR: misc_node_info: src/tables/misc_node_info_view.cc:push:257 Failed to update node: 'nmg-fas8040-01' about misc_node_info for node: 'nmg-fas8040-02': RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to kernel at 169.254.5.219] 00000074.0065fa4f 243bb98d Thu Sep 26 2019 04:23:58 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to mgwd at 169.254.5.219] 00000074.0065fa50 243bb98d Thu Sep 26 2019 04:23:58 -06:00 [kern_mgwd:info:2284] 0x81b6aa100: 0: ERR: misc_node_info: src/tables/misc_node_info_view.cc:push:264 Error iterating misc_node_info_view: RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to mgwd at 169.254.5.219] 00000074.0065fa51 243bb98d Thu Sep 26 2019 04:23:59 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries for kernel on node "nmg-fas8040-02": RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to kernel at 169.254.5.219]. 00000074.0065fa52 243bb98d Thu Sep 26 2019 04:23:59 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fa53 243bb98d Thu Sep 26 2019 04:23:59 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fa54 243bb98d Thu Sep 26 2019 04:23:59 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fa55 243bb98d Thu Sep 26 2019 04:23:59 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fa56 243bb98d Thu Sep 26 2019 04:23:59 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fa57 243bb98d Thu Sep 26 2019 04:23:59 -06:00 [kern_mgwd:info:2284] ZSM: KSMF REQ FAILED: sf-status - kSMF alternate path failed to host 169.254.5.219 with a kSMF ERROR: RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to kernel at 169.254.5.219] [TO=20s =>169.254.5.219:951 CN=11022/1] {ksmf_invoke:314} 00000074.0065fa58 243bb98d Thu Sep 26 2019 04:23:59 -06:00 [kern_mgwd:info:2284] ZAPI sf-status failed. Host: 169.254.5.219, Status: 1, Reason: ZSM - failed, status code = 572, extra = kSMF alternate path failed to host 169.254.5.219 with a kSMF ERROR: RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to kernel at 169.254.5.219], max 20s [169.254.5.219:951], Error: 13057 00000074.0065fa59 243bb98d Thu Sep 26 2019 04:23:59 -06:00 [kern_mgwd:info:2284] 0x81da83400: 0: ERR: perf::perf_asup_info: _validateCounterMapCache: asup store enabled - caching only mhost objects 00000074.0065fa5a 243bb98d Thu Sep 26 2019 04:23:59 -06:00 [kern_mgwd:info:2284] 0x81da83400: 0: ERR: perf::perf_asup_info: _validateCounterMapCache: asup store enabled - caching only mhost objects 00000074.0065fa5c 243bb98d Thu Sep 26 2019 04:23:59 -06:00 [kern_mgwd:info:2284] 0x81da83400: 0: ERR: perf::perf_asup_info: _validateCounterMapCache: asup store enabled - caching only mhost objects 00000074.0065fa5d 243bb98d Thu Sep 26 2019 04:23:59 -06:00 [kern_mgwd:info:2284] 0x81da83400: 0: ERR: perf::perf_asup_info: _validateCounterMapCache: asup store enabled - caching only mhost objects 00000074.0065fa5e 243bb98d Thu Sep 26 2019 04:23:59 -06:00 [kern_mgwd:info:2284] 0x81da83400: 0: ERR: perf::perf_asup_info: _validateCounterMapCache: asup store enabled - caching only mhost objects 00000074.0065fa60 243bb98d Thu Sep 26 2019 04:23:59 -06:00 [kern_mgwd:info:2284] 0x81da83400: 0: ERR: perf::perf_asup_info: _validateCounterMapCache: asup store enabled - caching only mhost objects 00000074.0065fa62 243bb98d Thu Sep 26 2019 04:23:59 -06:00 [kern_mgwd:info:2284] 0x81da83400: 0: ERR: perf::perf_asup_info: _validateCounterMapCache: asup store enabled - caching only mhost objects 00000074.0065fa64 243bb98d Thu Sep 26 2019 04:23:59 -06:00 [kern_mgwd:info:2284] 0x81da83400: 0: ERR: perf::perf_asup_info: _validateCounterMapCache: asup store enabled - caching only mhost objects 00000074.0065fa66 243bb98d Thu Sep 26 2019 04:23:59 -06:00 [kern_mgwd:info:2284] 0x81da83400: 0: ERR: perf::perf_asup_info: _validateCounterMapCache: asup store enabled - caching only mhost objects 00000074.0065fa67 243bb98d Thu Sep 26 2019 04:23:59 -06:00 [kern_mgwd:info:2284] 0x81da83400: 0: ERR: perf::perf_asup_info: _validateCounterMapCache: asup store enabled - caching only mhost objects 00000074.0065fa68 243bb98d Thu Sep 26 2019 04:23:59 -06:00 [kern_mgwd:info:2284] 0x81da83400: 0: ERR: perf::perf_asup_info: _validateCounterMapCache: asup store enabled - caching only mhost objects 00000074.0065fa6a 243bb98d Thu Sep 26 2019 04:23:59 -06:00 [kern_mgwd:info:2284] 0x81da83400: 0: ERR: metrocluster::fcvi: get failed on kern_fcvi_info table for port 0, error = entry doesn't exist {in get_imp() at src/tables/sysconfig_ic_xml.cc:105} 00000074.0065fa6b 243bb98d Thu Sep 26 2019 04:23:59 -06:00 [kern_mgwd:info:2284] 0x81da83400: 0: ERR: metrocluster::fcvi: get failed on kern_fcvi_info table for port 0, error = entry doesn't exist {in next_imp() at src/tables/sysconfig_ic_xml.cc:137} 00000074.0065fa6c 243bb98d Thu Sep 26 2019 04:23:59 -06:00 [kern_mgwd:info:2284] Error: Loop detected in next() for table kern_ethernet_controller_info. Next on "0" returned "0". 00000074.0065fa6d 243bb98d Thu Sep 26 2019 04:23:59 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-01. System Disk details are not available on this platform. 00000074.0065fa6e 243bb98d Thu Sep 26 2019 04:23:59 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fa6f 243bb98d Thu Sep 26 2019 04:23:59 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fa70 243bb98d Thu Sep 26 2019 04:24:00 -06:00 [kern_mgwd:info:2284] 0x81da83400: 0: ERR: perf::perf_asup_info: _validateCounterMapCache: asup store enabled - caching only mhost objects 00000074.0065fa71 243bb98d Thu Sep 26 2019 04:24:00 -06:00 [kern_mgwd:info:2284] 0x81da83400: 0: ERR: perf::perf_asup_info: _validateCounterMapCache: asup store enabled - caching only mhost objects 00000074.0065fa73 243bb98d Thu Sep 26 2019 04:24:00 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fa74 243bb98d Thu Sep 26 2019 04:24:00 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fa83 243bb98d Thu Sep 26 2019 04:24:01 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fa84 243bb98d Thu Sep 26 2019 04:24:01 -06:00 [kern_mgwd:info:2284] 0x81b7b5a00: 8503e80000002815: ERR: ZapiConnection: system-get-info: failed to connect to '169.254.5.219:951 Vers=1.0 3:0:2 CallTO=110 ConnTO=15 PingTO=10' duration 0 00000074.0065fa85 243bb98d Thu Sep 26 2019 04:24:01 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fa86 243bb98d Thu Sep 26 2019 04:24:01 -06:00 [kern_mgwd:info:2284] 0x81b7b3c00: 8503e80000002819: ERR: TABLES::disk: _getDisks: Node nmg-fas8040-02 not healthy, Not gathering disk attributes from this node. 00000074.0065fa87 243bb98d Thu Sep 26 2019 04:24:01 -06:00 [kern_mgwd:info:2284] A [src/rdb/HAM.cc 1233 (0x81b7b5000)]: checkHASFOConfigVerbose: haConfigured: True, result HA_AGENT_CONFIGURED. 00000074.0065fa8a 243bb98d Thu Sep 26 2019 04:24:01 -06:00 [kern_mgwd:info:2284] update_phase_data: populateData - No phase information found entry doesn't exist { ANDU_LOG in populateData() at src/tables/cluster_image.cc:3824 } 00000074.0065fa8b 243bb98d Thu Sep 26 2019 04:24:01 -06:00 [kern_mgwd:info:2284] update_phase_data: populateData - No phase information found entry doesn't exist { ANDU_LOG in populateData() at src/tables/cluster_image.cc:3824 } 00000074.0065fa8c 243bb98d Thu Sep 26 2019 04:24:01 -06:00 [kern_mgwd:info:2284] update_phase_data: populateData - No phase information found entry doesn't exist { ANDU_LOG in populateData() at src/tables/cluster_image.cc:3824 } 00000074.0065fabd 243bb98e Thu Sep 26 2019 04:24:02 -06:00 [kern_mgwd:info:2284] ZSM: shttpc_connect failed: Operation timed out [TO=4s TRT=4.001s =>169.254.5.219:951 CN=11021/1] {na_zsm_socket_open:575} 00000074.0065fac3 243bb98e Thu Sep 26 2019 04:24:03 -06:00 [kern_mgwd:info:2284] A [src/rdb/HAM.cc 1233 (0x81b7b8700)]: checkHASFOConfigVerbose: haConfigured: True, result HA_AGENT_CONFIGURED. 00000074.0065fad2 243bb98e Thu Sep 26 2019 04:24:05 -06:00 [kern_mgwd:info:2284] 0x81b7b9600: 8503e8000000282c: ERR: TABLES::disk: _getDisks: Node nmg-fas8040-02 not healthy, Not gathering disk attributes from this node. 00000074.0065fad4 243bb98e Thu Sep 26 2019 04:24:05 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries for kernel on node "nmg-fas8040-02": RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to kernel at 169.254.5.219]. 00000074.0065fafd 243bb9fa Thu Sep 26 2019 04:24:15 -06:00 [kern_mgwd:info:2284] 0x81b6aa100: 0: ERR: misc_node_info: src/tables/misc_node_info_view.cc:push:257 Failed to update node: 'nmg-fas8040-01' about misc_node_info for node: 'nmg-fas8040-02': RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to kernel at 169.254.5.219] 00000074.0065fafe 243bb9fa Thu Sep 26 2019 04:24:15 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to mgwd at 169.254.5.219] 00000074.0065faff 243bb9fa Thu Sep 26 2019 04:24:15 -06:00 [kern_mgwd:info:2284] 0x81b6aa100: 0: ERR: misc_node_info: src/tables/misc_node_info_view.cc:push:264 Error iterating misc_node_info_view: RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to mgwd at 169.254.5.219] 00000074.0065fb01 243bba90 Thu Sep 26 2019 04:24:30 -06:00 [kern_mgwd:info:2284] 0x81b7b6900: 8503e80000002834: ERR: TABLES::disk: _getDisks: Node nmg-fas8040-02 not healthy, Not gathering disk attributes from this node. 00000074.0065fb02 243bba90 Thu Sep 26 2019 04:24:30 -06:00 [kern_mgwd:info:2284] 0x81b6aa100: 0: ERR: misc_node_info: src/tables/misc_node_info_view.cc:push:257 Failed to update node: 'nmg-fas8040-01' about misc_node_info for node: 'nmg-fas8040-02': RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to kernel at 169.254.5.219] 00000074.0065fb06 243bba9e Thu Sep 26 2019 04:24:32 -06:00 [kern_mgwd:info:2284] 0x81b148c00: 8503e80000002835: ERR: TABLES::disk: _getDisks: Node nmg-fas8040-02 not healthy, Not gathering disk attributes from this node. 00000074.0065fb07 243bba9e Thu Sep 26 2019 04:24:32 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries for kernel on node "nmg-fas8040-02": RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to kernel at 169.254.5.219]. 00000074.0065fb08 243bba9e Thu Sep 26 2019 04:24:32 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to mgwd at 169.254.5.219] 00000074.0065fb09 243bba9e Thu Sep 26 2019 04:24:32 -06:00 [kern_mgwd:info:2284] 0x81b6aa100: 0: ERR: misc_node_info: src/tables/misc_node_info_view.cc:push:264 Error iterating misc_node_info_view: RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to mgwd at 169.254.5.219] 00000074.0065fb0a 243bbaf9 Thu Sep 26 2019 04:24:41 -06:00 [kern_mgwd:info:2284] 0x81d1e4200: 86ffff000000000e: WARNING: job_manager::job_recovery: unclaim_jobs:src/job_rec_int.cc:894 unclaiming failover job 65701994-b79d-11e7-9b07-00a09857ee8f from owner nmg-fas8040-02 00000074.0065fb0b 243bbaf9 Thu Sep 26 2019 04:24:41 -06:00 [kern_mgwd:info:2284] 0x81d1e4200: 86ffff000000000e: WARNING: job_manager::job_recovery: unclaim_jobs:src/job_rec_int.cc:894 unclaiming failover job 656fa976-b79d-11e7-9b07-00a09857ee8f from owner nmg-fas8040-02 00000074.0065fb0c 243bbaf9 Thu Sep 26 2019 04:24:41 -06:00 [kern_mgwd:info:2284] 0x81d1e4200: 86ffff000000000e: WARNING: job_manager::job_recovery: unclaim_jobs:src/job_rec_int.cc:894 unclaiming failover job 179be0d8-b79e-11e7-9b07-00a09857ee8f from owner nmg-fas8040-02 00000074.0065fb0d 243bbb21 Thu Sep 26 2019 04:24:46 -06:00 [kern_mgwd:info:2284] 0x81d1e3d00: 8603e8000029735d: WARNING: job_manager::job_sched: process_modify:src/job_sched.cc:611 UIID:15 UUID:179be0d8-b79e-11e7-9b07-00a09857ee8f name:FabricPool Space Job rc:1 process_modify: job restarted=1, claimed from last_owner=nmg-fas8040-02 00000074.0065fb0e 243bbb21 Thu Sep 26 2019 04:24:46 -06:00 [kern_mgwd:info:2284] 0x81d1e3d00: 8603e80000297360: WARNING: job_manager::job_sched: process_modify:src/job_sched.cc:611 UIID:3 UUID:65701994-b79d-11e7-9b07-00a09857ee8f name:SP Certificate Expiry Check Job rc:1 process_modify: job restarted=1, claimed from last_owner=nmg-fas8040-02 00000074.0065fb0f 243bbb21 Thu Sep 26 2019 04:24:46 -06:00 [kern_mgwd:info:2284] 0x81d1e3d00: 8603e80000297363: WARNING: job_manager::job_sched: process_modify:src/job_sched.cc:611 UIID:4 UUID:656fa976-b79d-11e7-9b07-00a09857ee8f name:SP log collection job rc:1 process_modify: job restarted=1, claimed from last_owner=nmg-fas8040-02 00000074.0065fb11 243bbb49 Thu Sep 26 2019 04:24:49 -06:00 [kern_mgwd:info:2284] 0x81b6aa100: 0: ERR: misc_node_info: src/tables/misc_node_info_view.cc:push:257 Failed to update node: 'nmg-fas8040-01' about misc_node_info for node: 'nmg-fas8040-02': RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to kernel at 169.254.5.219] 00000074.0065fb12 243bbb49 Thu Sep 26 2019 04:24:49 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to mgwd at 169.254.5.219] 00000074.0065fb13 243bbb49 Thu Sep 26 2019 04:24:49 -06:00 [kern_mgwd:info:2284] 0x81b6aa100: 0: ERR: misc_node_info: src/tables/misc_node_info_view.cc:push:264 Error iterating misc_node_info_view: RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to mgwd at 169.254.5.219] 00000074.0065fb17 243bbbb6 Thu Sep 26 2019 04:25:00 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fb18 243bbbb6 Thu Sep 26 2019 04:25:00 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fb1a 243bbbd5 Thu Sep 26 2019 04:25:03 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries for kernel on node "nmg-fas8040-02": RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to kernel at 169.254.5.219]. 00000074.0065fb1b 243bbbd5 Thu Sep 26 2019 04:25:03 -06:00 [kern_mgwd:info:2284] 0x81b7b3200: 8503e8000000283a: NOTICE: TABLES::disk: Added 84 disk recs to the shared reference cache (size 84) 00000074.0065fb1c 243bbbd5 Thu Sep 26 2019 04:25:03 -06:00 [kern_mgwd:info:2284] 0x81b7b3200: 8503e8000000283a: ERR: TABLES::disk: _getDisks: Node nmg-fas8040-02 not healthy, Not gathering disk attributes from this node. 00000074.0065fb1d 243bbbdf Thu Sep 26 2019 04:25:04 -06:00 [kern_mgwd:info:2284] 0x81b6aa100: 0: ERR: misc_node_info: src/tables/misc_node_info_view.cc:push:257 Failed to update node: 'nmg-fas8040-01' about misc_node_info for node: 'nmg-fas8040-02': RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to kernel at 169.254.5.219] 00000074.0065fb1e 243bbbdf Thu Sep 26 2019 04:25:05 -06:00 [kern_mgwd:info:2284] 0x81d1ea100: 86ffff0000000035: WARNING: job_manager::job_store: run:src/job_store_support.cc:568 Job Mgr: rdb_transaction history: OK/0 OK/174 OK/199 Timeout/317 Timeout/617 00000074.0065fb1f 243bbbfa Thu Sep 26 2019 04:25:06 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to mgwd at 169.254.5.219] 00000074.0065fb20 243bbbfa Thu Sep 26 2019 04:25:06 -06:00 [kern_mgwd:info:2284] 0x81b6aa100: 0: ERR: misc_node_info: src/tables/misc_node_info_view.cc:push:264 Error iterating misc_node_info_view: RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to mgwd at 169.254.5.219] 00000074.0065fb23 243bbc9d Thu Sep 26 2019 04:25:24 -06:00 [kern_mgwd:info:2284] 0x81b6aa100: 0: ERR: misc_node_info: src/tables/misc_node_info_view.cc:push:257 Failed to update node: 'nmg-fas8040-01' about misc_node_info for node: 'nmg-fas8040-02': RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to kernel at 169.254.5.219] 00000074.0065fb24 243bbc9d Thu Sep 26 2019 04:25:24 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to mgwd at 169.254.5.219] 00000074.0065fb25 243bbc9d Thu Sep 26 2019 04:25:24 -06:00 [kern_mgwd:info:2284] 0x81b6aa100: 0: ERR: misc_node_info: src/tables/misc_node_info_view.cc:push:264 Error iterating misc_node_info_view: RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to mgwd at 169.254.5.219] 00000074.0065fb4b 243bbcd7 Thu Sep 26 2019 04:25:29 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fb4c 243bbcd7 Thu Sep 26 2019 04:25:29 -06:00 [kern_mgwd:info:2284] 0x81b7b3c00: 8503e80000002847: ERR: TABLES::disk: _getDisks: Node nmg-fas8040-02 not healthy, Not gathering disk attributes from this node. 00000074.0065fb4d 243bbcd7 Thu Sep 26 2019 04:25:29 -06:00 [kern_mgwd:info:2284] A [src/rdb/HAM.cc 1233 (0x81b7b5000)]: checkHASFOConfigVerbose: haConfigured: True, result HA_AGENT_CONFIGURED. 00000074.0065fb4e 243bbcd7 Thu Sep 26 2019 04:25:29 -06:00 [kern_mgwd:info:2284] 0x81b7b8200: 8503e8000000284a: ERR: AggrEfficiency: src/tables/aggr_efficiency.cc:smdb_error aggr_efficiency_iterator::_getAggrDetails(const smdb_type_aggr_name &, smdb_type_Uuid &, smdb_type_filerid &):122 Failed to get aggregate information from VLDB for aggregate , Reason: entry doesn't exist 00000074.0065fb4f 243bbcd7 Thu Sep 26 2019 04:25:29 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fb50 243bbceb Thu Sep 26 2019 04:25:31 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries for vifmgr on node "nmg-fas8040-02": RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to vifmgr at 169.254.5.219]. 00000074.0065fb51 243bbcfd Thu Sep 26 2019 04:25:33 -06:00 [kern_mgwd:info:2284] ZSM: shttpc_connect failed: Operation timed out [TO=4s TRT=4.001s =>169.254.5.219:951 CN=11023/1] {na_zsm_socket_open:575} 00000074.0065fb52 243bbcfd Thu Sep 26 2019 04:25:33 -06:00 [kern_mgwd:info:2284] ZSM: KSMF REQ FAILED: sf-status - kSMF alternate path failed to host 169.254.5.219 with a kSMF ERROR: RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to kernel at 169.254.5.219] [TO=20s =>169.254.5.219:951 CN=11023/2] {ksmf_invoke:314} 00000074.0065fb53 243bbcfd Thu Sep 26 2019 04:25:33 -06:00 [kern_mgwd:info:2284] ZAPI sf-status failed. Host: 169.254.5.219, Status: 1, Reason: ZSM - failed, status code = 572, extra = kSMF alternate path failed to host 169.254.5.219 with a kSMF ERROR: RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to kernel at 169.254.5.219], max 20s [169.254.5.219:951], Error: 13057 00000074.0065fb54 243bbcfd Thu Sep 26 2019 04:25:33 -06:00 [kern_mgwd:info:2284] A [src/rdb/HAM.cc 1233 (0x81b7b6900)]: checkHASFOConfigVerbose: haConfigured: True, result HA_AGENT_CONFIGURED. 00000074.0065fb56 243bbd3d Thu Sep 26 2019 04:25:39 -06:00 [kern_mgwd:info:2284] 0x81b6aa100: 0: ERR: misc_node_info: src/tables/misc_node_info_view.cc:push:257 Failed to update node: 'nmg-fas8040-01' about misc_node_info for node: 'nmg-fas8040-02': RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to kernel at 169.254.5.219] 00000074.0065fb78 243bbd4b Thu Sep 26 2019 04:25:41 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to mgwd at 169.254.5.219] 00000074.0065fb79 243bbd4b Thu Sep 26 2019 04:25:41 -06:00 [kern_mgwd:info:2284] 0x81b6aa100: 0: ERR: misc_node_info: src/tables/misc_node_info_view.cc:push:264 Error iterating misc_node_info_view: RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to mgwd at 169.254.5.219] 00000074.0065fb7a 243bbd4b Thu Sep 26 2019 04:25:41 -06:00 [kern_mgwd:info:2284] ZSM: shttpc_connect failed: Operation timed out [TO=4s TRT=4.001s =>169.254.5.219:951 CN=11025/1] {na_zsm_socket_open:575} 00000074.0065fb7d 243bbdfa Thu Sep 26 2019 04:25:58 -06:00 [kern_mgwd:info:2284] 0x81b6aa100: 0: ERR: misc_node_info: src/tables/misc_node_info_view.cc:push:257 Failed to update node: 'nmg-fas8040-01' about misc_node_info for node: 'nmg-fas8040-02': RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to kernel at 169.254.5.219] 00000074.0065fb7e 243bbdfa Thu Sep 26 2019 04:25:58 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to mgwd at 169.254.5.219] 00000074.0065fb7f 243bbdfa Thu Sep 26 2019 04:25:58 -06:00 [kern_mgwd:info:2284] 0x81b6aa100: 0: ERR: misc_node_info: src/tables/misc_node_info_view.cc:push:264 Error iterating misc_node_info_view: RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to mgwd at 169.254.5.219] 00000074.0065fb82 243bbe17 Thu Sep 26 2019 04:26:01 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fb83 243bbe17 Thu Sep 26 2019 04:26:01 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fb84 243bbe90 Thu Sep 26 2019 04:26:13 -06:00 [kern_mgwd:info:2284] 0x81b6aa100: 0: ERR: misc_node_info: src/tables/misc_node_info_view.cc:push:257 Failed to update node: 'nmg-fas8040-01' about misc_node_info for node: 'nmg-fas8040-02': RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to kernel at 169.254.5.219] 00000074.0065fb86 243bbe9c Thu Sep 26 2019 04:26:15 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to mgwd at 169.254.5.219] 00000074.0065fb87 243bbe9c Thu Sep 26 2019 04:26:15 -06:00 [kern_mgwd:info:2284] 0x81b6aa100: 0: ERR: misc_node_info: src/tables/misc_node_info_view.cc:push:264 Error iterating misc_node_info_view: RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to mgwd at 169.254.5.219] 00000074.0065fb89 243bbf32 Thu Sep 26 2019 04:26:29 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fb8a 243bbf32 Thu Sep 26 2019 04:26:29 -06:00 [kern_mgwd:info:2284] A [src/rdb/HAM.cc 1233 (0x81b7b5500)]: checkHASFOConfigVerbose: haConfigured: True, result HA_AGENT_CONFIGURED. 00000074.0065fb8b 243bbf32 Thu Sep 26 2019 04:26:29 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fb8e 243bbf49 Thu Sep 26 2019 04:26:32 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries for vifmgr on node "nmg-fas8040-02": RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to vifmgr at 169.254.5.219]. 00000074.0065fb8f 243bbf49 Thu Sep 26 2019 04:26:32 -06:00 [kern_mgwd:info:2284] 0x81b7b9100: 8503e8000000285f: NOTICE: TABLES::disk: Added 84 disk recs to the shared reference cache (size 84) 00000074.0065fb90 243bbf49 Thu Sep 26 2019 04:26:32 -06:00 [kern_mgwd:info:2284] 0x81b7b9100: 8503e8000000285f: ERR: TABLES::disk: _getDisks: Node nmg-fas8040-02 not healthy, Not gathering disk attributes from this node. 00000074.0065fb91 243bbf49 Thu Sep 26 2019 04:26:32 -06:00 [kern_mgwd:info:2284] 0x81b6aa100: 0: ERR: misc_node_info: src/tables/misc_node_info_view.cc:push:257 Failed to update node: 'nmg-fas8040-01' about misc_node_info for node: 'nmg-fas8040-02': RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to kernel at 169.254.5.219] 00000074.0065fb92 243bbf49 Thu Sep 26 2019 04:26:32 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to mgwd at 169.254.5.219] 00000074.0065fb93 243bbf49 Thu Sep 26 2019 04:26:32 -06:00 [kern_mgwd:info:2284] 0x81b6aa100: 0: ERR: misc_node_info: src/tables/misc_node_info_view.cc:push:264 Error iterating misc_node_info_view: RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to mgwd at 169.254.5.219] 00000074.0065fbb5 243bbfdc Thu Sep 26 2019 04:26:47 -06:00 [kern_mgwd:info:2284] 0x81b6aa100: 0: ERR: misc_node_info: src/tables/misc_node_info_view.cc:push:257 Failed to update node: 'nmg-fas8040-01' about misc_node_info for node: 'nmg-fas8040-02': RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to kernel at 169.254.5.219] 00000074.0065fbb6 243bbff0 Thu Sep 26 2019 04:26:49 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to mgwd at 169.254.5.219] 00000074.0065fbb7 243bbff0 Thu Sep 26 2019 04:26:49 -06:00 [kern_mgwd:info:2284] 0x81b6aa100: 0: ERR: misc_node_info: src/tables/misc_node_info_view.cc:push:264 Error iterating misc_node_info_view: RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to mgwd at 169.254.5.219] 00000074.0065fbb8 243bbff0 Thu Sep 26 2019 04:26:49 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to mgwd at 169.254.5.219] 00000074.0065fbb9 243bbff0 Thu Sep 26 2019 04:26:49 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to mgwd at 169.254.5.219] 00000074.0065fbbb 243bc069 Thu Sep 26 2019 04:27:00 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fbbc 243bc069 Thu Sep 26 2019 04:27:00 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fbc0 243bc09a Thu Sep 26 2019 04:27:06 -06:00 [kern_mgwd:info:2284] 0x81b6aa100: 0: ERR: misc_node_info: src/tables/misc_node_info_view.cc:push:257 Failed to update node: 'nmg-fas8040-01' about misc_node_info for node: 'nmg-fas8040-02': RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to kernel at 169.254.5.219] 00000074.0065fbc1 243bc09a Thu Sep 26 2019 04:27:06 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to mgwd at 169.254.5.219] 00000074.0065fbc2 243bc09a Thu Sep 26 2019 04:27:06 -06:00 [kern_mgwd:info:2284] 0x81b6aa100: 0: ERR: misc_node_info: src/tables/misc_node_info_view.cc:push:264 Error iterating misc_node_info_view: RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to mgwd at 169.254.5.219] 00000074.0065fbf5 243bc0e0 Thu Sep 26 2019 04:27:12 -06:00 [kern_mgwd:info:2284] 0x81b7b8c00: 8503e8000000286b: ERR: AggrEfficiency: src/tables/aggr_efficiency.cc:smdb_error aggr_efficiency_iterator::_getAggrDetails(const smdb_type_aggr_name &, smdb_type_Uuid &, smdb_type_filerid &):122 Failed to get aggregate information from VLDB for aggregate , Reason: entry doesn't exist 00000074.0065fbf6 243bc0e0 Thu Sep 26 2019 04:27:12 -06:00 [kern_mgwd:info:2284] 0x81b149b00: 8503e8000000286a: ERR: TABLES::disk: _getDisks: Node nmg-fas8040-02 not healthy, Not gathering disk attributes from this node. 00000074.0065fc13 243bc0e0 Thu Sep 26 2019 04:27:12 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fc27 243bc0e0 Thu Sep 26 2019 04:27:12 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fc28 243bc0e0 Thu Sep 26 2019 04:27:13 -06:00 [kern_mgwd:info:2284] A [src/rdb/HAM.cc 1233 (0x81b7b3200)]: checkHASFOConfigVerbose: haConfigured: True, result HA_AGENT_CONFIGURED. 00000074.0065fc49 243bc0f4 Thu Sep 26 2019 04:27:15 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries for vifmgr on node "nmg-fas8040-02": RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to vifmgr at 169.254.5.219]. 00000074.0065fc4b 243bc119 Thu Sep 26 2019 04:27:17 -06:00 [kern_mgwd:info:2284] ZSM: shttpc_connect failed: Operation timed out [TO=4s TRT=4.001s =>169.254.5.219:951 CN=11027/1] {na_zsm_socket_open:575} 00000074.0065fc4c 243bc119 Thu Sep 26 2019 04:27:17 -06:00 [kern_mgwd:info:2284] ZSM: KSMF REQ FAILED: sf-status - kSMF alternate path failed to host 169.254.5.219 with a kSMF ERROR: RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to kernel at 169.254.5.219] [TO=20s TRT=0.001s =>169.254.5.219:951 CN=11027/2] {ksmf_invoke:314} 00000074.0065fc4d 243bc119 Thu Sep 26 2019 04:27:17 -06:00 [kern_mgwd:info:2284] ZAPI sf-status failed. Host: 169.254.5.219, Status: 1, Reason: ZSM - failed, status code = 572, extra = kSMF alternate path failed to host 169.254.5.219 with a kSMF ERROR: RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to kernel at 169.254.5.219], took 0.001s, max 20s [169.254.5.219:9, Error: 13057 00000074.0065fc4e 243bc119 Thu Sep 26 2019 04:27:17 -06:00 [kern_mgwd:info:2284] A [src/rdb/HAM.cc 1233 (0x81b7b7d00)]: checkHASFOConfigVerbose: haConfigured: True, result HA_AGENT_CONFIGURED. 00000074.0065fc58 243bc119 Thu Sep 26 2019 04:27:17 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries for vifmgr on node "nmg-fas8040-02": RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to vifmgr at 169.254.5.219]. 00000074.0065fc5b 243bc119 Thu Sep 26 2019 04:27:18 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries for vifmgr on node "nmg-fas8040-02": RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to vifmgr at 169.254.5.219]. 00000074.0065fc82 243bc130 Thu Sep 26 2019 04:27:21 -06:00 [kern_mgwd:info:2284] 0x81b6aa100: 0: ERR: misc_node_info: src/tables/misc_node_info_view.cc:push:257 Failed to update node: 'nmg-fas8040-01' about misc_node_info for node: 'nmg-fas8040-02': RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to kernel at 169.254.5.219] 00000074.0065fc83 243bc145 Thu Sep 26 2019 04:27:23 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to mgwd at 169.254.5.219] 00000074.0065fc84 243bc145 Thu Sep 26 2019 04:27:23 -06:00 [kern_mgwd:info:2284] 0x81b6aa100: 0: ERR: misc_node_info: src/tables/misc_node_info_view.cc:push:264 Error iterating misc_node_info_view: RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to mgwd at 169.254.5.219] 00000074.0065fc86 243bc15b Thu Sep 26 2019 04:27:25 -06:00 [kern_mgwd:info:2284] ZSM: shttpc_connect failed: Operation timed out [TO=4s TRT=4.002s =>169.254.5.219:951 CN=11028/1] {na_zsm_socket_open:575} 00000074.0065fc88 243bc18a Thu Sep 26 2019 04:27:29 -06:00 [kern_mgwd:info:2284] 0x81b7b6900: 8503e80000002892: NOTICE: TABLES::disk: Added 84 disk recs to the shared reference cache (size 84) 00000074.0065fc89 243bc18a Thu Sep 26 2019 04:27:29 -06:00 [kern_mgwd:info:2284] 0x81b7b6900: 8503e80000002892: ERR: TABLES::disk: _getDisks: Node nmg-fas8040-02 not healthy, Not gathering disk attributes from this node. 00000074.0065fc8a 243bc18a Thu Sep 26 2019 04:27:29 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fc8b 243bc18a Thu Sep 26 2019 04:27:30 -06:00 [kern_mgwd:info:2284] 0x81b7b9600: 8503e80000002896: ERR: AggrEfficiency: src/tables/aggr_efficiency.cc:smdb_error aggr_efficiency_iterator::_getAggrDetails(const smdb_type_aggr_name &, smdb_type_Uuid &, smdb_type_filerid &):122 Failed to get aggregate information from VLDB for aggregate , Reason: entry doesn't exist 00000074.0065fc8c 243bc18a Thu Sep 26 2019 04:27:30 -06:00 [kern_mgwd:info:2284] A [src/rdb/HAM.cc 1233 (0x81b7b8c00)]: checkHASFOConfigVerbose: haConfigured: True, result HA_AGENT_CONFIGURED. 00000074.0065fc8d 243bc18a Thu Sep 26 2019 04:27:30 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fc8e 243bc18a Thu Sep 26 2019 04:27:30 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries for vifmgr on node "nmg-fas8040-02": RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to vifmgr at 169.254.5.219]. 00000074.0065fcb0 243bc1b3 Thu Sep 26 2019 04:27:34 -06:00 [kern_mgwd:info:2284] ZSM: shttpc_connect failed: Operation timed out [TO=4s TRT=4.002s =>169.254.5.219:951 CN=11030/1] {na_zsm_socket_open:575} 00000074.0065fcb1 243bc1b3 Thu Sep 26 2019 04:27:34 -06:00 [kern_mgwd:info:2284] ZSM: KSMF REQ FAILED: sf-status - kSMF alternate path failed to host 169.254.5.219 with a kSMF ERROR: RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to kernel at 169.254.5.219] [TO=20s =>169.254.5.219:951 CN=11030/2] {ksmf_invoke:314} 00000074.0065fcb2 243bc1b3 Thu Sep 26 2019 04:27:34 -06:00 [kern_mgwd:info:2284] ZAPI sf-status failed. Host: 169.254.5.219, Status: 1, Reason: ZSM - failed, status code = 572, extra = kSMF alternate path failed to host 169.254.5.219 with a kSMF ERROR: RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to kernel at 169.254.5.219], max 20s [169.254.5.219:951], Error: 13057 00000074.0065fcb3 243bc1b3 Thu Sep 26 2019 04:27:34 -06:00 [kern_mgwd:info:2284] A [src/rdb/HAM.cc 1233 (0x81b7b5a00)]: checkHASFOConfigVerbose: haConfigured: True, result HA_AGENT_CONFIGURED. 00000074.0065fcba 243bc1f0 Thu Sep 26 2019 04:27:39 -06:00 [kern_mgwd:info:2284] ZSM: shttpc_connect failed: Operation timed out [TO=4s TRT=4.002s =>169.254.5.219:951 CN=11031/1] {na_zsm_socket_open:575} 00000074.0065fcbb 243bc1f0 Thu Sep 26 2019 04:27:40 -06:00 [kern_mgwd:info:2284] 0x81b6aa100: 0: ERR: misc_node_info: src/tables/misc_node_info_view.cc:push:257 Failed to update node: 'nmg-fas8040-01' about misc_node_info for node: 'nmg-fas8040-02': RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to kernel at 169.254.5.219] 00000074.0065fcbc 243bc1f0 Thu Sep 26 2019 04:27:40 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to mgwd at 169.254.5.219] 00000074.0065fcbd 243bc1f0 Thu Sep 26 2019 04:27:40 -06:00 [kern_mgwd:info:2284] 0x81b6aa100: 0: ERR: misc_node_info: src/tables/misc_node_info_view.cc:push:264 Error iterating misc_node_info_view: RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to mgwd at 169.254.5.219] 00000074.0065fcc4 243bc285 Thu Sep 26 2019 04:27:55 -06:00 [kern_mgwd:info:2284] 0x81b6aa100: 0: ERR: misc_node_info: src/tables/misc_node_info_view.cc:push:257 Failed to update node: 'nmg-fas8040-01' about misc_node_info for node: 'nmg-fas8040-02': RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to kernel at 169.254.5.219] 00000074.0065fcc5 243bc299 Thu Sep 26 2019 04:27:57 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to mgwd at 169.254.5.219] 00000074.0065fcc6 243bc299 Thu Sep 26 2019 04:27:57 -06:00 [kern_mgwd:info:2284] 0x81b6aa100: 0: ERR: misc_node_info: src/tables/misc_node_info_view.cc:push:264 Error iterating misc_node_info_view: RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to mgwd at 169.254.5.219] 00000074.0065fcc7 243bc2c2 Thu Sep 26 2019 04:28:00 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fcc8 243bc2c2 Thu Sep 26 2019 04:28:00 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fccc 243bc343 Thu Sep 26 2019 04:28:14 -06:00 [kern_mgwd:info:2284] 0x81b6aa100: 0: ERR: misc_node_info: src/tables/misc_node_info_view.cc:push:257 Failed to update node: 'nmg-fas8040-01' about misc_node_info for node: 'nmg-fas8040-02': RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to kernel at 169.254.5.219] 00000074.0065fccd 243bc343 Thu Sep 26 2019 04:28:14 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to mgwd at 169.254.5.219] 00000074.0065fcce 243bc343 Thu Sep 26 2019 04:28:14 -06:00 [kern_mgwd:info:2284] 0x81b6aa100: 0: ERR: misc_node_info: src/tables/misc_node_info_view.cc:push:264 Error iterating misc_node_info_view: RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to mgwd at 169.254.5.219] 00000074.0065fcd2 243bc3e1 Thu Sep 26 2019 04:28:29 -06:00 [kern_mgwd:info:2284] 0x81b6aa100: 0: ERR: misc_node_info: src/tables/misc_node_info_view.cc:push:257 Failed to update node: 'nmg-fas8040-01' about misc_node_info for node: 'nmg-fas8040-02': RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to kernel at 169.254.5.219] 00000074.0065fcd3 243bc3e1 Thu Sep 26 2019 04:28:30 -06:00 [kern_mgwd:info:2284] 0x81b7b8c00: 8503e800000028ad: NOTICE: TABLES::disk: Added 84 disk recs to the shared reference cache (size 84) 00000074.0065fcd4 243bc3e1 Thu Sep 26 2019 04:28:30 -06:00 [kern_mgwd:info:2284] 0x81b7b8c00: 8503e800000028ad: ERR: TABLES::disk: _getDisks: Node nmg-fas8040-02 not healthy, Not gathering disk attributes from this node. 00000074.0065fcd5 243bc3f9 Thu Sep 26 2019 04:28:31 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to mgwd at 169.254.5.219] 00000074.0065fcd6 243bc3f9 Thu Sep 26 2019 04:28:31 -06:00 [kern_mgwd:info:2284] 0x81b6aa100: 0: ERR: misc_node_info: src/tables/misc_node_info_view.cc:push:264 Error iterating misc_node_info_view: RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to mgwd at 169.254.5.219] 00000074.0065fcd7 243bc3fa Thu Sep 26 2019 04:28:31 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fcf8 243bc3fa Thu Sep 26 2019 04:28:32 -06:00 [kern_mgwd:info:2284] A [src/rdb/HAM.cc 1233 (0x81b7b3700)]: checkHASFOConfigVerbose: haConfigured: True, result HA_AGENT_CONFIGURED. 00000074.0065fcf9 243bc3fa Thu Sep 26 2019 04:28:32 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fcfa 243bc3fa Thu Sep 26 2019 04:28:32 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries for vifmgr on node "nmg-fas8040-02": RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to vifmgr at 169.254.5.219]. 00000074.0065fcfe 243bc4a0 Thu Sep 26 2019 04:28:48 -06:00 [kern_mgwd:info:2284] 0x81b6aa100: 0: ERR: misc_node_info: src/tables/misc_node_info_view.cc:push:257 Failed to update node: 'nmg-fas8040-01' about misc_node_info for node: 'nmg-fas8040-02': RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to kernel at 169.254.5.219] 00000074.0065fcff 243bc4a0 Thu Sep 26 2019 04:28:48 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to mgwd at 169.254.5.219] 00000074.0065fd00 243bc4a0 Thu Sep 26 2019 04:28:48 -06:00 [kern_mgwd:info:2284] 0x81b6aa100: 0: ERR: misc_node_info: src/tables/misc_node_info_view.cc:push:264 Error iterating misc_node_info_view: RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to mgwd at 169.254.5.219] 00000074.0065fd23 243bc4d1 Thu Sep 26 2019 04:28:53 -06:00 [kern_mgwd:info:2284] A [src/rdb/HAM.cc 1233 (0x81b7b4b00)]: checkHASFOConfigVerbose: haConfigured: True, result HA_AGENT_CONFIGURED. 00000074.0065fd24 243bc53c Thu Sep 26 2019 04:29:02 -06:00 [kern_mgwd:info:2284] 0x81b7b8200: 8503e800000028b7: ERR: TABLES::disk: _getDisks: Node nmg-fas8040-02 not healthy, Not gathering disk attributes from this node. 00000074.0065fd25 243bc53c Thu Sep 26 2019 04:29:02 -06:00 [kern_mgwd:info:2284] 0x81b7b8700: 8503e800000028b9: ERR: AggrEfficiency: src/tables/aggr_efficiency.cc:smdb_error aggr_efficiency_iterator::_getAggrDetails(const smdb_type_aggr_name &, smdb_type_Uuid &, smdb_type_filerid &):122 Failed to get aggregate information from VLDB for aggregate , Reason: entry doesn't exist 00000074.0065fd26 243bc53c Thu Sep 26 2019 04:29:02 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fd27 243bc53c Thu Sep 26 2019 04:29:02 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fd28 243bc53c Thu Sep 26 2019 04:29:03 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fd29 243bc53c Thu Sep 26 2019 04:29:03 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fd34 243bc53c Thu Sep 26 2019 04:29:03 -06:00 [kern_mgwd:info:2284] A [src/rdb/HAM.cc 1233 (0x81b7b6900)]: checkHASFOConfigVerbose: haConfigured: True, result HA_AGENT_CONFIGURED. 00000074.0065fd4b 243bc53c Thu Sep 26 2019 04:29:03 -06:00 [kern_mgwd:info:2284] 0x81b6aa100: 0: ERR: misc_node_info: src/tables/misc_node_info_view.cc:push:257 Failed to update node: 'nmg-fas8040-01' about misc_node_info for node: 'nmg-fas8040-02': RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to kernel at 169.254.5.219] 00000074.0065fd4c 243bc53c Thu Sep 26 2019 04:29:03 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to mgwd at 169.254.5.219] 00000074.0065fd4d 243bc53c Thu Sep 26 2019 04:29:03 -06:00 [kern_mgwd:info:2284] 0x81b6aa100: 0: ERR: misc_node_info: src/tables/misc_node_info_view.cc:push:264 Error iterating misc_node_info_view: RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to mgwd at 169.254.5.219] 00000074.0065fd4f 243bc53c Thu Sep 26 2019 04:29:04 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries for vifmgr on node "nmg-fas8040-02": RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to vifmgr at 169.254.5.219]. 00000074.0065fd52 243bc555 Thu Sep 26 2019 04:29:07 -06:00 [kern_mgwd:info:2284] ZSM: shttpc_connect failed: Operation timed out [TO=4s TRT=4.001s =>169.254.5.219:951 CN=11032/1] {na_zsm_socket_open:575} 00000074.0065fd53 243bc555 Thu Sep 26 2019 04:29:07 -06:00 [kern_mgwd:info:2284] ZSM: KSMF REQ FAILED: sf-status - kSMF alternate path failed to host 169.254.5.219 with a kSMF ERROR: RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to kernel at 169.254.5.219] [TO=20s =>169.254.5.219:951 CN=11032/2] {ksmf_invoke:314} 00000074.0065fd54 243bc555 Thu Sep 26 2019 04:29:07 -06:00 [kern_mgwd:info:2284] ZAPI sf-status failed. Host: 169.254.5.219, Status: 1, Reason: ZSM - failed, status code = 572, extra = kSMF alternate path failed to host 169.254.5.219 with a kSMF ERROR: RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to kernel at 169.254.5.219], max 20s [169.254.5.219:951], Error: 13057 00000074.0065fd55 243bc555 Thu Sep 26 2019 04:29:07 -06:00 [kern_mgwd:info:2284] A [src/rdb/HAM.cc 1233 (0x81b7b4100)]: checkHASFOConfigVerbose: haConfigured: True, result HA_AGENT_CONFIGURED. 00000074.0065fd57 243bc594 Thu Sep 26 2019 04:29:13 -06:00 [kern_mgwd:info:2284] ZSM: shttpc_connect failed: Operation timed out [TO=4s TRT=4.001s =>169.254.5.219:951 CN=11033/1] {na_zsm_socket_open:575} 00000074.0065fd59 243bc5d8 Thu Sep 26 2019 04:29:20 -06:00 [kern_mgwd:info:2284] 0x81b6aa100: 0: ERR: misc_node_info: src/tables/misc_node_info_view.cc:push:257 Failed to update node: 'nmg-fas8040-01' about misc_node_info for node: 'nmg-fas8040-02': RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to kernel at 169.254.5.219] 00000074.0065fd5a 243bc5d8 Thu Sep 26 2019 04:29:20 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to mgwd at 169.254.5.219] 00000074.0065fd5b 243bc5d8 Thu Sep 26 2019 04:29:20 -06:00 [kern_mgwd:info:2284] 0x81b6aa100: 0: ERR: misc_node_info: src/tables/misc_node_info_view.cc:push:264 Error iterating misc_node_info_view: RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to mgwd at 169.254.5.219] 00000074.0065fd7d 243bc673 Thu Sep 26 2019 04:29:35 -06:00 [kern_mgwd:info:2284] 0x81b6aa100: 0: ERR: misc_node_info: src/tables/misc_node_info_view.cc:push:257 Failed to update node: 'nmg-fas8040-01' about misc_node_info for node: 'nmg-fas8040-02': RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to kernel at 169.254.5.219] 00000074.0065fd80 243bc682 Thu Sep 26 2019 04:29:37 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to mgwd at 169.254.5.219] 00000074.0065fd81 243bc682 Thu Sep 26 2019 04:29:37 -06:00 [kern_mgwd:info:2284] 0x81b6aa100: 0: ERR: misc_node_info: src/tables/misc_node_info_view.cc:push:264 Error iterating misc_node_info_view: RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to mgwd at 169.254.5.219] 00000074.0065fd82 243bc6da Thu Sep 26 2019 04:29:46 -06:00 [kern_mgwd:info:2284] Info: uuid_to_hostname_imp: filerid to hostname 00000074.0065fd83 243bc6da Thu Sep 26 2019 04:29:46 -06:00 [kern_mgwd:info:2284] Info: uuid_to_hostname_imp: hostname is nmg-fas8040-02. 00000074.0065fd84 243bc6da Thu Sep 26 2019 04:29:46 -06:00 [kern_mgwd:info:2284] Info: uuid_to_hostname_imp: filerid to hostname: Successful 00000074.0065fd8b 243bc731 Thu Sep 26 2019 04:29:54 -06:00 [kern_mgwd:info:2284] 0x81b6aa100: 0: ERR: misc_node_info: src/tables/misc_node_info_view.cc:push:257 Failed to update node: 'nmg-fas8040-01' about misc_node_info for node: 'nmg-fas8040-02': RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to kernel at 169.254.5.219] 00000074.0065fd8c 243bc731 Thu Sep 26 2019 04:29:54 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to mgwd at 169.254.5.219] 00000074.0065fd8d 243bc731 Thu Sep 26 2019 04:29:54 -06:00 [kern_mgwd:info:2284] 0x81b6aa100: 0: ERR: misc_node_info: src/tables/misc_node_info_view.cc:push:264 Error iterating misc_node_info_view: RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to mgwd at 169.254.5.219] 00000074.0065fd91 243bc76e Thu Sep 26 2019 04:30:00 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fd92 243bc76e Thu Sep 26 2019 04:30:00 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fd94 243bc784 Thu Sep 26 2019 04:30:03 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fd95 243bc784 Thu Sep 26 2019 04:30:03 -06:00 [kern_mgwd:info:2284] 0x81b7b8700: 8503e800000028cf: NOTICE: TABLES::disk: Added 84 disk recs to the shared reference cache (size 84) 00000074.0065fd96 243bc784 Thu Sep 26 2019 04:30:03 -06:00 [kern_mgwd:info:2284] 0x81b7b8700: 8503e800000028cf: ERR: TABLES::disk: _getDisks: Node nmg-fas8040-02 not healthy, Not gathering disk attributes from this node. 00000074.0065fd97 243bc784 Thu Sep 26 2019 04:30:03 -06:00 [kern_mgwd:info:2284] A [src/rdb/HAM.cc 1233 (0x81b7b7800)]: checkHASFOConfigVerbose: haConfigured: True, result HA_AGENT_CONFIGURED. 00000074.0065fd98 243bc784 Thu Sep 26 2019 04:30:03 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fd99 243bc798 Thu Sep 26 2019 04:30:05 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries for vifmgr on node "nmg-fas8040-02": RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to vifmgr at 169.254.5.219]. 00000074.0065fd9c 243bc7c2 Thu Sep 26 2019 04:30:09 -06:00 [kern_mgwd:info:2284] 0x81b6aa100: 0: ERR: misc_node_info: src/tables/misc_node_info_view.cc:push:257 Failed to update node: 'nmg-fas8040-01' about misc_node_info for node: 'nmg-fas8040-02': RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to kernel at 169.254.5.219] 00000074.0065fd9e 243bc7d6 Thu Sep 26 2019 04:30:11 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to mgwd at 169.254.5.219] 00000074.0065fd9f 243bc7d6 Thu Sep 26 2019 04:30:11 -06:00 [kern_mgwd:info:2284] 0x81b6aa100: 0: ERR: misc_node_info: src/tables/misc_node_info_view.cc:push:264 Error iterating misc_node_info_view: RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to mgwd at 169.254.5.219] 00000074.0065fda2 243bc881 Thu Sep 26 2019 04:30:28 -06:00 [kern_mgwd:info:2284] 0x81b6aa100: 0: ERR: misc_node_info: src/tables/misc_node_info_view.cc:push:257 Failed to update node: 'nmg-fas8040-01' about misc_node_info for node: 'nmg-fas8040-02': RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to kernel at 169.254.5.219] 00000074.0065fda3 243bc881 Thu Sep 26 2019 04:30:28 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to mgwd at 169.254.5.219] 00000074.0065fda4 243bc881 Thu Sep 26 2019 04:30:28 -06:00 [kern_mgwd:info:2284] 0x81b6aa100: 0: ERR: misc_node_info: src/tables/misc_node_info_view.cc:push:264 Error iterating misc_node_info_view: RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to mgwd at 169.254.5.219] 00000074.0065fdae 243bc8be Thu Sep 26 2019 04:30:32 -06:00 [kern_mgwd:info:2284] 0x81b6aa600: 0: ERR: RPCServer: mgwd_xml_start_1_svc: Called for asup_pathname(/mroot/etc/log/autosupport/201909260430.0.files) 00000074.0065fdaf 243bc8be Thu Sep 26 2019 04:30:32 -06:00 [kern_mgwd:info:2284] 0x81b6aa600: 0: ERR: RPCServer: mgwd_xml_start_1_svc: current_asup_xml exists. State: (4) 00000074.0065fdb0 243bc8be Thu Sep 26 2019 04:30:32 -06:00 [kern_mgwd:info:2284] 0x81b6aa600: 0: ERR: RPCServer: mgwd_xml_start_1_svc: ASUP Started SUCCESS 00000074.0065fdb1 243bc8be Thu Sep 26 2019 04:30:32 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fdb2 243bc8be Thu Sep 26 2019 04:30:32 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fdb3 243bc8be Thu Sep 26 2019 04:30:32 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fdb4 243bc8be Thu Sep 26 2019 04:30:32 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fdb5 243bc8be Thu Sep 26 2019 04:30:32 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fdb6 243bc8be Thu Sep 26 2019 04:30:32 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fdb7 243bc8be Thu Sep 26 2019 04:30:32 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fdb8 243bc8be Thu Sep 26 2019 04:30:32 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fdb9 243bc8be Thu Sep 26 2019 04:30:32 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fdba 243bc8be Thu Sep 26 2019 04:30:32 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fdbb 243bc8be Thu Sep 26 2019 04:30:32 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fdbc 243bc8be Thu Sep 26 2019 04:30:32 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fdbd 243bc8be Thu Sep 26 2019 04:30:32 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fdbe 243bc8be Thu Sep 26 2019 04:30:32 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fdbf 243bc8be Thu Sep 26 2019 04:30:32 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fdc0 243bc8be Thu Sep 26 2019 04:30:32 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fdc1 243bc8be Thu Sep 26 2019 04:30:32 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fdc2 243bc8be Thu Sep 26 2019 04:30:32 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fdc3 243bc8be Thu Sep 26 2019 04:30:32 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fdc4 243bc8be Thu Sep 26 2019 04:30:32 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fdc5 243bc8bf Thu Sep 26 2019 04:30:32 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fdc6 243bc8bf Thu Sep 26 2019 04:30:32 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fdc7 243bc8bf Thu Sep 26 2019 04:30:32 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fdc8 243bc8bf Thu Sep 26 2019 04:30:32 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fdc9 243bc8bf Thu Sep 26 2019 04:30:32 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fdca 243bc8bf Thu Sep 26 2019 04:30:32 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fdcb 243bc8bf Thu Sep 26 2019 04:30:32 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fdcc 243bc8bf Thu Sep 26 2019 04:30:32 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fdcd 243bc8bf Thu Sep 26 2019 04:30:32 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fdce 243bc8bf Thu Sep 26 2019 04:30:32 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fdcf 243bc8bf Thu Sep 26 2019 04:30:32 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fdd0 243bc8bf Thu Sep 26 2019 04:30:32 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fdd1 243bc8bf Thu Sep 26 2019 04:30:32 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fdd2 243bc8bf Thu Sep 26 2019 04:30:32 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fdd3 243bc8bf Thu Sep 26 2019 04:30:32 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fdd4 243bc8bf Thu Sep 26 2019 04:30:32 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fdd5 243bc8bf Thu Sep 26 2019 04:30:32 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fdd6 243bc8bf Thu Sep 26 2019 04:30:32 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fdd7 243bc8bf Thu Sep 26 2019 04:30:32 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fdd8 243bc8bf Thu Sep 26 2019 04:30:32 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fdd9 243bc8bf Thu Sep 26 2019 04:30:32 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fdda 243bc8bf Thu Sep 26 2019 04:30:32 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fddb 243bc8bf Thu Sep 26 2019 04:30:32 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fddc 243bc8bf Thu Sep 26 2019 04:30:32 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fddd 243bc8bf Thu Sep 26 2019 04:30:32 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fdde 243bc8bf Thu Sep 26 2019 04:30:32 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fddf 243bc8bf Thu Sep 26 2019 04:30:32 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fde0 243bc8bf Thu Sep 26 2019 04:30:32 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fde1 243bc8bf Thu Sep 26 2019 04:30:32 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fde2 243bc8bf Thu Sep 26 2019 04:30:33 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fde3 243bc8bf Thu Sep 26 2019 04:30:33 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fde4 243bc8bf Thu Sep 26 2019 04:30:33 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fde5 243bc8bf Thu Sep 26 2019 04:30:33 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fde6 243bc8bf Thu Sep 26 2019 04:30:33 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fde7 243bc8bf Thu Sep 26 2019 04:30:33 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fde8 243bc8bf Thu Sep 26 2019 04:30:33 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fde9 243bc8bf Thu Sep 26 2019 04:30:33 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fdea 243bc8bf Thu Sep 26 2019 04:30:33 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fdeb 243bc8bf Thu Sep 26 2019 04:30:33 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fdec 243bc8bf Thu Sep 26 2019 04:30:33 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fded 243bc8bf Thu Sep 26 2019 04:30:33 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fdee 243bc8bf Thu Sep 26 2019 04:30:33 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fdef 243bc8bf Thu Sep 26 2019 04:30:33 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fdf0 243bc8bf Thu Sep 26 2019 04:30:33 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fdf1 243bc8bf Thu Sep 26 2019 04:30:33 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fdf2 243bc8bf Thu Sep 26 2019 04:30:33 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fdf3 243bc8bf Thu Sep 26 2019 04:30:33 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fdf4 243bc8bf Thu Sep 26 2019 04:30:33 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fdf5 243bc8bf Thu Sep 26 2019 04:30:33 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fdf6 243bc8bf Thu Sep 26 2019 04:30:33 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fdf7 243bc8bf Thu Sep 26 2019 04:30:33 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fdf8 243bc8bf Thu Sep 26 2019 04:30:33 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fdf9 243bc8bf Thu Sep 26 2019 04:30:33 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fdfa 243bc8bf Thu Sep 26 2019 04:30:33 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fdfb 243bc8bf Thu Sep 26 2019 04:30:33 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fdfc 243bc8bf Thu Sep 26 2019 04:30:33 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fdfd 243bc8bf Thu Sep 26 2019 04:30:33 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fdfe 243bc8bf Thu Sep 26 2019 04:30:33 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fdff 243bc8bf Thu Sep 26 2019 04:30:33 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fe00 243bc8bf Thu Sep 26 2019 04:30:33 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fe01 243bc8bf Thu Sep 26 2019 04:30:33 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fe02 243bc8bf Thu Sep 26 2019 04:30:33 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fe03 243bc8bf Thu Sep 26 2019 04:30:33 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fe04 243bc8bf Thu Sep 26 2019 04:30:33 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fe05 243bc8bf Thu Sep 26 2019 04:30:33 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fe06 243bc8bf Thu Sep 26 2019 04:30:33 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fe07 243bc8bf Thu Sep 26 2019 04:30:33 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fe08 243bc8bf Thu Sep 26 2019 04:30:33 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fe09 243bc8bf Thu Sep 26 2019 04:30:33 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fe0a 243bc8bf Thu Sep 26 2019 04:30:33 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fe0b 243bc8bf Thu Sep 26 2019 04:30:33 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fe0c 243bc8bf Thu Sep 26 2019 04:30:33 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fe0d 243bc8bf Thu Sep 26 2019 04:30:33 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fe0e 243bc8bf Thu Sep 26 2019 04:30:33 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fe0f 243bc8bf Thu Sep 26 2019 04:30:33 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fe10 243bc8bf Thu Sep 26 2019 04:30:33 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fe11 243bc8bf Thu Sep 26 2019 04:30:33 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fe12 243bc8bf Thu Sep 26 2019 04:30:33 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fe13 243bc8bf Thu Sep 26 2019 04:30:33 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fe14 243bc8bf Thu Sep 26 2019 04:30:33 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fe15 243bc8bf Thu Sep 26 2019 04:30:33 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fe16 243bc8bf Thu Sep 26 2019 04:30:33 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fe17 243bc8bf Thu Sep 26 2019 04:30:33 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fe18 243bc8bf Thu Sep 26 2019 04:30:33 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fe19 243bc8bf Thu Sep 26 2019 04:30:33 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fe1a 243bc8bf Thu Sep 26 2019 04:30:33 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fe1b 243bc8bf Thu Sep 26 2019 04:30:33 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fe1c 243bc8bf Thu Sep 26 2019 04:30:33 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fe1d 243bc8bf Thu Sep 26 2019 04:30:33 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fe1e 243bc8bf Thu Sep 26 2019 04:30:33 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fe1f 243bc8bf Thu Sep 26 2019 04:30:33 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fe20 243bc8bf Thu Sep 26 2019 04:30:33 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fe21 243bc8bf Thu Sep 26 2019 04:30:33 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fe22 243bc8bf Thu Sep 26 2019 04:30:33 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fe23 243bc8bf Thu Sep 26 2019 04:30:33 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fe24 243bc8bf Thu Sep 26 2019 04:30:33 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fe25 243bc8bf Thu Sep 26 2019 04:30:33 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fe26 243bc8bf Thu Sep 26 2019 04:30:33 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fe27 243bc8bf Thu Sep 26 2019 04:30:33 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fe28 243bc8bf Thu Sep 26 2019 04:30:33 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fe29 243bc8bf Thu Sep 26 2019 04:30:33 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fe2a 243bc8bf Thu Sep 26 2019 04:30:33 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fe2b 243bc8bf Thu Sep 26 2019 04:30:33 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fe2c 243bc8bf Thu Sep 26 2019 04:30:33 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fe2d 243bc8bf Thu Sep 26 2019 04:30:33 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fe2e 243bc8bf Thu Sep 26 2019 04:30:33 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fe2f 243bc8bf Thu Sep 26 2019 04:30:33 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fe30 243bc8bf Thu Sep 26 2019 04:30:33 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fe31 243bc8bf Thu Sep 26 2019 04:30:33 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fe32 243bc8bf Thu Sep 26 2019 04:30:33 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fe33 243bc8bf Thu Sep 26 2019 04:30:33 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fe34 243bc8bf Thu Sep 26 2019 04:30:33 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fe35 243bc8bf Thu Sep 26 2019 04:30:33 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fe36 243bc8bf Thu Sep 26 2019 04:30:33 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fe37 243bc8bf Thu Sep 26 2019 04:30:33 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fe3f 243bc917 Thu Sep 26 2019 04:30:43 -06:00 [kern_mgwd:info:2284] 0x81b6aa100: 0: ERR: misc_node_info: src/tables/misc_node_info_view.cc:push:257 Failed to update node: 'nmg-fas8040-01' about misc_node_info for node: 'nmg-fas8040-02': RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to kernel at 169.254.5.219] 00000074.0065fe40 243bc931 Thu Sep 26 2019 04:30:45 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to mgwd at 169.254.5.219] 00000074.0065fe41 243bc931 Thu Sep 26 2019 04:30:45 -06:00 [kern_mgwd:info:2284] 0x81b6aa100: 0: ERR: misc_node_info: src/tables/misc_node_info_view.cc:push:264 Error iterating misc_node_info_view: RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to mgwd at 169.254.5.219] 00000074.0065fe66 243bc9d9 Thu Sep 26 2019 04:31:00 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fe67 243bc9d9 Thu Sep 26 2019 04:31:00 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065fe69 243bc9d9 Thu Sep 26 2019 04:31:01 -06:00 [kern_mgwd:info:2284] ZSM: shttpc_connect failed: Operation timed out [TO=4s TRT=4.001s =>169.254.5.219:951 CN=11036/1] {na_zsm_socket_open:575} 00000074.0065fe6c 243bc9d9 Thu Sep 26 2019 04:31:02 -06:00 [kern_mgwd:info:2284] 0x81b6aa100: 0: ERR: misc_node_info: src/tables/misc_node_info_view.cc:push:257 Failed to update node: 'nmg-fas8040-01' about misc_node_info for node: 'nmg-fas8040-02': RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to kernel at 169.254.5.219] 00000074.0065fe6d 243bc9d9 Thu Sep 26 2019 04:31:02 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to mgwd at 169.254.5.219] 00000074.0065fe6e 243bc9d9 Thu Sep 26 2019 04:31:02 -06:00 [kern_mgwd:info:2284] 0x81b6aa100: 0: ERR: misc_node_info: src/tables/misc_node_info_view.cc:push:264 Error iterating misc_node_info_view: RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to mgwd at 169.254.5.219] 00000074.0065fe6f 243bc9d9 Thu Sep 26 2019 04:31:02 -06:00 [kern_mgwd:info:2284] ZSM: KSMF REQ FAILED: system-get-info - kSMF alternate path failed to host 169.254.5.219 with a kSMF ERROR: RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to kernel at 169.254.5.219] [TO=110s TRT=1.003s =>169.254.5.219:951 CN=11036/2] {ksmf_invoke:314} 00000074.0065fe70 243bc9d9 Thu Sep 26 2019 04:31:02 -06:00 [kern_mgwd:info:2284] A [src/rdb/HAM.cc 1233 (0x81b7b5a00)]: checkHASFOConfigVerbose: haConfigured: True, result HA_AGENT_CONFIGURED. 00000074.0065fe72 243bc9f5 Thu Sep 26 2019 04:31:05 -06:00 [kern_mgwd:info:2284] 0x81b7b4100: 8503e800000028e3: ERR: ZapiConnection: sf-status: failed to connect to '169.254.5.219:951 Vers=1.0 3:0:2 CallTO=20 ConnTO=4 PingTO=10' duration 0 00000074.0065fe73 243bc9f5 Thu Sep 26 2019 04:31:05 -06:00 [kern_mgwd:info:2284] ZAPI sf-status failed. Host: 169.254.5.219, Status: 3, Reason: Node "nmg-fas8040-02" (169.254.5.219) not responding to management requests. If the node is under heavy load, try the request again when the node is less busy. If the error persists, contact technical support for assistance, Error: 14007 00000074.0065fe74 243bc9f5 Thu Sep 26 2019 04:31:05 -06:00 [kern_mgwd:info:2284] 0x81b7b4100: 8503e800000028e3: ERR: ZapiConnection: sf-status: failed to connect to '169.254.5.219:951 Vers=1.0 3:0:2 CallTO=20 ConnTO=4 PingTO=10' duration 0 00000074.0065fe75 243bc9f5 Thu Sep 26 2019 04:31:05 -06:00 [kern_mgwd:info:2284] ZAPI sf-status failed. Host: 169.254.5.219, Status: 3, Reason: Node "nmg-fas8040-02" (169.254.5.219) not responding to management requests. If the node is under heavy load, try the request again when the node is less busy. If the error persists, contact technical support for assistance, Error: 14007 00000074.0065fe76 243bca08 Thu Sep 26 2019 04:31:07 -06:00 [kern_mgwd:info:2284] ZSM: shttpc_connect failed: Operation timed out [TO=4s TRT=4.001s =>169.254.5.219:951 CN=11037/1] {na_zsm_socket_open:575} 00000074.0065fe78 243bca6b Thu Sep 26 2019 04:31:17 -06:00 [kern_mgwd:info:2284] 0x81b6aa100: 0: ERR: misc_node_info: src/tables/misc_node_info_view.cc:push:257 Failed to update node: 'nmg-fas8040-01' about misc_node_info for node: 'nmg-fas8040-02': RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to kernel at 169.254.5.219] 00000074.0065fe79 243bca8e Thu Sep 26 2019 04:31:19 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to mgwd at 169.254.5.219] 00000074.0065fe7a 243bca8e Thu Sep 26 2019 04:31:19 -06:00 [kern_mgwd:info:2284] 0x81b6aa100: 0: ERR: misc_node_info: src/tables/misc_node_info_view.cc:push:264 Error iterating misc_node_info_view: RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to mgwd at 169.254.5.219] 00000074.0065feaa 243bcb32 Thu Sep 26 2019 04:31:36 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065feab 243bcb32 Thu Sep 26 2019 04:31:36 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065feac 243bcb32 Thu Sep 26 2019 04:31:36 -06:00 [kern_mgwd:info:2284] A [src/rdb/HAM.cc 1233 (0x81b7b4b00)]: checkHASFOConfigVerbose: haConfigured: True, result HA_AGENT_CONFIGURED. 00000074.0065fead 243bcb32 Thu Sep 26 2019 04:31:36 -06:00 [kern_mgwd:info:2284] 0x81b6aa100: 0: ERR: misc_node_info: src/tables/misc_node_info_view.cc:push:257 Failed to update node: 'nmg-fas8040-01' about misc_node_info for node: 'nmg-fas8040-02': RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to kernel at 169.254.5.219] 00000074.0065feae 243bcb32 Thu Sep 26 2019 04:31:36 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to mgwd at 169.254.5.219] 00000074.0065feaf 243bcb32 Thu Sep 26 2019 04:31:36 -06:00 [kern_mgwd:info:2284] 0x81b6aa100: 0: ERR: misc_node_info: src/tables/misc_node_info_view.cc:push:264 Error iterating misc_node_info_view: RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to mgwd at 169.254.5.219] 00000074.0065feb0 243bcb32 Thu Sep 26 2019 04:31:36 -06:00 [kern_mgwd:info:2284] update_phase_data: populateData - No phase information found entry doesn't exist { ANDU_LOG in populateData() at src/tables/cluster_image.cc:3824 } 00000074.0065feb1 243bcb32 Thu Sep 26 2019 04:31:36 -06:00 [kern_mgwd:info:2284] update_phase_data: populateData - No phase information found entry doesn't exist { ANDU_LOG in populateData() at src/tables/cluster_image.cc:3824 } 00000074.0065feb2 243bcb32 Thu Sep 26 2019 04:31:36 -06:00 [kern_mgwd:info:2284] update_phase_data: populateData - No phase information found entry doesn't exist { ANDU_LOG in populateData() at src/tables/cluster_image.cc:3824 } 00000074.0065fee1 243bcb32 Thu Sep 26 2019 04:31:37 -06:00 [kern_mgwd:info:2284] 0x81b148c00: 8503e800000028fd: NOTICE: TABLES::disk: Added 84 disk recs to the shared reference cache (size 84) 00000074.0065fee2 243bcb32 Thu Sep 26 2019 04:31:37 -06:00 [kern_mgwd:info:2284] 0x81b148c00: 8503e800000028fd: ERR: TABLES::disk: _getDisks: Node nmg-fas8040-02 not healthy, Not gathering disk attributes from this node. 00000074.0065fee3 243bcb50 Thu Sep 26 2019 04:31:40 -06:00 [kern_mgwd:info:2284] ZSM: shttpc_connect failed: Operation timed out [TO=4s TRT=4.001s =>169.254.5.219:951 CN=11040/1] {na_zsm_socket_open:575} 00000074.0065fee4 243bcb50 Thu Sep 26 2019 04:31:40 -06:00 [kern_mgwd:info:2284] ZSM: KSMF REQ FAILED: system-get-info - kSMF alternate path failed to host 169.254.5.219 with a kSMF ERROR: RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to kernel at 169.254.5.219] [TO=110s =>169.254.5.219:951 CN=11040/2] {ksmf_invoke:314} 00000074.0065fee5 243bcb79 Thu Sep 26 2019 04:31:42 -06:00 [kern_mgwd:info:2284] A [src/rdb/HAM.cc 1233 (0x81b7b8c00)]: checkHASFOConfigVerbose: haConfigured: True, result HA_AGENT_CONFIGURED. 00000074.0065feea 243bcb79 Thu Sep 26 2019 04:31:43 -06:00 [kern_mgwd:info:2284] ZSM: KSMF REQ FAILED: system-get-info - kSMF alternate path failed to host 169.254.5.219 with a kSMF ERROR: RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to kernel at 169.254.5.219] [TO=110s =>169.254.5.219:951 CN=11042/1] {ksmf_invoke:314} 00000074.0065feeb 243bcb79 Thu Sep 26 2019 04:31:43 -06:00 [kern_mgwd:info:2284] A [src/rdb/HAM.cc 1233 (0x81b7b5000)]: checkHASFOConfigVerbose: haConfigured: True, result HA_AGENT_CONFIGURED. 00000074.0065ff0c 243bcb8e Thu Sep 26 2019 04:31:46 -06:00 [kern_mgwd:info:2284] ZSM: shttpc_connect failed: Operation timed out [TO=4s TRT=4.001s =>169.254.5.219:951 CN=11041/1] {na_zsm_socket_open:575} 00000074.0065ff10 243bcbbf Thu Sep 26 2019 04:31:51 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to mgwd at 169.254.5.219] 00000074.0065ff11 243bcbbf Thu Sep 26 2019 04:31:51 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to mgwd at 169.254.5.219] 00000074.0065ff12 243bcbbf Thu Sep 26 2019 04:31:51 -06:00 [kern_mgwd:info:2284] 0x81b6aa100: 0: ERR: misc_node_info: src/tables/misc_node_info_view.cc:push:257 Failed to update node: 'nmg-fas8040-01' about misc_node_info for node: 'nmg-fas8040-02': RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to kernel at 169.254.5.219] 00000074.0065ff13 243bcbbf Thu Sep 26 2019 04:31:51 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to mgwd at 169.254.5.219] 00000074.0065ff14 243bcbbf Thu Sep 26 2019 04:31:51 -06:00 [kern_mgwd:info:2284] 0x81b6aa100: 0: ERR: misc_node_info: src/tables/misc_node_info_view.cc:push:264 Error iterating misc_node_info_view: RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to mgwd at 169.254.5.219] 00000074.0065ff17 243bcc1e Thu Sep 26 2019 04:32:00 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065ff1a 243bcc6a Thu Sep 26 2019 04:32:08 -06:00 [kern_mgwd:info:2284] 0x81b6aa100: 0: ERR: misc_node_info: src/tables/misc_node_info_view.cc:push:257 Failed to update node: 'nmg-fas8040-01' about misc_node_info for node: 'nmg-fas8040-02': RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to kernel at 169.254.5.219] 00000074.0065ff1b 243bcc6a Thu Sep 26 2019 04:32:08 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to mgwd at 169.254.5.219] 00000074.0065ff1c 243bcc6a Thu Sep 26 2019 04:32:08 -06:00 [kern_mgwd:info:2284] 0x81b6aa100: 0: ERR: misc_node_info: src/tables/misc_node_info_view.cc:push:264 Error iterating misc_node_info_view: RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to mgwd at 169.254.5.219] 00000074.0065ff20 243bccf4 Thu Sep 26 2019 04:32:21 -06:00 [kern_mgwd:info:2284] 0x81b7b8200: 8503e80000002919: ERR: TABLES::disk: _getDisks: Node nmg-fas8040-02 not healthy, Not gathering disk attributes from this node. 00000074.0065ff22 243bcd0a Thu Sep 26 2019 04:32:23 -06:00 [kern_mgwd:info:2284] 0x81b6aa100: 0: ERR: misc_node_info: src/tables/misc_node_info_view.cc:push:257 Failed to update node: 'nmg-fas8040-01' about misc_node_info for node: 'nmg-fas8040-02': RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to kernel at 169.254.5.219] 00000074.0065ff23 243bcd0a Thu Sep 26 2019 04:32:23 -06:00 [kern_mgwd:info:2284] A [src/rdb/HAM.cc 1233 (0x81b7b3c00)]: checkHASFOConfigVerbose: haConfigured: True, result HA_AGENT_CONFIGURED. 00000074.0065ff24 243bcd0a Thu Sep 26 2019 04:32:23 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065ff25 243bcd0a Thu Sep 26 2019 04:32:23 -06:00 [kern_mgwd:info:2284] 0x81b149100: 8503e8000000291d: ERR: AggrEfficiency: src/tables/aggr_efficiency.cc:smdb_error aggr_efficiency_iterator::_getAggrDetails(const smdb_type_aggr_name &, smdb_type_Uuid &, smdb_type_filerid &):122 Failed to get aggregate information from VLDB for aggregate , Reason: entry doesn't exist 00000074.0065ff26 243bcd0a Thu Sep 26 2019 04:32:23 -06:00 [kern_mgwd:info:2284] 0x81b149100: 8503e8000000291d: ERR: AggrEfficiency: src/tables/aggr_efficiency.cc:smdb_error aggr_efficiency_iterator::_populateRowFromKSMFTable(const smdb_type_filerid &, const smdb_type_Uuid &):171 kSMF get failed for aggr 6173354a-2f55-4aa2-824b-54d19124c33c, Reason: entry doesn't exist 00000074.0065ff27 243bcd0a Thu Sep 26 2019 04:32:23 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries for vifmgr on node "nmg-fas8040-02": RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to vifmgr at 169.254.5.219]. 00000074.0065ff28 243bcd0a Thu Sep 26 2019 04:32:23 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to mgwd at 169.254.5.219] 00000074.0065ff29 243bcd0a Thu Sep 26 2019 04:32:24 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to mgwd at 169.254.5.219] 00000074.0065ff2a 243bcd0a Thu Sep 26 2019 04:32:24 -06:00 [kern_mgwd:info:2284] 0x81b6aa100: 0: ERR: misc_node_info: src/tables/misc_node_info_view.cc:push:264 Error iterating misc_node_info_view: RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to mgwd at 169.254.5.219] 00000074.0065ff2b 243bcd1c Thu Sep 26 2019 04:32:25 -06:00 [kern_mgwd:info:2284] ZSM: shttpc_connect failed: Operation timed out [TO=4s TRT=4.002s =>169.254.5.219:951 CN=11043/1] {na_zsm_socket_open:575} 00000074.0065ff2c 243bcd1c Thu Sep 26 2019 04:32:25 -06:00 [kern_mgwd:info:2284] ZSM: KSMF REQ FAILED: sf-status - kSMF alternate path failed to host 169.254.5.219 with a kSMF ERROR: RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to kernel at 169.254.5.219] [TO=20s =>169.254.5.219:951 CN=11043/2] {ksmf_invoke:314} 00000074.0065ff2d 243bcd1c Thu Sep 26 2019 04:32:25 -06:00 [kern_mgwd:info:2284] ZAPI sf-status failed. Host: 169.254.5.219, Status: 1, Reason: ZSM - failed, status code = 572, extra = kSMF alternate path failed to host 169.254.5.219 with a kSMF ERROR: RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to kernel at 169.254.5.219], max 20s [169.254.5.219:951], Error: 13057 00000074.0065ff2e 243bcd1c Thu Sep 26 2019 04:32:25 -06:00 [kern_mgwd:info:2284] 0x81b7b6400: 8503e80000002915: INFO: cluster_ring: get_cluster_ip_for_node:src/tables/cluster_ring.cc:917 Start 00000074.0065ff2f 243bcd1c Thu Sep 26 2019 04:32:25 -06:00 [kern_mgwd:info:2284] 0x81b7b6400: 8503e80000002915: INFO: cluster_ring: get_cluster_ip_for_node:src/tables/cluster_ring.cc:956 End 00000074.0065ff30 243bcd1c Thu Sep 26 2019 04:32:25 -06:00 [kern_mgwd:info:2284] 0x81b7b6400: 8503e80000002915: INFO: cluster_ring: is_ring_online_on_node:src/tables/cluster_ring.cc:985 Start, checking node nmg-fas8040-02 and unit mgmt. 00000074.0065ff54 243bcd47 Thu Sep 26 2019 04:32:30 -06:00 [kern_mgwd:info:2284] ZSM: shttpc_connect failed: Operation timed out [TO=4s TRT=4.001s =>169.254.5.219:951 CN=11044/1] {na_zsm_socket_open:575} 00000074.0065ff55 243bcd47 Thu Sep 26 2019 04:32:30 -06:00 [kern_mgwd:info:2284] 0x81b7b6400: 8503e80000002915: NOTICE: RpcConnectionCache: markFailure: markFailure: New Quarantine for 169.254.5.219:536874272(rdb_management)/1[tcp]{fffffffd|4} with timeout(5.000s) Reason:: RPC: Remote system error - Operation timed out 00000074.0065ff58 243bcd79 Thu Sep 26 2019 04:32:35 -06:00 [kern_mgwd:info:2284] 0x81b7b6400: 8503e80000002915: NOTICE: RpcConnectionCache: markFailure: markFailure: New Quarantine for 169.254.8.83:536874272(rdb_management)/1[tcp]{fffffffd|4} with timeout(5.000s) Reason:: RPC: Remote system error - Operation timed out 00000074.0065ff59 243bcd79 Thu Sep 26 2019 04:32:35 -06:00 [kern_mgwd:info:2284] 0x81b7b6400: 8503e80000002915: ERR: cluster_ring: rdb_ring_info:src/tables/cluster_ring.cc:203 RDB ring state query of 169.254.5.219 for management failed on RPC connect: clnttcp_create: RPC: Remote system error - Operation timed out 00000074.0065ff5a 243bcd79 Thu Sep 26 2019 04:32:35 -06:00 [kern_mgwd:info:2284] 0x81b7b6400: 8503e80000002915: INFO: cluster_ring: is_ring_online_on_node:src/tables/cluster_ring.cc:1023 End 00000074.0065ff5b 243bcd79 Thu Sep 26 2019 04:32:35 -06:00 [kern_mgwd:info:2284] 0x81b7b6400: 8503e80000002915: INFO: cluster_ring: is_ring_online_on_node:src/tables/cluster_ring.cc:985 Start, checking node nmg-fas8040-02 and unit vldb. 00000074.0065ff5e 243bcdbc Thu Sep 26 2019 04:32:40 -06:00 [kern_mgwd:info:2284] 0x81b7b6400: 8503e80000002915: NOTICE: RpcConnectionCache: markFailure: markFailure: New Quarantine for 169.254.5.219:536874256(rdb_vldb)/1[tcp]{fffffffd|4} with timeout(5.000s) Reason:: RPC: Remote system error - Operation timed out 00000074.0065ff5f 243bcdbc Thu Sep 26 2019 04:32:41 -06:00 [kern_mgwd:info:2284] 0x81b6aa100: 0: ERR: misc_node_info: src/tables/misc_node_info_view.cc:push:257 Failed to update node: 'nmg-fas8040-01' about misc_node_info for node: 'nmg-fas8040-02': RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to kernel at 169.254.5.219] 00000074.0065ff60 243bcdbc Thu Sep 26 2019 04:32:41 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-02. RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to mgwd at 169.254.5.219] 00000074.0065ff61 243bcdbc Thu Sep 26 2019 04:32:41 -06:00 [kern_mgwd:info:2284] 0x81b6aa100: 0: ERR: misc_node_info: src/tables/misc_node_info_view.cc:push:264 Error iterating misc_node_info_view: RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to mgwd at 169.254.5.219] 00000074.0065ff64 243bcddd Thu Sep 26 2019 04:32:45 -06:00 [kern_mgwd:info:2284] 0x81b7b6400: 8503e80000002915: NOTICE: RpcConnectionCache: markFailure: markFailure: New Quarantine for 169.254.8.83:536874256(rdb_vldb)/1[tcp]{fffffffd|4} with timeout(5.000s) Reason:: RPC: Remote system error - Operation timed out 00000074.0065ff65 243bcddd Thu Sep 26 2019 04:32:45 -06:00 [kern_mgwd:info:2284] 0x81b7b6400: 8503e80000002915: ERR: cluster_ring: rdb_ring_info:src/tables/cluster_ring.cc:203 RDB ring state query of 169.254.5.219 for vldb failed on RPC connect: clnttcp_create: RPC: Remote system error - Operation timed out 00000074.0065ff66 243bcddd Thu Sep 26 2019 04:32:45 -06:00 [kern_mgwd:info:2284] 0x81b7b6400: 8503e80000002915: INFO: cluster_ring: is_ring_online_on_node:src/tables/cluster_ring.cc:1023 End 00000074.0065ff67 243bcddd Thu Sep 26 2019 04:32:45 -06:00 [kern_mgwd:info:2284] 0x81b7b6400: 8503e80000002915: INFO: cluster_ring: is_ring_online_on_node:src/tables/cluster_ring.cc:985 Start, checking node nmg-fas8040-02 and unit vifmgr. 00000074.0065ff6b 243bce0f Thu Sep 26 2019 04:32:49 -06:00 [kern_mgwd:info:2284] 0x81b7b5a00: 8503e8000000292a: NOTICE: TABLES::disk: Added 84 disk recs to the shared reference cache (size 84) 00000074.0065ff6c 243bce0f Thu Sep 26 2019 04:32:49 -06:00 [kern_mgwd:info:2284] 0x81b7b5a00: 8503e8000000292a: ERR: TABLES::disk: _getDisks: Node nmg-fas8040-02 not healthy, Not gathering disk attributes from this node. 00000074.0065ff6d 243bce0f Thu Sep 26 2019 04:32:49 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries for kernel on node "nmg-fas8040-02": RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to kernel at 169.254.5.219]. 00000074.0065ff6e 243bce0f Thu Sep 26 2019 04:32:50 -06:00 [kern_mgwd:info:2284] 0x81b7b6400: 8503e80000002915: NOTICE: RpcConnectionCache: markFailure: markFailure: New Quarantine for 169.254.5.219:536874288(rdb_vif_mgr)/1[tcp]{fffffffd|4} with timeout(5.000s) Reason:: RPC: Remote system error - Operation timed out 00000074.0065ff6f 243bce61 Thu Sep 26 2019 04:32:54 -06:00 [kern_mgwd:info:2284] 0x81b7b3700: 8503e8000000292f: ERR: TABLES::disk: _getDisks: Node nmg-fas8040-02 not healthy, Not gathering disk attributes from this node. 00000074.0065ff70 243bce61 Thu Sep 26 2019 04:32:55 -06:00 [kern_mgwd:info:2284] 0x81b7b7300: 8503e80000002930: ERR: TABLES::disk: _getDisks: Node nmg-fas8040-02 not healthy, Not gathering disk attributes from this node. 00000074.0065ff71 243bce61 Thu Sep 26 2019 04:32:55 -06:00 [kern_mgwd:info:2284] 0x81b7b6400: 8503e80000002915: NOTICE: RpcConnectionCache: markFailure: markFailure: New Quarantine for 169.254.8.83:536874288(rdb_vif_mgr)/1[tcp]{fffffffd|4} with timeout(5.000s) Reason:: RPC: Remote system error - Operation timed out 00000074.0065ff72 243bce61 Thu Sep 26 2019 04:32:55 -06:00 [kern_mgwd:info:2284] 0x81b7b6400: 8503e80000002915: ERR: cluster_ring: rdb_ring_info:src/tables/cluster_ring.cc:203 RDB ring state query of 169.254.5.219 for vifmgr failed on RPC connect: clnttcp_create: RPC: Remote system error - Operation timed out 00000074.0065ff73 243bce61 Thu Sep 26 2019 04:32:55 -06:00 [kern_mgwd:info:2284] 0x81b7b6400: 8503e80000002915: INFO: cluster_ring: is_ring_online_on_node:src/tables/cluster_ring.cc:1023 End 00000074.0065ff74 243bce61 Thu Sep 26 2019 04:32:55 -06:00 [kern_mgwd:info:2284] 0x81b7b6400: 8503e80000002915: INFO: cluster_ring: is_ring_online_on_node:src/tables/cluster_ring.cc:985 Start, checking node nmg-fas8040-02 and unit bcomd. 00000074.0065ff75 243bce61 Thu Sep 26 2019 04:32:55 -06:00 [kern_mgwd:info:2284] 0x81b7b6400: 8503e80000002915: NOTICE: RpcConnectionCache: markFailure: markFailure: New Quarantine for 169.254.5.219:536874336(rdb_bcomd)/1[tcp]{fffffffd|4} with timeout(5.000s) Reason:: RPC: Remote system error - Connection refused 00000074.0065ff76 243bce61 Thu Sep 26 2019 04:32:56 -06:00 [kern_mgwd:info:2284] 0x81b6aa100: 0: ERR: misc_node_info: src/tables/misc_node_info_view.cc:push:257 Failed to update node: 'nmg-fas8040-01' about misc_node_info for node: 'nmg-fas8040-02': RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to kernel at 169.254.5.219] 00000074.0065ff77 243bce61 Thu Sep 26 2019 04:32:56 -06:00 [kern_mgwd:info:2284] 0x81b6aa100: 0: NOTICE: RpcConnectionCache: clearFailure: called for 169.254.5.219:536873488(mgwd)/1[tcp]{fffffffd|4} 00000074.0065ff79 243bce61 Thu Sep 26 2019 04:32:57 -06:00 [kern_mgwd:info:2284] 0x81b6aa100: 0: ERR: misc_node_info: src/tables/misc_node_info_view.cc:push:257 Failed to update node: 'nmg-fas8040-02' about misc_node_info for node: 'nmg-fas8040-01': "node-uuid" is a required field 00000074.0065ff7a 243bce61 Thu Sep 26 2019 04:32:58 -06:00 [kern_mgwd:info:2284] 0x81b7b6400: 8503e80000002915: NOTICE: RpcConnectionCache: markFailure: markFailure: New Quarantine for 169.254.8.83:536874336(rdb_bcomd)/1[tcp]{fffffffd|4} with timeout(5.000s) Reason:: RPC: Remote system error - Connection refused 00000074.0065ff7b 243bce61 Thu Sep 26 2019 04:32:58 -06:00 [kern_mgwd:info:2284] 0x81b7b6400: 8503e80000002915: ERR: cluster_ring: rdb_ring_info:src/tables/cluster_ring.cc:203 RDB ring state query of 169.254.5.219 for bcomd failed on RPC connect: clnttcp_create: RPC: Remote system error - Connection refused 00000074.0065ff7c 243bce61 Thu Sep 26 2019 04:32:58 -06:00 [kern_mgwd:info:2284] 0x81b7b6400: 8503e80000002915: INFO: cluster_ring: is_ring_online_on_node:src/tables/cluster_ring.cc:1023 End 00000074.0065ff7d 243bce61 Thu Sep 26 2019 04:32:58 -06:00 [kern_mgwd:info:2284] 0x81b7b6400: 8503e80000002915: INFO: cluster_ring: is_ring_online_on_node:src/tables/cluster_ring.cc:985 Start, checking node nmg-fas8040-02 and unit crs. 00000074.0065ff7e 243bce61 Thu Sep 26 2019 04:32:58 -06:00 [kern_mgwd:info:2284] 0x81b7b6400: 8503e80000002915: NOTICE: RpcConnectionCache: markFailure: markFailure: New Quarantine for 169.254.5.219:536874368(rdb_crs)/1[tcp]{fffffffd|4} with timeout(5.000s) Reason:: RPC: Remote system error - Connection refused 00000074.0065ff7f 243bce61 Thu Sep 26 2019 04:32:58 -06:00 [kern_mgwd:info:2284] 0x81b7b6400: 8503e80000002915: NOTICE: RpcConnectionCache: markFailure: markFailure: New Quarantine for 169.254.8.83:536874368(rdb_crs)/1[tcp]{fffffffd|4} with timeout(5.000s) Reason:: RPC: Remote system error - Connection refused 00000074.0065ff80 243bce61 Thu Sep 26 2019 04:32:58 -06:00 [kern_mgwd:info:2284] 0x81b7b6400: 8503e80000002915: ERR: cluster_ring: rdb_ring_info:src/tables/cluster_ring.cc:203 RDB ring state query of 169.254.5.219 for crs failed on RPC connect: clnttcp_create: RPC: Remote system error - Connection refused 00000074.0065ff81 243bce61 Thu Sep 26 2019 04:32:58 -06:00 [kern_mgwd:info:2284] 0x81b7b6400: 8503e80000002915: INFO: cluster_ring: is_ring_online_on_node:src/tables/cluster_ring.cc:1023 End 00000074.0065ff82 243bce61 Thu Sep 26 2019 04:32:58 -06:00 [kern_mgwd:info:2284] 0x81b7b6400: 8503e80000002915: ERR: SFO_Ready|initstateshelper: isScsiBladeStatusOk:src/mgmt_s1/init_states_helper.cc:118 bcomd_info_iterator get failed for node nmg-fas8040-02 00000074.0065ff83 243bce61 Thu Sep 26 2019 04:32:58 -06:00 [kern_mgwd:info:2284] 0x81b7b6400: 8503e80000002915: INFO: SFO_Ready|initstateshelper: getProcStateDescription state: Offline applications: mgmt, vldb, vifmgr, bcomd, crs, scsi blade, clam. 00000074.0065ff84 243bce61 Thu Sep 26 2019 04:32:58 -06:00 [kern_mgwd:info:2284] 0x81b7b6400: 8503e80000002915: INFO: SFO_Ready|initstateshelper: updateInitStateDescription state: Waiting for cluster applications to come online on the local node Offline applications: mgmt, vldb, vifmgr, bcomd, crs, scsi blade, clam. 00000074.0065ffa5 243bce61 Thu Sep 26 2019 04:32:58 -06:00 [kern_mgwd:info:2284] A [src/rdb/HAM.cc 1233 (0x81b7b8200)]: checkHASFOConfigVerbose: haConfigured: True, result HA_AGENT_CONFIGURED. 00000074.0065ffa6 243bce7a Thu Sep 26 2019 04:33:00 -06:00 [kern_mgwd:info:2284] A [src/rdb/HAM.cc 1233 (0x81b149100)]: checkHASFOConfigVerbose: haConfigured: True, result HA_AGENT_CONFIGURED. 00000074.0065ffa7 243bce7a Thu Sep 26 2019 04:33:00 -06:00 [kern_mgwd:info:2284] 0x81b7b9100: 8503e80000002937: ERR: TABLES::disk: _getDisks: Node nmg-fas8040-02 not healthy, Not gathering disk attributes from this node. 00000074.0065ffa8 243bce7a Thu Sep 26 2019 04:33:00 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries for vifmgr on node "nmg-fas8040-02": RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to vifmgr at 169.254.5.219]. 00000074.0065ffa9 243bce7a Thu Sep 26 2019 04:33:00 -06:00 [kern_mgwd:info:2284] 0x81b7b6900: 8503e8000000293b: ERR: AggrEfficiency: src/tables/aggr_efficiency.cc:smdb_error aggr_efficiency_iterator::_getAggrDetails(const smdb_type_aggr_name &, smdb_type_Uuid &, smdb_type_filerid &):122 Failed to get aggregate information from VLDB for aggregate , Reason: entry doesn't exist 00000074.0065ffaa 243bce7a Thu Sep 26 2019 04:33:00 -06:00 [kern_mgwd:info:2284] 0x81b7b6900: 8503e8000000293b: ERR: AggrEfficiency: src/tables/aggr_efficiency.cc:smdb_error aggr_efficiency_iterator::_populateRowFromKSMFTable(const smdb_type_filerid &, const smdb_type_Uuid &):171 kSMF get failed for aggr 6173354a-2f55-4aa2-824b-54d19124c33c, Reason: entry doesn't exist 00000074.0065ffab 243bce7a Thu Sep 26 2019 04:33:00 -06:00 [kern_mgwd:info:2284] 0x81b7b4b00: 8503e8000000293d: INFO: cluster_ring: get_cluster_ip_for_node:src/tables/cluster_ring.cc:917 Start 00000074.0065ffac 243bce7a Thu Sep 26 2019 04:33:00 -06:00 [kern_mgwd:info:2284] 0x81b7b4b00: 8503e8000000293d: INFO: cluster_ring: get_cluster_ip_for_node:src/tables/cluster_ring.cc:956 End 00000074.0065ffad 243bce7a Thu Sep 26 2019 04:33:00 -06:00 [kern_mgwd:info:2284] 0x81b7b4b00: 8503e8000000293d: INFO: cluster_ring: is_ring_online_on_node:src/tables/cluster_ring.cc:985 Start, checking node nmg-fas8040-02 and unit mgmt. 00000074.0065ffae 243bce7a Thu Sep 26 2019 04:33:00 -06:00 [kern_mgwd:info:2284] 0x81b7b4b00: 8503e8000000293d: ERR: cluster_ring: rdb_ring_info:src/tables/cluster_ring.cc:203 RDB ring state query of 169.254.5.219 for management failed on RPC connect: clnttcp_create: RPC: Remote system error - Connection refused 00000074.0065ffaf 243bce7a Thu Sep 26 2019 04:33:00 -06:00 [kern_mgwd:info:2284] 0x81b7b4b00: 8503e8000000293d: INFO: cluster_ring: is_ring_online_on_node:src/tables/cluster_ring.cc:1023 End 00000074.0065ffb0 243bce7a Thu Sep 26 2019 04:33:00 -06:00 [kern_mgwd:info:2284] 0x81b7b4b00: 8503e8000000293d: INFO: cluster_ring: is_ring_online_on_node:src/tables/cluster_ring.cc:985 Start, checking node nmg-fas8040-02 and unit vldb. 00000074.0065ffb1 243bce7a Thu Sep 26 2019 04:33:00 -06:00 [kern_mgwd:info:2284] 0x81b7b4b00: 8503e8000000293d: ERR: cluster_ring: rdb_ring_info:src/tables/cluster_ring.cc:203 RDB ring state query of 169.254.5.219 for vldb failed on RPC connect: clnttcp_create: RPC: Remote system error - Connection refused 00000074.0065ffb2 243bce7a Thu Sep 26 2019 04:33:00 -06:00 [kern_mgwd:info:2284] 0x81b7b4b00: 8503e8000000293d: INFO: cluster_ring: is_ring_online_on_node:src/tables/cluster_ring.cc:1023 End 00000074.0065ffb3 243bce7a Thu Sep 26 2019 04:33:00 -06:00 [kern_mgwd:info:2284] 0x81b7b4b00: 8503e8000000293d: INFO: cluster_ring: is_ring_online_on_node:src/tables/cluster_ring.cc:985 Start, checking node nmg-fas8040-02 and unit vifmgr. 00000074.0065ffb4 243bce7a Thu Sep 26 2019 04:33:00 -06:00 [kern_mgwd:info:2284] 0x81b7b4b00: 8503e8000000293d: ERR: cluster_ring: rdb_ring_info:src/tables/cluster_ring.cc:203 RDB ring state query of 169.254.5.219 for vifmgr failed on RPC connect: clnttcp_create: RPC: Remote system error - Connection refused 00000074.0065ffb5 243bce7a Thu Sep 26 2019 04:33:00 -06:00 [kern_mgwd:info:2284] 0x81b7b4b00: 8503e8000000293d: INFO: cluster_ring: is_ring_online_on_node:src/tables/cluster_ring.cc:1023 End 00000074.0065ffb6 243bce7a Thu Sep 26 2019 04:33:00 -06:00 [kern_mgwd:info:2284] 0x81b7b4b00: 8503e8000000293d: INFO: cluster_ring: is_ring_online_on_node:src/tables/cluster_ring.cc:985 Start, checking node nmg-fas8040-02 and unit bcomd. 00000074.0065ffb7 243bce7a Thu Sep 26 2019 04:33:00 -06:00 [kern_mgwd:info:2284] 0x81b7b4b00: 8503e8000000293d: ERR: cluster_ring: rdb_ring_info:src/tables/cluster_ring.cc:203 RDB ring state query of 169.254.5.219 for bcomd failed on RPC connect: clnttcp_create: RPC: Remote system error - Connection refused 00000074.0065ffb8 243bce7a Thu Sep 26 2019 04:33:00 -06:00 [kern_mgwd:info:2284] 0x81b7b4b00: 8503e8000000293d: INFO: cluster_ring: is_ring_online_on_node:src/tables/cluster_ring.cc:1023 End 00000074.0065ffb9 243bce7a Thu Sep 26 2019 04:33:00 -06:00 [kern_mgwd:info:2284] 0x81b7b4b00: 8503e8000000293d: INFO: cluster_ring: is_ring_online_on_node:src/tables/cluster_ring.cc:985 Start, checking node nmg-fas8040-02 and unit crs. 00000074.0065ffba 243bce7a Thu Sep 26 2019 04:33:00 -06:00 [kern_mgwd:info:2284] 0x81b7b4b00: 8503e8000000293d: ERR: cluster_ring: rdb_ring_info:src/tables/cluster_ring.cc:203 RDB ring state query of 169.254.5.219 for crs failed on RPC connect: clnttcp_create: RPC: Remote system error - Connection refused 00000074.0065ffbb 243bce7a Thu Sep 26 2019 04:33:00 -06:00 [kern_mgwd:info:2284] 0x81b7b4b00: 8503e8000000293d: INFO: cluster_ring: is_ring_online_on_node:src/tables/cluster_ring.cc:1023 End 00000074.0065ffbc 243bce7a Thu Sep 26 2019 04:33:00 -06:00 [kern_mgwd:info:2284] 0x81b7b4b00: 8503e8000000293d: ERR: SFO_Ready|initstateshelper: isScsiBladeStatusOk:src/mgmt_s1/init_states_helper.cc:118 bcomd_info_iterator get failed for node nmg-fas8040-02 00000074.0065ffbd 243bce7a Thu Sep 26 2019 04:33:00 -06:00 [kern_mgwd:info:2284] 0x81b7b4b00: 8503e8000000293d: INFO: SFO_Ready|initstateshelper: getProcStateDescription state: Offline applications: mgmt, vldb, vifmgr, bcomd, crs, scsi blade, clam. 00000074.0065ffbe 243bce7a Thu Sep 26 2019 04:33:00 -06:00 [kern_mgwd:info:2284] 0x81b7b4b00: 8503e8000000293d: INFO: SFO_Ready|initstateshelper: updateInitStateDescription state: Connected to nmg-fas8040-01. Waiting for cluster applications to come online on the local node. Offline applications: mgmt, vldb, vifmgr, bcomd, crs, scsi blade, clam. 00000074.0065ffe1 243bce8a Thu Sep 26 2019 04:33:02 -06:00 [kern_mgwd:info:2284] A [src/rdb/HAM.cc 1233 (0x81b7b9600)]: checkHASFOConfigVerbose: haConfigured: True, result HA_AGENT_CONFIGURED. 00000074.0065ffe6 243bcef5 Thu Sep 26 2019 04:33:12 -06:00 [kern_mgwd:info:2284] 0x81b6aa100: 0: NOTICE: RpcConnectionCache: clearFailure: called for 169.254.5.219:536873508(kernel)/1[tcp]{fffffffd|4} 00000074.0065ffe7 243bcef5 Thu Sep 26 2019 04:33:12 -06:00 [kern_mgwd:info:2284] 0x81b6aa100: 0: ERR: misc_node_info: src/tables/misc_node_info_view.cc:push:257 Failed to update node: 'nmg-fas8040-01' about misc_node_info for node: 'nmg-fas8040-02': entry doesn't exist 00000074.0065ffe8 243bcef5 Thu Sep 26 2019 04:33:12 -06:00 [kern_mgwd:info:2284] 0x81b6aa100: 0: ERR: misc_node_info: src/tables/misc_node_info_view.cc:push:257 Failed to update node: 'nmg-fas8040-02' about misc_node_info for node: 'nmg-fas8040-01': "node-uuid" is a required field 00000074.0065ffeb 243bcef5 Thu Sep 26 2019 04:33:13 -06:00 [kern_mgwd:info:2284] A [src/rdb/quorum/dslqm.cc 945 (0x81b244c00)]: QM: Voting NO to site 1001 due to voting disabled (HA). 00000074.0065ffec 243bcf24 Thu Sep 26 2019 04:33:14 -06:00 [kern_mgwd:info:2284] A [src/rdb/quorum/dslqm.cc 945 (0x81b244200)]: QM: Voting NO to site 1001 due to voting disabled (HA). 00000074.0065ffed 243bcf24 Thu Sep 26 2019 04:33:14 -06:00 [kern_mgwd:info:2284] 0x81b7b7300: 8503e8000000294a: ERR: TABLES::disk: _getDisks: Node nmg-fas8040-02 not healthy, Not gathering disk attributes from this node. 00000074.0065ffee 243bcf24 Thu Sep 26 2019 04:33:15 -06:00 [kern_mgwd:info:2284] 0x81b7b6400: 8503e8000000294b: ERR: TABLES::disk: _getDisks: Node nmg-fas8040-02 not healthy, Not gathering disk attributes from this node. 00000074.0065ffef 243bcf24 Thu Sep 26 2019 04:33:15 -06:00 [kern_mgwd:info:2284] A [src/rdb/quorum/dslqm.cc 945 (0x81b6a8300)]: QM: Voting NO to site 1001 due to voting disabled (HA). 00000074.0065fff0 243bcf24 Thu Sep 26 2019 04:33:15 -06:00 [kern_mgwd:info:2284] 0x81ccad700: 0: NOTICE: RpcConnectionCache: clearFailure: called for 169.254.8.83:536874273(rdb_management_qm)/1[tcp]{fffffffd|ffffffff} 00000074.0065fff1 243bcf24 Thu Sep 26 2019 04:33:15 -06:00 [kern_mgwd:info:2284] A [src/rdb/rpcmgr.cc 581 (0x81ccad700)]: Site 1001: successful failover to 169.254.8.83. 00000074.0065fff2 243bcf24 Thu Sep 26 2019 04:33:15 -06:00 [kern_mgwd:info:2284] A [src/rdb/quorum/quorumimpl.cc 1744 (0x81ccad700)]: Remote in contact upcall remoteId: 1001 00000074.0065fff3 243bcf24 Thu Sep 26 2019 04:33:15 -06:00 [kern_mgwd:info:2284] A [src/rdb/RM.cc 889 (0x81d1e0100)]: RM 1000: Online reconciliation begins in epoch 6. 00000074.0065fff4 243bcf24 Thu Sep 26 2019 04:33:15 -06:00 [kern_mgwd:info:2284] A [src/rdb/RM.cc 1435 (0x81d1e0100)]: RM 1000: Master running online reconciliation; quorum version <6,58> (unlocked). 00000074.0065fff5 243bcf24 Thu Sep 26 2019 04:33:15 -06:00 [kern_mgwd:info:2284] A [src/rdb/RM.cc 1743 (0x81d1e0100)]: RM 1000: distributeDBSet<6,58> to quorum members, running recovery 0. 00000074.0065fff6 243bcf24 Thu Sep 26 2019 04:33:15 -06:00 [kern_mgwd:info:2284] A [src/rdb/RM.cc 1332 (0x81d1e0100)]: Renegade Transaction : <5,981471> exists in local Tlog; Rollback of remote site is not needed. 00000074.0065fff7 243bcf24 Thu Sep 26 2019 04:33:15 -06:00 [kern_mgwd:info:2284] A [src/rdb/RM.cc 1924 (0x81d1e0100)]: RM 1000: Push quorum DBSet <6,58> to site 1001 (at <5,981471>). 00000074.0065fff8 243bcf24 Thu Sep 26 2019 04:33:16 -06:00 [kern_mgwd:info:2284] A [src/rdb/cluster_events.cc 78 (0x81d1e0100)]: Cluster event: node-online, epoch 6, site 1001 [Healthy/Total: 2/2]. 00000074.0065fff9 243bcf24 Thu Sep 26 2019 04:33:16 -06:00 [kern_mgwd:info:2284] Notice: secondary_online_callback: secondaryOnlineCallback: siteId: 1001 00000074.0065fffa 243bcf24 Thu Sep 26 2019 04:33:16 -06:00 [kern_mgwd:info:2284] A [src/rdb/cluster_events.cc 78 (0x81d1e0100)]: Cluster event: cluster-event, epoch 6, site 1000 [master moving towards HA-normal]. 00000074.0065fffb 243bcf24 Thu Sep 26 2019 04:33:16 -06:00 [kern_mgwd:info:2284] 0x81d1e0600: 0: DEBUG: cluster_ntpd: secondary_online_status_callback:1073 RDB status is Master 00000074.0065fffc 243bcf24 Thu Sep 26 2019 04:33:16 -06:00 [kern_mgwd:info:2284] A [src/rdb/TM.cc 3094 (0x81da8a200)]: RW-transaction TID <6,61,61> held by client 1001 for 9 seconds (created: 60789939s, now: 60789948s) (label 'vreport rdb cleanup nmg-fas8040-02'). 00000074.0065fffd 243bcf24 Thu Sep 26 2019 04:33:16 -06:00 [kern_mgwd:info:2284] A [src/rdb/HAM.cc 1571 (0x81d1dfc00)]: HAM: Entering HA-normal. 00000074.0065fffe 243bcf24 Thu Sep 26 2019 04:33:16 -06:00 [kern_mgwd:info:2284] A [src/rdb/TM.cc 3094 (0x81b244200)]: RW-transaction TID <6,62,62> held by client 1001 for 9 seconds (created: 60789939s, now: 60789948s) (label 'cluster_version_replicated: create row'). 00000074.0065ffff 243bcf24 Thu Sep 26 2019 04:33:16 -06:00 [kern_mgwd:info:2284] 0x81da8a200: 0: NOTICE: epsilon_transition_job: queue_epsilon_transition_job:src/tables/cluster_management/epsilon_transition.cc:183 The job was queued successfully with id 0ce32b2d-e049-11e9-93b8-00a09857ee8f. 00000074.00660000 243bcf24 Thu Sep 26 2019 04:33:16 -06:00 [kern_mgwd:info:2284] A [src/rdb/TM.cc 3094 (0x81b13fb00)]: RW-transaction TID <6,65,65> held by client 1001 for 8 seconds (created: 60789940s, now: 60789948s) (label 'service_policy modify'). 00000074.00660001 243bcf24 Thu Sep 26 2019 04:33:16 -06:00 [kern_mgwd:info:2284] 0x81d1e3d00: 8603e80000297398: WARNING: job_manager::job_sched: process_modify:src/job_sched.cc:487 UIID:8855 UUID:0ce32b2d-e049-11e9-93b8-00a09857ee8f name:Epsilon Transition Job rc:1 Doing nothing in modify callback for job, since it's pending cleanup 00000074.00660004 243bcf24 Thu Sep 26 2019 04:33:17 -06:00 [kern_mgwd:info:2284] A [src/rdb/TM.cc 3094 (0x81b245100)]: RW-transaction TID <6,72,72> held by client 1001 for 8 seconds (created: 60789941s, now: 60789949s) (label 'job_manager job enqueue'). 00000074.00660007 243bcf24 Thu Sep 26 2019 04:33:18 -06:00 [kern_mgwd:info:2284] A [src/rdb/TM.cc 3094 (0x81b6a7e00)]: RW-transaction TID <6,78,78> held by client 1001 for 8 seconds (created: 60789941s, now: 60789949s) (label 'CM RDB Initialization Callback'). 00000074.0066000c 243bcf80 Thu Sep 26 2019 04:33:27 -06:00 [kern_mgwd:info:2284] A [src/rdb/HAM.cc 1233 (0x81b149100)]: checkHASFOConfigVerbose: haConfigured: True, result HA_AGENT_CONFIGURED. 00000074.00660030 243bcfea Thu Sep 26 2019 04:33:37 -06:00 [kern_mgwd:info:2284] A [src/rdb/HAM.cc 1233 (0x81b7b7d00)]: checkHASFOConfigVerbose: haConfigured: True, result HA_AGENT_CONFIGURED. 00000074.00660031 243bcfea Thu Sep 26 2019 04:33:37 -06:00 [kern_mgwd:info:2284] 0x81b7b5500: 8503e8000000295b: INFO: cluster_ring: get_cluster_ip_for_node:src/tables/cluster_ring.cc:917 Start 00000074.00660032 243bcfea Thu Sep 26 2019 04:33:37 -06:00 [kern_mgwd:info:2284] 0x81b7b4100: 8503e8000000295f: ERR: AggrEfficiency: src/tables/aggr_efficiency.cc:smdb_error aggr_efficiency_iterator::_getAggrDetails(const smdb_type_aggr_name &, smdb_type_Uuid &, smdb_type_filerid &):122 Failed to get aggregate information from VLDB for aggregate , Reason: entry doesn't exist 00000074.00660033 243bcfea Thu Sep 26 2019 04:33:37 -06:00 [kern_mgwd:info:2284] 0x81b7b5500: 8503e8000000295b: INFO: cluster_ring: get_cluster_ip_for_node:src/tables/cluster_ring.cc:956 End 00000074.00660034 243bcfea Thu Sep 26 2019 04:33:37 -06:00 [kern_mgwd:info:2284] 0x81b7b5500: 8503e8000000295b: INFO: cluster_ring: is_ring_online_on_node:src/tables/cluster_ring.cc:985 Start, checking node nmg-fas8040-02 and unit mgmt. 00000074.00660035 243bcfea Thu Sep 26 2019 04:33:37 -06:00 [kern_mgwd:info:2284] 0x81b7b5500: 8503e8000000295b: NOTICE: RpcConnectionCache: clearFailure: called for 169.254.5.219:536874272(rdb_management)/1[tcp]{fffffffd|4} 00000074.00660036 243bcfea Thu Sep 26 2019 04:33:37 -06:00 [kern_mgwd:info:2284] 0x81b7b4100: 8503e8000000295f: ERR: AggrEfficiency: src/tables/aggr_efficiency.cc:smdb_error aggr_efficiency_iterator::_populateRowFromKSMFTable(const smdb_type_filerid &, const smdb_type_Uuid &):171 kSMF get failed for aggr 6173354a-2f55-4aa2-824b-54d19124c33c, Reason: entry doesn't exist 00000074.00660037 243bcfea Thu Sep 26 2019 04:33:37 -06:00 [kern_mgwd:info:2284] 0x81b7b5500: 8503e8000000295b: INFO: cluster_ring: is_ring_online_on_node:src/tables/cluster_ring.cc:1023 End 00000074.00660038 243bcfea Thu Sep 26 2019 04:33:37 -06:00 [kern_mgwd:info:2284] 0x81b7b5500: 8503e8000000295b: INFO: cluster_ring: is_ring_online_on_node:src/tables/cluster_ring.cc:985 Start, checking node nmg-fas8040-02 and unit vldb. 00000074.00660039 243bcfea Thu Sep 26 2019 04:33:37 -06:00 [kern_mgwd:info:2284] 0x81b7b5500: 8503e8000000295b: ERR: cluster_ring: rdb_ring_info:src/tables/cluster_ring.cc:203 RDB ring state query of 169.254.5.219 for vldb failed on RPC connect: clnttcp_create: RPC: Remote system error - Connection refused 00000074.0066003a 243bcfea Thu Sep 26 2019 04:33:37 -06:00 [kern_mgwd:info:2284] 0x81b7b5500: 8503e8000000295b: INFO: cluster_ring: is_ring_online_on_node:src/tables/cluster_ring.cc:1023 End 00000074.0066003b 243bcfea Thu Sep 26 2019 04:33:37 -06:00 [kern_mgwd:info:2284] 0x81b7b5500: 8503e8000000295b: INFO: cluster_ring: is_ring_online_on_node:src/tables/cluster_ring.cc:985 Start, checking node nmg-fas8040-02 and unit vifmgr. 00000074.0066003c 243bcfea Thu Sep 26 2019 04:33:37 -06:00 [kern_mgwd:info:2284] 0x81b7b5500: 8503e8000000295b: ERR: cluster_ring: rdb_ring_info:src/tables/cluster_ring.cc:203 RDB ring state query of 169.254.5.219 for vifmgr failed on RPC connect: clnttcp_create: RPC: Remote system error - Connection refused 00000074.0066003d 243bcfea Thu Sep 26 2019 04:33:37 -06:00 [kern_mgwd:info:2284] 0x81b7b5500: 8503e8000000295b: INFO: cluster_ring: is_ring_online_on_node:src/tables/cluster_ring.cc:1023 End 00000074.0066003e 243bcfea Thu Sep 26 2019 04:33:37 -06:00 [kern_mgwd:info:2284] 0x81b7b5500: 8503e8000000295b: INFO: cluster_ring: is_ring_online_on_node:src/tables/cluster_ring.cc:985 Start, checking node nmg-fas8040-02 and unit bcomd. 00000074.0066003f 243bcfea Thu Sep 26 2019 04:33:37 -06:00 [kern_mgwd:info:2284] 0x81b7b5500: 8503e8000000295b: ERR: cluster_ring: rdb_ring_info:src/tables/cluster_ring.cc:203 RDB ring state query of 169.254.5.219 for bcomd failed on RPC connect: clnttcp_create: RPC: Remote system error - Connection refused 00000074.00660040 243bcfea Thu Sep 26 2019 04:33:37 -06:00 [kern_mgwd:info:2284] 0x81b7b5500: 8503e8000000295b: INFO: cluster_ring: is_ring_online_on_node:src/tables/cluster_ring.cc:1023 End 00000074.00660041 243bcfea Thu Sep 26 2019 04:33:37 -06:00 [kern_mgwd:info:2284] 0x81b7b5500: 8503e8000000295b: INFO: cluster_ring: is_ring_online_on_node:src/tables/cluster_ring.cc:985 Start, checking node nmg-fas8040-02 and unit crs. 00000074.00660042 243bcfea Thu Sep 26 2019 04:33:37 -06:00 [kern_mgwd:info:2284] 0x81b7b5500: 8503e8000000295b: ERR: cluster_ring: rdb_ring_info:src/tables/cluster_ring.cc:203 RDB ring state query of 169.254.5.219 for crs failed on RPC connect: clnttcp_create: RPC: Remote system error - Connection refused 00000074.00660043 243bcfea Thu Sep 26 2019 04:33:37 -06:00 [kern_mgwd:info:2284] 0x81b7b5500: 8503e8000000295b: INFO: cluster_ring: is_ring_online_on_node:src/tables/cluster_ring.cc:1023 End 00000074.00660044 243bcfea Thu Sep 26 2019 04:33:37 -06:00 [kern_mgwd:info:2284] 0x81b7b5500: 8503e8000000295b: ERR: SFO_Ready|initstateshelper: isScsiBladeStatusOk:src/mgmt_s1/init_states_helper.cc:118 bcomd_info_iterator get failed for node nmg-fas8040-02 00000074.00660045 243bcfea Thu Sep 26 2019 04:33:37 -06:00 [kern_mgwd:info:2284] 0x81b7b5500: 8503e8000000295b: INFO: SFO_Ready|initstateshelper: getProcStateDescription state: Offline applications: vldb, vifmgr, bcomd, crs, scsi blade, clam. 00000074.00660046 243bcfea Thu Sep 26 2019 04:33:37 -06:00 [kern_mgwd:info:2284] 0x81b7b5500: 8503e8000000295b: INFO: SFO_Ready|initstateshelper: updateInitStateDescription state: Connected to nmg-fas8040-01. Waiting for cluster applications to come online on the local node. Offline applications: vldb, vifmgr, bcomd, crs, scsi blade, clam. 00000074.00660047 243bcfea Thu Sep 26 2019 04:33:37 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries for vifmgr on node "nmg-fas8040-02": RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -1) to vifmgr at 169.254.5.219]. 00000074.00660048 243bcfea Thu Sep 26 2019 04:33:37 -06:00 [kern_mgwd:info:2284] 0x81b7b5000: 8503e80000002960: NOTICE: TABLES::disk: Added 168 disk recs to the shared reference cache (size 84) 00000074.0066006b 243bd048 Thu Sep 26 2019 04:33:39 -06:00 [kern_mgwd:info:2284] A [src/rdb/HAM.cc 1233 (0x81b7b5a00)]: checkHASFOConfigVerbose: haConfigured: True, result HA_AGENT_CONFIGURED. 00000074.00660078 243bd048 Thu Sep 26 2019 04:33:41 -06:00 [kern_mgwd:info:2284] 0x81d1e4200: 86ffff000000000e: WARNING: job_manager::job_recovery: thread_body:src/job_recovery.cc:496 recovery_thread: not sleeping 00000074.006600bd 243bd065 Thu Sep 26 2019 04:33:49 -06:00 [kern_mgwd:info:2284] 0x81b245100: 0: NOTICE: Net::Vserver: NetVserverQueue::schedule_refresh: scheduled a refresh for 1 vservers on node nmg-fas8040-02 00000074.006600be 243bd065 Thu Sep 26 2019 04:33:49 -06:00 [kern_mgwd:info:2284] A [src/rdb/TM.cc 3094 (0x81d1eab00)]: RW-transaction TID <6,85,85> held by client 1001 for 8 seconds (created: 60789972s, now: 60789980s) (label 'network recovery cancel'). 00000074.006600bf 243bd065 Thu Sep 26 2019 04:33:49 -06:00 [kern_mgwd:info:2284] 0x81d1eab00: 0: NOTICE: Net::Vserver: NetVserverQueue::UpdateTask::_updateNode: updating vserver status for vifmgr on node nmg-fas8040-02 00000074.006600c0 243bd065 Thu Sep 26 2019 04:33:49 -06:00 [kern_mgwd:info:2284] 0x81d1eab00: 0: NOTICE: Net::Vserver: NetVserverQueue::UpdateTask::_updateNode: failed to update vserver cache on node nmg-fas8040-02 (attempt 1): RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to vifmgr at 169.254.5.219] 00000074.006600c3 243bd065 Thu Sep 26 2019 04:33:50 -06:00 [kern_mgwd:info:2284] 0x81b7bc800: 0: ERR: Tables:web: web_proxy_cluster_lifs: Failed to get the operational status of cluster LIF 1007 on node nmg-fas8040-02: RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to vifmgr at 169.254.5.219] 00000074.006600c4 243bd065 Thu Sep 26 2019 04:33:50 -06:00 [kern_mgwd:info:2284] 0x81b7bc800: 0: ERR: Tables:web: web_proxy_cluster_lifs: Failed to get the operational status of cluster LIF 1008 on node nmg-fas8040-02: RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to vifmgr at 169.254.5.219] 00000074.006600c5 243bd065 Thu Sep 26 2019 04:33:50 -06:00 [kern_mgwd:info:2284] 0x81b7bc800: 0: ERR: Tables:web: web_proxy_cluster_lifs: Failed to get the operational status of cluster LIF 1009 on node nmg-fas8040-02: RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to vifmgr at 169.254.5.219] 00000074.006600c6 243bd065 Thu Sep 26 2019 04:33:50 -06:00 [kern_mgwd:info:2284] 0x81b7bc800: 0: ERR: Tables:web: web_proxy_cluster_lifs: Failed to get the operational status of cluster LIF 1010 on node nmg-fas8040-02: RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to vifmgr at 169.254.5.219] 00000074.006600c7 243bd065 Thu Sep 26 2019 04:33:50 -06:00 [kern_mgwd:info:2284] 0x81b7bc800: 0: ERR: Tables:web: web_proxy_cluster_lifs: Failed to find an operational cluster LIF on node nmg-fas8040-02 00000074.006600c8 243bd065 Thu Sep 26 2019 04:33:50 -06:00 [kern_mgwd:info:2284] 0x81da81100: 0: ERR: Tables:web: web_proxy_cluster_lifs: Failed to get the operational status of cluster LIF 1007 on node nmg-fas8040-02: RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to vifmgr at 169.254.5.219] 00000074.006600c9 243bd065 Thu Sep 26 2019 04:33:50 -06:00 [kern_mgwd:info:2284] 0x81da81100: 0: ERR: Tables:web: web_proxy_cluster_lifs: Failed to get the operational status of cluster LIF 1008 on node nmg-fas8040-02: RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to vifmgr at 169.254.5.219] 00000074.006600ca 243bd065 Thu Sep 26 2019 04:33:50 -06:00 [kern_mgwd:info:2284] 0x81da81100: 0: ERR: Tables:web: web_proxy_cluster_lifs: Failed to get the operational status of cluster LIF 1009 on node nmg-fas8040-02: RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to vifmgr at 169.254.5.219] 00000074.006600cb 243bd065 Thu Sep 26 2019 04:33:50 -06:00 [kern_mgwd:info:2284] 0x81da81100: 0: ERR: Tables:web: web_proxy_cluster_lifs: Failed to get the operational status of cluster LIF 1010 on node nmg-fas8040-02: RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to vifmgr at 169.254.5.219] 00000074.006600cc 243bd065 Thu Sep 26 2019 04:33:50 -06:00 [kern_mgwd:info:2284] 0x81da81100: 0: ERR: Tables:web: web_proxy_cluster_lifs: Failed to find an operational cluster LIF on node nmg-fas8040-02 00000074.006600cd 243bd079 Thu Sep 26 2019 04:33:52 -06:00 [kern_mgwd:info:2284] 0x81d1eab00: 0: NOTICE: Net::Vserver: NetVserverQueue::UpdateTask::_updateNode: updating vserver status for vifmgr on node nmg-fas8040-02 00000074.006600ce 243bd079 Thu Sep 26 2019 04:33:52 -06:00 [kern_mgwd:info:2284] 0x81d1eab00: 0: NOTICE: Net::Vserver: NetVserverQueue::UpdateTask::_updateNode: failed to update vserver cache on node nmg-fas8040-02 (attempt 2): RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to vifmgr at 169.254.5.219] 00000074.006600d1 243bd097 Thu Sep 26 2019 04:33:55 -06:00 [kern_mgwd:info:2284] 0x81d1eab00: 0: NOTICE: Net::Vserver: NetVserverQueue::UpdateTask::_updateNode: updating vserver status for vifmgr on node nmg-fas8040-02 00000074.006600d2 243bd097 Thu Sep 26 2019 04:33:55 -06:00 [kern_mgwd:info:2284] 0x81d1eab00: 0: NOTICE: Net::Vserver: NetVserverQueue::UpdateTask::_updateNode: failed to update vserver cache on node nmg-fas8040-02 (attempt 3): RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to vifmgr at 169.254.5.219] 00000074.006600d5 243bd0b5 Thu Sep 26 2019 04:33:58 -06:00 [kern_mgwd:info:2284] 0x81d1eab00: 0: NOTICE: Net::Vserver: NetVserverQueue::UpdateTask::_updateNode: updating vserver status for vifmgr on node nmg-fas8040-02 00000074.006600d6 243bd0b5 Thu Sep 26 2019 04:33:58 -06:00 [kern_mgwd:info:2284] 0x81d1eab00: 0: NOTICE: Net::Vserver: NetVserverQueue::UpdateTask::_updateNode: failed to update vserver cache on node nmg-fas8040-02 (attempt 4): RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to vifmgr at 169.254.5.219] 00000074.006600d7 243bd0d4 Thu Sep 26 2019 04:34:01 -06:00 [kern_mgwd:info:2284] 0x81d1eab00: 0: NOTICE: Net::Vserver: NetVserverQueue::UpdateTask::_updateNode: updating vserver status for vifmgr on node nmg-fas8040-02 00000074.006600d8 243bd0d4 Thu Sep 26 2019 04:34:01 -06:00 [kern_mgwd:info:2284] 0x81d1eab00: 0: NOTICE: Net::Vserver: NetVserverQueue::UpdateTask::_updateNode: failed to update vserver cache on node nmg-fas8040-02 (attempt 5): RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to vifmgr at 169.254.5.219] 00000074.006600dc 243bd0f1 Thu Sep 26 2019 04:34:04 -06:00 [kern_mgwd:info:2284] 0x81d1eab00: 0: NOTICE: Net::Vserver: NetVserverQueue::UpdateTask::_updateNode: updating vserver status for vifmgr on node nmg-fas8040-02 00000074.006600dd 243bd0f1 Thu Sep 26 2019 04:34:04 -06:00 [kern_mgwd:info:2284] 0x81d1eab00: 0: NOTICE: Net::Vserver: NetVserverQueue::UpdateTask::_updateNode: failed to update vserver cache on node nmg-fas8040-02 (attempt 6): RPC: Couldn't make connection [from mgwd on node "nmg-fas8040-01" (VSID: -3) to vifmgr at 169.254.5.219] 00000074.006600e0 243bd10f Thu Sep 26 2019 04:34:07 -06:00 [kern_mgwd:info:2284] 0x81d1eab00: 0: NOTICE: Net::Vserver: NetVserverQueue::UpdateTask::_updateNode: updating vserver status for vifmgr on node nmg-fas8040-02 00000074.006600e1 243bd10f Thu Sep 26 2019 04:34:07 -06:00 [kern_mgwd:info:2284] 0x81d1eab00: 0: NOTICE: RpcConnectionCache: clearFailure: called for 169.254.5.219:536873492(vifmgr)/1[tcp]{fffffffd|4} 00000074.006600e2 243bd10f Thu Sep 26 2019 04:34:07 -06:00 [kern_mgwd:info:2284] 0x81d1eab00: 0: NOTICE: Net::Vserver: NetVserverQueue::UpdateTask::_updateNode: returning immediately: success 00000074.006600ef 243bd23d Thu Sep 26 2019 04:34:37 -06:00 [kern_mgwd:info:2284] 0x81b148c00: 8503e80000002970: NOTICE: TABLES::disk: Added 168 disk recs to the shared reference cache (size 84) 00000074.006600f0 243bd23d Thu Sep 26 2019 04:34:37 -06:00 [kern_mgwd:info:2284] A [src/rdb/HAM.cc 1233 (0x81b7b5f00)]: checkHASFOConfigVerbose: haConfigured: True, result HA_AGENT_CONFIGURED. 00000074.00660122 243bd2da Thu Sep 26 2019 04:34:53 -06:00 [kern_mgwd:info:2284] 0x81b7bb400: 0: ERR: RPCServer: mgwd_xml_start_1_svc: Called for asup_pathname(/mroot/etc/log/autosupport/201909260434.0.files) 00000074.00660123 243bd2da Thu Sep 26 2019 04:34:53 -06:00 [kern_mgwd:info:2284] 0x81b7bb400: 0: ERR: RPCServer: mgwd_xml_start_1_svc: current_asup_xml exists. State: (2) 00000074.00660124 243bd2da Thu Sep 26 2019 04:34:53 -06:00 [kern_mgwd:info:2284] 0x81b7bb400: 0: ERR: RPCServer: mgwd_xml_start_1_svc: ASUP Started SUCCESS 00000074.00660125 243bd309 Thu Sep 26 2019 04:34:55 -06:00 [kern_mgwd:info:2284] 0x81da89800: 0: ERR: perf::perf_asup_info: _validateCounterMapCache: asup store enabled - caching only mhost objects 00000074.00660126 243bd309 Thu Sep 26 2019 04:34:55 -06:00 [kern_mgwd:info:2284] 0x81da89800: 0: ERR: perf::perf_asup_info: _validateCounterMapCache: asup store enabled - caching only mhost objects 00000074.00660128 243bd309 Thu Sep 26 2019 04:34:55 -06:00 [kern_mgwd:info:2284] 0x81da89800: 0: ERR: perf::perf_asup_info: _validateCounterMapCache: asup store enabled - caching only mhost objects 00000074.00660129 243bd309 Thu Sep 26 2019 04:34:55 -06:00 [kern_mgwd:info:2284] 0x81da89800: 0: ERR: perf::perf_asup_info: _validateCounterMapCache: asup store enabled - caching only mhost objects 00000074.0066012a 243bd30a Thu Sep 26 2019 04:34:55 -06:00 [kern_mgwd:info:2284] 0x81da89800: 0: ERR: perf::perf_asup_info: _validateCounterMapCache: asup store enabled - caching only mhost objects 00000074.0066012c 243bd30a Thu Sep 26 2019 04:34:55 -06:00 [kern_mgwd:info:2284] 0x81da89800: 0: ERR: perf::perf_asup_info: _validateCounterMapCache: asup store enabled - caching only mhost objects 00000074.0066012e 243bd30a Thu Sep 26 2019 04:34:55 -06:00 [kern_mgwd:info:2284] 0x81da89800: 0: ERR: perf::perf_asup_info: _validateCounterMapCache: asup store enabled - caching only mhost objects 00000074.00660130 243bd30a Thu Sep 26 2019 04:34:55 -06:00 [kern_mgwd:info:2284] 0x81da89800: 0: ERR: perf::perf_asup_info: _validateCounterMapCache: asup store enabled - caching only mhost objects 00000074.00660132 243bd30b Thu Sep 26 2019 04:34:55 -06:00 [kern_mgwd:info:2284] 0x81da89800: 0: ERR: perf::perf_asup_info: _validateCounterMapCache: asup store enabled - caching only mhost objects 00000074.00660133 243bd30b Thu Sep 26 2019 04:34:55 -06:00 [kern_mgwd:info:2284] 0x81da89800: 0: ERR: perf::perf_asup_info: _validateCounterMapCache: asup store enabled - caching only mhost objects 00000074.00660134 243bd30b Thu Sep 26 2019 04:34:55 -06:00 [kern_mgwd:info:2284] 0x81da89800: 0: ERR: perf::perf_asup_info: _validateCounterMapCache: asup store enabled - caching only mhost objects 00000074.00660136 243bd30b Thu Sep 26 2019 04:34:55 -06:00 [kern_mgwd:info:2284] 0x81da89800: 0: ERR: metrocluster::fcvi: get failed on kern_fcvi_info table for port 0, error = entry doesn't exist {in get_imp() at src/tables/sysconfig_ic_xml.cc:105} 00000074.00660137 243bd30b Thu Sep 26 2019 04:34:55 -06:00 [kern_mgwd:info:2284] 0x81da89800: 0: ERR: metrocluster::fcvi: get failed on kern_fcvi_info table for port 0, error = entry doesn't exist {in next_imp() at src/tables/sysconfig_ic_xml.cc:137} 00000074.00660138 243bd30b Thu Sep 26 2019 04:34:55 -06:00 [kern_mgwd:info:2284] Error: Loop detected in next() for table kern_ethernet_controller_info. Next on "0" returned "0". 00000074.00660139 243bd30c Thu Sep 26 2019 04:34:55 -06:00 [kern_mgwd:info:2284] Warning: Unable to list entries on node nmg-fas8040-01. System Disk details are not available on this platform. 00000074.00660144 243bd322 Thu Sep 26 2019 04:35:00 -06:00 [kern_mgwd:info:2284] 0x81da89800: 0: ERR: AggrEfficiency: src/tables/aggr_efficiency.cc:smdb_error aggr_efficiency_iterator::_getAggrDetails(const smdb_type_aggr_name &, smdb_type_Uuid &, smdb_type_filerid &):122 Failed to get aggregate information from VLDB for aggregate , Reason: entry doesn't exist 00000074.00660148 243bd361 Thu Sep 26 2019 04:35:05 -06:00 [kern_mgwd:info:2284] 0x81da89800: 0: NOTICE: RpcConnectionCache: clearFailure: called for 169.254.5.219:536873504(bcomd)/1[tcp]{fffffffd|4} 00000074.00660149 243bd361 Thu Sep 26 2019 04:35:05 -06:00 [kern_mgwd:info:2284] 0x81da89800: 0: ERR: SAN::FCP::INITIATOR: src/tables/san/fcp_initiator.cc:get_imp:134 returning: 82/30 - Invalid WWN "": Valid WWN format is XX:XX:XX:XX:XX:XX:XX:XX, where X is a hexadecimal digit. Example: "01:02:03:04:0a:0b:0c:0d". 00000074.0066014a 243bd361 Thu Sep 26 2019 04:35:05 -06:00 [kern_mgwd:info:2284] 0x81da89800: 0: ERR: SAN::MGWD::UTILS: src/tables/san/bcomUtils.cc:getVserverUuid:1013 Failed getting UUID for vserver : entry doesn't exist 00000074.0066014b 243bd361 Thu Sep 26 2019 04:35:05 -06:00 [kern_mgwd:info:2284] 0x81da89800: 0: ERR: SAN::ISCSI::INTERFACE: src/tables/san/iscsi_interface.cc:get_imp:422 returning: 40/24 - Failed to lookup identifier for Vserver . entry doesn't exist. 00000074.0066014c 243bd361 Thu Sep 26 2019 04:35:06 -06:00 [kern_mgwd:info:2284] 0x81da89800: 0: INFO: SFO_Ready|Cluster_Apps: wait_for_apps_online (waiter: VReport) apps: vldb, maxTime 5 sec: starting 00000074.0066014d 243bd361 Thu Sep 26 2019 04:35:06 -06:00 [kern_mgwd:info:2284] 0x81da89800: 0: INFO: SFO_Ready|Cluster_Apps: wait_for_apps_online (VReport): vldb is online. Number of tries: 1. 00000074.0066014e 243bd361 Thu Sep 26 2019 04:35:06 -06:00 [kern_mgwd:info:2284] 0x81da89800: 0: INFO: SFO_Ready|Cluster_Apps: wait_for_apps_online (waiter: VReport): Finished after 0 tries. 00000074.0066014f 243bd361 Thu Sep 26 2019 04:35:06 -06:00 [kern_mgwd:info:2284] 0x81da89800: 0: INFO: SFO_Ready|Cluster_Apps: wait_for_apps_online (waiter: VReport) apps: vldb, maxTime 5 sec: starting 00000074.00660150 243bd361 Thu Sep 26 2019 04:35:06 -06:00 [kern_mgwd:info:2284] 0x81da89800: 0: INFO: SFO_Ready|Cluster_Apps: wait_for_apps_online (VReport): vldb is online. Number of tries: 1. 00000074.00660151 243bd361 Thu Sep 26 2019 04:35:06 -06:00 [kern_mgwd:info:2284] 0x81da89800: 0: INFO: SFO_Ready|Cluster_Apps: wait_for_apps_online (waiter: VReport): Finished after 0 tries. 00000074.00660152 243bd361 Thu Sep 26 2019 04:35:06 -06:00 [kern_mgwd:info:2284] 0x81da89800: 0: WARNING: MGWD::volume_cache: populateCache SetVolumeCache 546 d_volume_list_info_iter_next with nextTag: cookie=0,desired_attrs=name,owning-vserver-uuid,is-home,extent-size,dsid,msid,state,vol-access,language-code,containing-aggregate,mirror-types,containing-aggregate-uuid,data-version,uuid,clone-parent,is-cluster-volume,fc-cache-policy-idx,transition,iv-constituent-role,creation-time,snaplock,flexgroup-index,flexgroup-msid,flexgroup-uuid,ondisk-quiesced,encrypt,key-id,encryption-blob,key-generation,buftree-id,btuuid response from node: 169.254.5.219 is: 00000074.00660153 243bd361 Thu Sep 26 2019 04:35:06 -06:00 [kern_mgwd:info:2284] 0x81da89800: 0: WARNING: MGWD::volume_cache: populateCache SetVolumeCache 546 d_volume_list_info_iter_next with nextTag: cookie=f26ab847-ca47-11e7-8fa8-00a098573067,desired_attrs=name,owning-vserver-uuid,is-home,extent-size,dsid,msid,state,vol-access,language-code,containing-aggregate,mirror-types,containing-aggregate-uuid,data-version,uuid,clone-parent,is-cluster-volume,fc-cache-policy-idx,transition,iv-constituent-role,creation-time,snaplock,flexgroup-index,flexgroup-msid,flexgroup-uuid,ondisk-quiesced,encrypt,key-id,encryption-blob,key-generation,buftree-id,btuuid response from node: 169.254.5.219 is: 00000074.00660154 243bd361 Thu Sep 26 2019 04:35:06 -06:00 [kern_mgwd:info:2284] 0x81da89800: 0: WARNING: MGWD::volume_cache: populateCache SetVolumeCache 546 d_volume_list_info_iter_next with nextTag: cookie=0,desired_attrs=name,owning-vserver-uuid,is-home,extent-size,dsid,msid,state,vol-access,language-code,containing-aggregate,mirror-types,containing-aggregate-uuid,data-version,uuid,clone-parent,is-cluster-volume,fc-cache-policy-idx,transition,iv-constituent-role,creation-time,snaplock,flexgroup-index,flexgroup-msid,flexgroup-uuid,ondisk-quiesced,encrypt,key-id,encryption-blob,key-generation,buftree-id,btuuid response from node: 169.254.23.82 is: 00000074.00660155 243bd361 Thu Sep 26 2019 04:35:06 -06:00 [kern_mgwd:info:2284] 0x81da89800: 0: WARNING: MGWD::volume_cache: populateCache SetVolumeCache 546 d_volume_list_info_iter_next with nextTag: cookie=c5105621-51ff-44fe-9abe-69b0d9bee4da,desired_attrs=name,owning-vserver-uuid,is-home,extent-size,dsid,msid,state,vol-access,language-code,containing-aggregate,mirror-types,containing-aggregate-uuid,data-version,uuid,clone-parent,is-cluster-volume,fc-cache-policy-idx,transition,iv-constituent-role,creation-time,snaplock,flexgroup-index,flexgroup-msid,flexgroup-uuid,ondisk-quiesced,encrypt,key-id,encryption-blob,key-generation,buftree-id,btuuid response from node: 169.254.23.82 is: 00000074.00660156 243bd361 Thu Sep 26 2019 04:35:06 -06:00 [kern_mgwd:info:2284] 0x81da89800: 0: ERR: rdb_glue: create_imp: duplicate key for 'vreportCacheLocation' 00000074.00660157 243bd361 Thu Sep 26 2019 04:35:06 -06:00 [kern_mgwd:info:2284] 0x81da89800: 0: ERR: tables::vreport: Failed to update vreportCacheLocation table with the local node: nmg-fas8040-01. Reason: duplicate entry 00000074.00660158 243bd361 Thu Sep 26 2019 04:35:06 -06:00 [kern_mgwd:info:2284] 0x81da89800: 0: ERR: tables::vreport: Object Name not found in vReport cache. 00000074.00660159 243bd361 Thu Sep 26 2019 04:35:06 -06:00 [kern_mgwd:info:2284] 0x81da89800: 0: ERR: tables::vreport: isMCCPostHealRoots: Cannot get metrocluster state. Error: entry doesn't exist 00000074.0066015a 243bd361 Thu Sep 26 2019 04:35:06 -06:00 [kern_mgwd:info:2284] 0x81da89800: 0: ERR: MGWD::VsMSID: src/vreport/vreport_junction.h 125: toStr(): vsName and vsid are both empty. 00000074.0066015b 243bd361 Thu Sep 26 2019 04:35:06 -06:00 [kern_mgwd:info:2284] 0x81da89800: 0: ERR: MGWD::VsMSID: src/vreport/vreport_junction.h 134: toStr(): volName and volMsid are both empty. The object is 00000074.0066015c 243bd361 Thu Sep 26 2019 04:35:06 -06:00 [kern_mgwd:info:2284] 0x81da89800: 0: ERR: MGWD::VsMSID: src/vreport/vreport_junction.h 125: toStr(): vsName and vsid are both empty. 00000074.0066015d 243bd361 Thu Sep 26 2019 04:35:06 -06:00 [kern_mgwd:info:2284] 0x81da89800: 0: ERR: MGWD::VsMSID: src/vreport/vreport_junction.h 134: toStr(): volName and volMsid are both empty. The object is 00000074.0066015e 243bd361 Thu Sep 26 2019 04:35:06 -06:00 [kern_mgwd:info:2284] Info: WAFL and VLDB volume/aggregate records are consistent. 00000074.0066015f 243bd361 Thu Sep 26 2019 04:35:06 -06:00 [kern_mgwd:info:2284] 0x81da89800: 0: ERR: perf::perf_asup_info: _validateCounterMapCache: asup store enabled - caching only mhost objects 00000074.00660160 243bd361 Thu Sep 26 2019 04:35:06 -06:00 [kern_mgwd:info:2284] 0x81da89800: 0: ERR: perf::perf_asup_info: _validateCounterMapCache: asup store enabled - caching only mhost objects 00000074.006601a1 243bd6c0 Thu Sep 26 2019 04:36:33 -06:00 [kern_mgwd:info:2284] 0x81b7bb400: 0: ERR: RPCServer: mgwd_xml_start_1_svc: Called for asup_pathname(/mroot/etc/log/autosupport/201909260436.0.files) 00000074.006601a2 243bd6c0 Thu Sep 26 2019 04:36:33 -06:00 [kern_mgwd:info:2284] 0x81b7bb400: 0: ERR: RPCServer: mgwd_xml_start_1_svc: current_asup_xml exists. State: (2) 00000074.006601a3 243bd6c0 Thu Sep 26 2019 04:36:33 -06:00 [kern_mgwd:info:2284] 0x81b7bb400: 0: ERR: RPCServer: mgwd_xml_start_1_svc: ASUP Started SUCCESS 00000074.006601cc 243bd792 Thu Sep 26 2019 04:36:53 -06:00 [kern_mgwd:info:2284] A [src/rdb/HAM.cc 1233 (0x81b7b6400)]: checkHASFOConfigVerbose: haConfigured: True, result HA_AGENT_CONFIGURED. 00000074.006601cd 243bd792 Thu Sep 26 2019 04:36:53 -06:00 [kern_mgwd:info:2284] 0x81b7b5f00: 8503e80000002988: ERR: AggrEfficiency: src/tables/aggr_efficiency.cc:smdb_error aggr_efficiency_iterator::_getAggrDetails(const smdb_type_aggr_name &, smdb_type_Uuid &, smdb_type_filerid &):122 Failed to get aggregate information from VLDB for aggregate , Reason: entry doesn't exist 00000074.006601ce 243bd792 Thu Sep 26 2019 04:36:54 -06:00 [kern_mgwd:info:2284] 0x81b7b7800: 8503e80000002987: NOTICE: TABLES::disk: Added 168 disk recs to the shared reference cache (size 84) 00000074.006601f5 243bd7b2 Thu Sep 26 2019 04:36:56 -06:00 [kern_mgwd:info:2284] A [src/rdb/HAM.cc 1233 (0x81b7b6900)]: checkHASFOConfigVerbose: haConfigured: True, result HA_AGENT_CONFIGURED. 00000074.00660201 243bd9eb Thu Sep 26 2019 04:37:54 -06:00 [kern_mgwd:info:2284] A [src/rdb/HAM.cc 1233 (0x81b7b5a00)]: checkHASFOConfigVerbose: haConfigured: True, result HA_AGENT_CONFIGURED. 00000074.00660202 243bd9eb Thu Sep 26 2019 04:37:54 -06:00 [kern_mgwd:info:2284] 0x81b7b6400: 8503e8000000299b: NOTICE: TABLES::disk: Added 168 disk recs to the shared reference cache (size 84) 00000074.00660223 243bdac5 Thu Sep 26 2019 04:38:16 -06:00 [kern_mgwd:info:2284] 0x81d1ea100: 86ffff0000000035: WARNING: job_manager::job_store: run:src/job_store_support.cc:568 Job Mgr: rdb_transaction history: OK/0 OK/190 OK/299 OK/490 OK/665 00000074.006602a9 243bdf7f Thu Sep 26 2019 04:40:16 -06:00 [kern_mgwd:info:2284] A [src/rdb/HAM.cc 1233 (0x81b7b5500)]: checkHASFOConfigVerbose: haConfigured: True, result HA_AGENT_CONFIGURED. 00000074.006602b4 243be082 Thu Sep 26 2019 04:40:42 -06:00 [kern_mgwd:info:2284] 0x81b7b3c00: 8503e800000029e6: NOTICE: TABLES::disk: Added 168 disk recs to the shared reference cache (size 84) 00000074.00660309 243be2f1 Thu Sep 26 2019 04:41:44 -06:00 [kern_mgwd:info:2284] 0x81b7b4100: 8503e800000029f8: NOTICE: TABLES::disk: Added 168 disk recs to the shared reference cache (size 84) 00000074.0066030a 243be2f1 Thu Sep 26 2019 04:41:44 -06:00 [kern_mgwd:info:2284] A [src/rdb/HAM.cc 1233 (0x81b7b6900)]: checkHASFOConfigVerbose: haConfigured: True, result HA_AGENT_CONFIGURED. 00000074.0066030b 243be2f1 Thu Sep 26 2019 04:41:44 -06:00 [kern_mgwd:info:2284] 0x81b7b3700: 8503e800000029fd: ERR: AggrEfficiency: src/tables/aggr_efficiency.cc:smdb_error aggr_efficiency_iterator::_getAggrDetails(const smdb_type_aggr_name &, smdb_type_Uuid &, smdb_type_filerid &):122 Failed to get aggregate information from VLDB for aggregate , Reason: entry doesn't exist 00000074.0066030d 243be307 Thu Sep 26 2019 04:41:47 -06:00 [kern_mgwd:info:2284] A [src/rdb/HAM.cc 1233 (0x81b7b5000)]: checkHASFOConfigVerbose: haConfigured: True, result HA_AGENT_CONFIGURED. 00000074.0066035a 243be41f Thu Sep 26 2019 04:42:15 -06:00 [kern_mgwd:info:2284] A [src/rdb/HAM.cc 1233 (0x81b7b5f00)]: checkHASFOConfigVerbose: haConfigured: True, result HA_AGENT_CONFIGURED. 00000074.0066035b 243be41f Thu Sep 26 2019 04:42:15 -06:00 [kern_mgwd:info:2284] 0x81b7b8700: 8503e80000002a21: ERR: AggrEfficiency: src/tables/aggr_efficiency.cc:smdb_error aggr_efficiency_iterator::_getAggrDetails(const smdb_type_aggr_name &, smdb_type_Uuid &, smdb_type_filerid &):122 Failed to get aggregate information from VLDB for aggregate , Reason: entry doesn't exist 00000074.0066037d 243be434 Thu Sep 26 2019 04:42:17 -06:00 [kern_mgwd:info:2284] A [src/rdb/HAM.cc 1233 (0x81b7b4b00)]: checkHASFOConfigVerbose: haConfigured: True, result HA_AGENT_CONFIGURED. 00000074.00660388 243be5c3 Thu Sep 26 2019 04:42:56 -06:00 [kern_mgwd:info:2284] A [src/rdb/HAM.cc 1233 (0x81b7b6900)]: checkHASFOConfigVerbose: haConfigured: True, result HA_AGENT_CONFIGURED. 00000074.00660393 243beeaa Thu Sep 26 2019 04:46:45 -06:00 [kern_mgwd:info:2284] A [src/rdb/HAM.cc 1233 (0x81b7b5500)]: checkHASFOConfigVerbose: haConfigured: True, result HA_AGENT_CONFIGURED. 00000074.00660394 243beeaa Thu Sep 26 2019 04:46:45 -06:00 [kern_mgwd:info:2284] 0x81b7b7d00: 8503e80000002a39: ERR: AggrEfficiency: src/tables/aggr_efficiency.cc:smdb_error aggr_efficiency_iterator::_getAggrDetails(const smdb_type_aggr_name &, smdb_type_Uuid &, smdb_type_filerid &):122 Failed to get aggregate information from VLDB for aggregate , Reason: entry doesn't exist 00000074.00660395 243beeaa Thu Sep 26 2019 04:46:45 -06:00 [kern_mgwd:info:2284] 0x81b7b5f00: 8503e80000002a33: NOTICE: TABLES::disk: Added 168 disk recs to the shared reference cache (size 84) 00000074.006603b6 243beec1 Thu Sep 26 2019 04:46:47 -06:00 [kern_mgwd:info:2284] A [src/rdb/HAM.cc 1233 (0x81b7b5a00)]: checkHASFOConfigVerbose: haConfigured: True, result HA_AGENT_CONFIGURED. 00000074.006603ee 243bef8c Thu Sep 26 2019 04:47:07 -06:00 [kern_mgwd:info:2284] A [src/rdb/HAM.cc 1233 (0x81b7b7d00)]: checkHASFOConfigVerbose: haConfigured: True, result HA_AGENT_CONFIGURED. 00000074.006603ef 243bef8c Thu Sep 26 2019 04:47:07 -06:00 [kern_mgwd:info:2284] update_phase_data: populateData - No phase information found entry doesn't exist { ANDU_LOG in populateData() at src/tables/cluster_image.cc:3824 } 00000074.006603f0 243bef8c Thu Sep 26 2019 04:47:07 -06:00 [kern_mgwd:info:2284] update_phase_data: populateData - No phase information found entry doesn't exist { ANDU_LOG in populateData() at src/tables/cluster_image.cc:3824 } 00000074.006603f1 243bef8c Thu Sep 26 2019 04:47:07 -06:00 [kern_mgwd:info:2284] update_phase_data: populateData - No phase information found entry doesn't exist { ANDU_LOG in populateData() at src/tables/cluster_image.cc:3824 } 00000074.00660420 243bef8c Thu Sep 26 2019 04:47:07 -06:00 [kern_mgwd:info:2284] A [src/rdb/HAM.cc 1233 (0x81b149100)]: checkHASFOConfigVerbose: haConfigured: True, result HA_AGENT_CONFIGURED. 00000074.00660421 243bef8c Thu Sep 26 2019 04:47:07 -06:00 [kern_mgwd:info:2284] A [src/rdb/HAM.cc 1233 (0x81b7b5a00)]: checkHASFOConfigVerbose: haConfigured: True, result HA_AGENT_CONFIGURED. 00000074.00660422 243bef8c Thu Sep 26 2019 04:47:07 -06:00 [kern_mgwd:info:2284] 0x81b7b4b00: 8503e80000002a68: INFO: MGWD::mdnsd_utils: start_mdnsd:src/tables/mdnsd_utils.cc:524 mdnsd process start. ref_cnt=0+1. 00000074.00660423 243bef8c Thu Sep 26 2019 04:47:07 -06:00 [kern_mgwd:info:2284] 0x81b7b4b00: 8503e80000002a68: INFO: MGWD::mdnsd_utils: start_mdnsd:src/tables/mdnsd_utils.cc:531 Starting mdnsd process. 00000074.00660428 243bef8d Thu Sep 26 2019 04:47:07 -06:00 [kern_mgwd:info:2284] 0x81b7b4b00: 8503e80000002a68: INFO: MGWD::mdnsd_utils: start_mdnsd:src/tables/mdnsd_utils.cc:534 Sleeping for 5 seconds for mdnsd process startup. 00000074.0066043b 243bf007 Thu Sep 26 2019 04:47:17 -06:00 [kern_mgwd:info:2284] 0x81b7b4b00: 8503e80000002a68: ERR: dsmfp: reload_mgwd_dsmfp_services:src/tables/dns_sd_dsmfp.cc:1737 Couldn't find any dsmfp services to resolve with error entry doesn't exist. 00000074.0066043c 243bf007 Thu Sep 26 2019 04:47:17 -06:00 [kern_mgwd:info:2284] 0x81b7b4b00: 8503e80000002a68: INFO: MGWD::mdnsd_utils: stop_mdnsd:src/tables/mdnsd_utils.cc:555 mdnsd process stop. ref_cnt=1-1. 00000074.0066043d 243bf007 Thu Sep 26 2019 04:47:17 -06:00 [kern_mgwd:info:2284] 0x81b6ad300: 0: INFO: dsmfp_utils: handle_events:src/tables/dns_sd_utils.cc:362 select() loop exited per interrupter. 00000074.0066043e 243bf007 Thu Sep 26 2019 04:47:17 -06:00 [kern_mgwd:info:2284] 0x81b7b4b00: 8503e80000002a68: INFO: MGWD::mdnsd_utils: stop_mdnsd:src/tables/mdnsd_utils.cc:567 Stopping mdnsd process. 00000074.00660471 243bf007 Thu Sep 26 2019 04:47:20 -06:00 [kern_mgwd:info:2284] A [src/rdb/HAM.cc 1233 (0x81b7b8200)]: checkHASFOConfigVerbose: haConfigured: True, result HA_AGENT_CONFIGURED. 00000074.00660472 243bf007 Thu Sep 26 2019 04:47:20 -06:00 [kern_mgwd:info:2284] 0x81b7b4100: 8503e80000002a7e: ERR: AggrEfficiency: src/tables/aggr_efficiency.cc:smdb_error aggr_efficiency_iterator::_getAggrDetails(const smdb_type_aggr_name &, smdb_type_Uuid &, smdb_type_filerid &):122 Failed to get aggregate information from VLDB for aggregate , Reason: entry doesn't exist 00000074.00660475 243bf01d Thu Sep 26 2019 04:47:22 -06:00 [kern_mgwd:info:2284] A [src/rdb/HAM.cc 1233 (0x81b7b8c00)]: checkHASFOConfigVerbose: haConfigured: True, result HA_AGENT_CONFIGURED. 00000074.0066049c 243bf099 Thu Sep 26 2019 04:47:34 -06:00 [kern_mgwd:info:2284] A [src/rdb/HAM.cc 1233 (0x81b7b3200)]: checkHASFOConfigVerbose: haConfigured: True, result HA_AGENT_CONFIGURED. 00000074.006604d3 243bf3a6 Thu Sep 26 2019 04:48:52 -06:00 [kern_mgwd:info:2284] 0x81b7b6900: 8503e80000002aa9: NOTICE: TABLES::disk: Added 168 disk recs to the shared reference cache (size 84) 00000074.006604d7 243bf3ce Thu Sep 26 2019 04:48:56 -06:00 [kern_mgwd:info:2284] A [src/rdb/HAM.cc 1233 (0x81b7b3c00)]: checkHASFOConfigVerbose: haConfigured: True, result HA_AGENT_CONFIGURED. 00000074.00660551 243bf678 Thu Sep 26 2019 04:50:05 -06:00 [kern_mgwd:info:2284] 0x81d1ea100: 86ffff0000000035: WARNING: job_manager::job_store: run:src/job_store_support.cc:568 Job Mgr: rdb_transaction history: OK/0 OK/300 OK/600 00000074.00660579 243bf770 Thu Sep 26 2019 04:50:29 -06:00 [kern_mgwd:info:2284] A [src/rdb/HAM.cc 1233 (0x81b7b3c00)]: checkHASFOConfigVerbose: haConfigured: True, result HA_AGENT_CONFIGURED. 00000074.0066057a 243bf770 Thu Sep 26 2019 04:50:29 -06:00 [kern_mgwd:info:2284] 0x81b149b00: 8503e80000002aee: ERR: AggrEfficiency: src/tables/aggr_efficiency.cc:smdb_error aggr_efficiency_iterator::_getAggrDetails(const smdb_type_aggr_name &, smdb_type_Uuid &, smdb_type_filerid &):122 Failed to get aggregate information from VLDB for aggregate , Reason: entry doesn't exist 00000074.0066057b 243bf770 Thu Sep 26 2019 04:50:29 -06:00 [kern_mgwd:info:2284] 0x81b7b9100: 8503e80000002aed: NOTICE: TABLES::disk: Added 168 disk recs to the shared reference cache (size 84) 00000074.0066057c 243bf790 Thu Sep 26 2019 04:50:32 -06:00 [kern_mgwd:info:2284] A [src/rdb/HAM.cc 1233 (0x81b7b5000)]: checkHASFOConfigVerbose: haConfigured: True, result HA_AGENT_CONFIGURED. 00000074.006605a2 243bf859 Thu Sep 26 2019 04:50:52 -06:00 [kern_mgwd:info:2284] A [src/rdb/HAM.cc 1233 (0x81b7b6e00)]: checkHASFOConfigVerbose: haConfigured: True, result HA_AGENT_CONFIGURED. 00000074.006605ab 243bf971 Thu Sep 26 2019 04:51:21 -06:00 [kern_mgwd:info:2284] A [src/rdb/HAM.cc 1233 (0x81b7b3c00)]: checkHASFOConfigVerbose: haConfigured: True, result HA_AGENT_CONFIGURED. 00000074.006605d4 243bfa00 Thu Sep 26 2019 04:51:35 -06:00 [kern_mgwd:info:2284] A [src/rdb/HAM.cc 1233 (0x81b7b7800)]: checkHASFOConfigVerbose: haConfigured: True, result HA_AGENT_CONFIGURED. 00000074.006605e3 243bfa30 Thu Sep 26 2019 04:51:41 -06:00 [kern_mgwd:info:2284] 0x81d1e6000: 8603e8000029730c: WARNING: MGWD:NetworkDiagJob::: [src/tables/network_diag_job.cc:109] 1 inconsistency found by network debug checker; see vifmgr.log for details 00000074.006606d4 243bfa31 Thu Sep 26 2019 04:51:41 -06:00 [kern_mgwd:info:2284] 0x81d1e6000: 8603e8000029730c: WARNING: job_manager::scheduler_other: get_next:src/scheduler.cc:440 onetime_scheduler::get_next: reschedule not allowed. line: 440 00000074.006606d5 243bfa31 Thu Sep 26 2019 04:51:41 -06:00 [kern_mgwd:info:2284] 0x81d1e6000: 8603e8000029730c: WARNING: job_manager::job_record: get_next_run:src/job_record.cc:647 get_next_run(reschedule), returning 0, schedulenext is 0 for job: 8854 - 6bcaefff-e047-11e9-93b8-00a09857ee8f 00000074.00660803 243c0bf0 Thu Sep 26 2019 04:59:14 -06:00 [kern_mgwd:info:2284] 0x81b7b3c00: 8503e80000002b74: ERR: job_manager::job_mgr_job_ops: in_progress:src/job_mgr_job_ops.cc:268 job id 65701994-b79d-11e7-9b07-00a09857ee8f returned 33 00000074.00660804 243c0bf0 Thu Sep 26 2019 04:59:14 -06:00 [kern_mgwd:info:2284] 0x81b7b3c00: 8503e80000002b74: ERR: job_manager::job_mgr_job_ops: in_progress:src/job_mgr_job_ops.cc:268 job id 656fa976-b79d-11e7-9b07-00a09857ee8f returned 33 00000074.00660805 243c0bf0 Thu Sep 26 2019 04:59:14 -06:00 [kern_mgwd:info:2284] 0x81b7b3c00: 8503e80000002b74: WARNING: job_manager::sched_db: get_scheduler_name:src/sched_db.cc:459 Unable to retrieve scheduler name for id 00000000-0000-0000-0000-000000000000: entry doesn't exist 00000074.00660806 243c0bf0 Thu Sep 26 2019 04:59:14 -06:00 [kern_mgwd:info:2284] 0x81b7b3c00: 8503e80000002b74: WARNING: job_manager::sched_db: get_scheduler_name:src/sched_db.cc:459 Unable to retrieve scheduler name for id 00000000-0000-0000-0000-000000000000: entry doesn't exist 00000074.00660807 243c0bf0 Thu Sep 26 2019 04:59:14 -06:00 [kern_mgwd:info:2284] 0x81b7b3c00: 8503e80000002b74: WARNING: job_manager::sched_db: get_scheduler_name:src/sched_db.cc:459 Unable to retrieve scheduler name for id 00000000-0000-0000-0000-000000000000: entry doesn't exist 00000074.00660808 243c0bf0 Thu Sep 26 2019 04:59:14 -06:00 [kern_mgwd:info:2284] 0x81b7b3c00: 8503e80000002b74: ERR: job_manager::job_mgr_job_ops: in_progress:src/job_mgr_job_ops.cc:268 job id 176c861b-b79e-11e7-9b07-00a09857ee8f returned 33 00000074.00660809 243c0bf0 Thu Sep 26 2019 04:59:14 -06:00 [kern_mgwd:info:2284] 0x81b7b3c00: 8503e80000002b74: WARNING: job_manager::sched_db: get_scheduler_name:src/sched_db.cc:459 Unable to retrieve scheduler name for id 00000000-0000-0000-0000-000000000000: entry doesn't exist 00000074.0066080a 243c0bf0 Thu Sep 26 2019 04:59:14 -06:00 [kern_mgwd:info:2284] 0x81b7b3c00: 8503e80000002b74: WARNING: job_manager::sched_db: get_scheduler_name:src/sched_db.cc:459 Unable to retrieve scheduler name for id 00000000-0000-0000-0000-000000000000: entry doesn't exist 00000074.0066080b 243c0bf0 Thu Sep 26 2019 04:59:14 -06:00 [kern_mgwd:info:2284] 0x81b7b3c00: 8503e80000002b74: ERR: job_manager::job_mgr_job_ops: in_progress:src/job_mgr_job_ops.cc:268 job id 179be0d8-b79e-11e7-9b07-00a09857ee8f returned 33 00000074.0066080c 243c0bf0 Thu Sep 26 2019 04:59:14 -06:00 [kern_mgwd:info:2284] 0x81b7b3c00: 8503e80000002b74: ERR: job_manager::job_mgr_job_ops: in_progress:src/job_mgr_job_ops.cc:268 job id fac3c78b-b80c-11e7-964b-00a098573067 returned 33 00000074.0066080d 243c0bf0 Thu Sep 26 2019 04:59:14 -06:00 [kern_mgwd:info:2284] 0x81b7b3c00: 8503e80000002b74: WARNING: job_manager::sched_db: get_scheduler_name:src/sched_db.cc:459 Unable to retrieve scheduler name for id 00000000-0000-0000-0000-000000000000: entry doesn't exist 00000074.0066080e 243c0bf0 Thu Sep 26 2019 04:59:14 -06:00 [kern_mgwd:info:2284] 0x81b7b3c00: 8503e80000002b74: WARNING: job_manager::sched_db: get_scheduler_name:src/sched_db.cc:459 Unable to retrieve scheduler name for id 00000000-0000-0000-0000-000000000000: entry doesn't exist 00000074.0066081b 243c0de8 Thu Sep 26 2019 05:00:05 -06:00 [kern_mgwd:info:2284] 0x81d1ea100: 86ffff0000000035: WARNING: job_manager::job_store: run:src/job_store_support.cc:568 Job Mgr: rdb_transaction history: OK/0 OK/300 OK/504 00000074.00660868 243c2542 Thu Sep 26 2019 05:10:02 -06:00 [kern_mgwd:info:2284] Starting a backup of the var filesystem. 00000074.00660872 243c310f Thu Sep 26 2019 05:15:05 -06:00 [kern_mgwd:info:2284] 0x81d1ea100: 86ffff0000000035: WARNING: job_manager::job_store: run:src/job_store_support.cc:568 Job Mgr: rdb_transaction history: Timeout/0 Timeout/300 OK/600 00000074.006608e5 243c5437 Thu Sep 26 2019 05:30:05 -06:00 [kern_mgwd:info:2284] 0x81d1ea100: 86ffff0000000035: WARNING: job_manager::job_store: run:src/job_store_support.cc:568 Job Mgr: rdb_transaction history: OK/0 OK/300 OK/600 00000074.0066096d 243c775f Thu Sep 26 2019 05:45:05 -06:00 [kern_mgwd:info:2284] 0x81d1ea100: 86ffff0000000035: WARNING: job_manager::job_store: run:src/job_store_support.cc:568 Job Mgr: rdb_transaction history: OK/0 OK/300 OK/600 00000074.006609c9 243c9a87 Thu Sep 26 2019 06:00:05 -06:00 [kern_mgwd:info:2284] 0x81d1ea100: 86ffff0000000035: WARNING: job_manager::job_store: run:src/job_store_support.cc:568 Job Mgr: rdb_transaction history: OK/0 OK/300 Timeout/600 00000074.00660a26 243cb794 Thu Sep 26 2019 06:12:28 -06:00 [kern_mgwd:info:2284] Starting a backup of the var filesystem. 00000074.00660a29 243cbdaf Thu Sep 26 2019 06:15:05 -06:00 [kern_mgwd:info:2284] 0x81d1ea100: 86ffff0000000035: WARNING: job_manager::job_store: run:src/job_store_support.cc:568 Job Mgr: rdb_transaction history: Timeout/0 OK/300 Timeout/600 00000074.00660a70 243cd4ec Thu Sep 26 2019 06:25:00 -06:00 [kern_mgwd:info:2284] A [src/rdb/TM.cc 3094 (0x81b6a7e00)]: RW-transaction TID <6,219,219> held by client 1000 for 8 seconds (created: 60796643s, now: 60796651s) (label 'job_manager job_sched check claimable'). 00000074.00660aa4 243ce0d6 Thu Sep 26 2019 06:30:05 -06:00 [kern_mgwd:info:2284] 0x81d1ea100: 86ffff0000000035: WARNING: job_manager::job_store: run:src/job_store_support.cc:568 Job Mgr: rdb_transaction history: OK/0 OK/300 Timeout/600 00000074.00660aab 243ce87e Thu Sep 26 2019 06:33:21 -06:00 [kern_mgwd:info:2284] 0x81d1e4c00: 8603e800002974fa: WARNING: job_manager::job_sched: modify_schedule:src/job_sched.cc:800 job_manager::job_sched::modify_schedule: Calling set_scheduler on the record: Current schedule = 0x81c45a540; New schedule = 0x81c0e40e0 00000074.00660b16 243d03fe Thu Sep 26 2019 06:45:05 -06:00 [kern_mgwd:info:2284] 0x81d1ea100: 86ffff0000000035: WARNING: job_manager::job_store: run:src/job_store_support.cc:568 Job Mgr: rdb_transaction history: OK/0 OK/300 Timeout/404 OK/704 00000074.00660b6a 243d2726 Thu Sep 26 2019 07:00:05 -06:00 [kern_mgwd:info:2284] 0x81d1ea100: 86ffff0000000035: WARNING: job_manager::job_store: run:src/job_store_support.cc:568 Job Mgr: rdb_transaction history: OK/0 OK/300 OK/600 00000074.00660bda 243d4a4e Thu Sep 26 2019 07:15:05 -06:00 [kern_mgwd:info:2284] 0x81d1ea100: 86ffff0000000035: WARNING: job_manager::job_store: run:src/job_store_support.cc:568 Job Mgr: rdb_transaction history: Timeout/0 OK/300 OK/600 00000074.00660c53 243d6d76 Thu Sep 26 2019 07:30:05 -06:00 [kern_mgwd:info:2284] 0x81d1ea100: 86ffff0000000035: WARNING: job_manager::job_store: run:src/job_store_support.cc:568 Job Mgr: rdb_transaction history: OK/0 OK/300 OK/600 00000074.00660cb3 243d909e Thu Sep 26 2019 07:45:05 -06:00 [kern_mgwd:info:2284] 0x81d1ea100: 86ffff0000000035: WARNING: job_manager::job_store: run:src/job_store_support.cc:568 Job Mgr: rdb_transaction history: OK/0 OK/300 OK/600 00000074.00660d0e 243db3c6 Thu Sep 26 2019 08:00:05 -06:00 [kern_mgwd:info:2284] 0x81d1ea100: 86ffff0000000035: WARNING: job_manager::job_store: run:src/job_store_support.cc:568 Job Mgr: rdb_transaction history: OK/0 OK/300 OK/600 00000074.00660d8d 243dd6ee Thu Sep 26 2019 08:15:05 -06:00 [kern_mgwd:info:2284] 0x81d1ea100: 86ffff0000000035: WARNING: job_manager::job_store: run:src/job_store_support.cc:568 Job Mgr: rdb_transaction history: OK/0 OK/300 OK/600 00000074.00660d8e 243ddc8f Thu Sep 26 2019 08:17:29 -06:00 [kern_mgwd:info:2284] Starting a backup of the var filesystem. 00000074.00660e01 243dfa16 Thu Sep 26 2019 08:30:05 -06:00 [kern_mgwd:info:2284] 0x81d1ea100: 86ffff0000000035: WARNING: job_manager::job_store: run:src/job_store_support.cc:568 Job Mgr: rdb_transaction history: OK/0 Timeout/300 OK/600 00000074.00660e56 243e1d47 Thu Sep 26 2019 08:45:05 -06:00 [kern_mgwd:info:2284] 0x81d1ea100: 86ffff0000000035: WARNING: job_manager::job_store: run:src/job_store_support.cc:568 Job Mgr: rdb_transaction history: OK/0 Timeout/300 OK/600 00000074.00660e65 243e1d82 Thu Sep 26 2019 08:45:11 -06:00 [kern_mgwd:info:2284] A [src/rdb/HAM.cc 1233 (0x81b7b5a00)]: checkHASFOConfigVerbose: haConfigured: True, result HA_AGENT_CONFIGURED. 00000074.00660e66 243e1d82 Thu Sep 26 2019 08:45:11 -06:00 [kern_mgwd:info:2284] 0x81b149100: 8503e80000002b98: NOTICE: TABLES::disk: Added 168 disk recs to the shared reference cache (size 84) 00000074.00660e67 243e1d82 Thu Sep 26 2019 08:45:11 -06:00 [kern_mgwd:info:2284] update_phase_data: populateData - No phase information found entry doesn't exist { ANDU_LOG in populateData() at src/tables/cluster_image.cc:3824 } 00000074.00660e68 243e1d82 Thu Sep 26 2019 08:45:11 -06:00 [kern_mgwd:info:2284] update_phase_data: populateData - No phase information found entry doesn't exist { ANDU_LOG in populateData() at src/tables/cluster_image.cc:3824 } 00000074.00660e69 243e1d82 Thu Sep 26 2019 08:45:11 -06:00 [kern_mgwd:info:2284] update_phase_data: populateData - No phase information found entry doesn't exist { ANDU_LOG in populateData() at src/tables/cluster_image.cc:3824 } 00000074.00660e98 243e1d82 Thu Sep 26 2019 08:45:11 -06:00 [kern_mgwd:info:2284] A [src/rdb/HAM.cc 1233 (0x81b7b3c00)]: checkHASFOConfigVerbose: haConfigured: True, result HA_AGENT_CONFIGURED. 00000074.00660e99 243e1d82 Thu Sep 26 2019 08:45:11 -06:00 [kern_mgwd:info:2284] A [src/rdb/HAM.cc 1233 (0x81b7b5500)]: checkHASFOConfigVerbose: haConfigured: True, result HA_AGENT_CONFIGURED. 00000074.00660e9a 243e1d82 Thu Sep 26 2019 08:45:11 -06:00 [kern_mgwd:info:2284] 0x81b7b7300: 8503e80000002ba4: INFO: MGWD::mdnsd_utils: start_mdnsd:src/tables/mdnsd_utils.cc:524 mdnsd process start. ref_cnt=0+1. 00000074.00660e9b 243e1d82 Thu Sep 26 2019 08:45:11 -06:00 [kern_mgwd:info:2284] 0x81b7b7300: 8503e80000002ba4: INFO: MGWD::mdnsd_utils: start_mdnsd:src/tables/mdnsd_utils.cc:531 Starting mdnsd process. 00000074.00660ea0 243e1d82 Thu Sep 26 2019 08:45:11 -06:00 [kern_mgwd:info:2284] 0x81b7b7300: 8503e80000002ba4: INFO: MGWD::mdnsd_utils: start_mdnsd:src/tables/mdnsd_utils.cc:534 Sleeping for 5 seconds for mdnsd process startup. 00000074.00660eb5 243e1df4 Thu Sep 26 2019 08:45:21 -06:00 [kern_mgwd:info:2284] 0x81b7b7300: 8503e80000002ba4: ERR: dsmfp: reload_mgwd_dsmfp_services:src/tables/dns_sd_dsmfp.cc:1737 Couldn't find any dsmfp services to resolve with error entry doesn't exist. 00000074.00660eb6 243e1df4 Thu Sep 26 2019 08:45:21 -06:00 [kern_mgwd:info:2284] 0x81b7b7300: 8503e80000002ba4: INFO: MGWD::mdnsd_utils: stop_mdnsd:src/tables/mdnsd_utils.cc:555 mdnsd process stop. ref_cnt=1-1. 00000074.00660eb7 243e1df4 Thu Sep 26 2019 08:45:21 -06:00 [kern_mgwd:info:2284] 0x81b146400: 0: INFO: dsmfp_utils: handle_events:src/tables/dns_sd_utils.cc:362 select() loop exited per interrupter. 00000074.00660eb8 243e1df4 Thu Sep 26 2019 08:45:21 -06:00 [kern_mgwd:info:2284] 0x81b7b7300: 8503e80000002ba4: INFO: MGWD::mdnsd_utils: stop_mdnsd:src/tables/mdnsd_utils.cc:567 Stopping mdnsd process. 00000074.00660ef6 243e1e25 Thu Sep 26 2019 08:45:28 -06:00 [kern_mgwd:info:2284] A [src/rdb/HAM.cc 1233 (0x81b7b4100)]: checkHASFOConfigVerbose: haConfigured: True, result HA_AGENT_CONFIGURED. 00000074.00660ef7 243e1e25 Thu Sep 26 2019 08:45:28 -06:00 [kern_mgwd:info:2284] 0x81b7b6400: 8503e80000002bc6: ERR: AggrEfficiency: src/tables/aggr_efficiency.cc:smdb_error aggr_efficiency_iterator::_getAggrDetails(const smdb_type_aggr_name &, smdb_type_Uuid &, smdb_type_filerid &):122 Failed to get aggregate information from VLDB for aggregate , Reason: entry doesn't exist 00000074.00660efa 243e1e38 Thu Sep 26 2019 08:45:29 -06:00 [kern_mgwd:info:2284] A [src/rdb/HAM.cc 1233 (0x81b7b5a00)]: checkHASFOConfigVerbose: haConfigured: True, result HA_AGENT_CONFIGURED. 00000074.00660f71 243e2d20 Thu Sep 26 2019 08:51:51 -06:00 [kern_mgwd:info:2284] A [src/rdb/HAM.cc 1233 (0x81b7b6900)]: checkHASFOConfigVerbose: haConfigured: True, result HA_AGENT_CONFIGURED. 00000074.00660f95 243e2f70 Thu Sep 26 2019 08:52:50 -06:00 [kern_mgwd:info:2284] A [src/rdb/HAM.cc 1233 (0x81b7b5a00)]: checkHASFOConfigVerbose: haConfigured: True, result HA_AGENT_CONFIGURED. 00000074.00660fd3 243e4066 Thu Sep 26 2019 09:00:05 -06:00 [kern_mgwd:info:2284] 0x81d1ea100: 86ffff0000000035: WARNING: job_manager::job_store: run:src/job_store_support.cc:568 Job Mgr: rdb_transaction history: OK/0 Timeout/300 OK/600 00000074.0066104d 243e638e Thu Sep 26 2019 09:15:05 -06:00 [kern_mgwd:info:2284] 0x81d1ea100: 86ffff0000000035: WARNING: job_manager::job_store: run:src/job_store_support.cc:568 Job Mgr: rdb_transaction history: OK/0 Timeout/300 OK/600 00000074.00661061 243e6f8b Thu Sep 26 2019 09:20:11 -06:00 [kern_mgwd:info:2284] Starting a backup of the var filesystem. 00000074.006610d1 243e86bc Thu Sep 26 2019 09:30:05 -06:00 [kern_mgwd:info:2284] 0x81d1ea100: 86ffff0000000035: WARNING: job_manager::job_store: run:src/job_store_support.cc:568 Job Mgr: rdb_transaction history: OK/0 OK/300 Timeout/600 00000074.006610ed 243e8ec2 Thu Sep 26 2019 09:33:31 -06:00 [kern_mgwd:info:2284] 0x81d1e4c00: 8603e800002976a4: WARNING: job_manager::job_sched: modify_schedule:src/job_sched.cc:800 job_manager::job_sched::modify_schedule: Calling set_scheduler on the record: Current schedule = 0x81c45a860; New schedule = 0x81c0e7440 00000074.0066112b 243ea9de Thu Sep 26 2019 09:45:05 -06:00 [kern_mgwd:info:2284] 0x81d1ea100: 86ffff0000000035: WARNING: job_manager::job_store: run:src/job_store_support.cc:568 Job Mgr: rdb_transaction history: OK/0 OK/300 OK/600 OK/694 00000074.006611a5 243ecd06 Thu Sep 26 2019 10:00:05 -06:00 [kern_mgwd:info:2284] 0x81d1ea100: 86ffff0000000035: WARNING: job_manager::job_store: run:src/job_store_support.cc:568 Job Mgr: rdb_transaction history: OK/0 OK/300 OK/600 00000074.0066121c 243ef030 Thu Sep 26 2019 10:15:05 -06:00 [kern_mgwd:info:2284] 0x81d1ea100: 86ffff0000000035: WARNING: job_manager::job_store: run:src/job_store_support.cc:568 Job Mgr: rdb_transaction history: OK/0 OK/300 OK/600 00000074.00661220 243ef173 Thu Sep 26 2019 10:15:37 -06:00 [kern_mgwd:info:2284] 0x81d1e3d00: 8603e8000029772c: WARNING: job_manager::job_sched: process_modify:src/job_sched.cc:487 UIID:8858 UUID:c9f644ee-e078-11e9-93b8-00a09857ee8f name:Local backup job rc:1 Doing nothing in modify callback for job, since it's pending cleanup 00000074.00661221 243ef704 Thu Sep 26 2019 10:18:00 -06:00 [kern_mgwd:info:2284] 0x81d1e6500: 8603e80000297741: WARNING: FileReplication: Starting subscription (download) request for package nmg-fas8040-02.8hour.2019-09-26.10_15_00.7z:latest with old API extract target '/mroot/etc/backups/.tmp/.tmp.bk.nmg-fas8040.8hour.7.1569514500/nmg-fas8040-02'. 00000074.00661222 243ef728 Thu Sep 26 2019 10:18:03 -06:00 [kern_mgwd:info:2284] 0x81d1e5100: 8603e80000297742: WARNING: FileReplication: Starting subscription (download) request for package nmg-fas8040-01.8hour.2019-09-26.10_15_00.7z:latest with old API extract target '/mroot/etc/backups/.tmp/.tmp.bk.nmg-fas8040.8hour.7.1569514500/nmg-fas8040-01'. 00000074.00661223 243ef732 Thu Sep 26 2019 10:18:04 -06:00 [kern_mgwd:info:2284] 0x81d1e6000: 8603e80000297706: WARNING: FileReplication: Initiating unpublish request of nmg-fas8040-02.8hour.2019-09-26.10_15_00.7z on the cluster. 00000074.00661224 243ef732 Thu Sep 26 2019 10:18:04 -06:00 [kern_mgwd:info:2284] 0x81d1e6000: 8603e80000297706: WARNING: FileReplication: Initiating unpublish request of nmg-fas8040-01.8hour.2019-09-26.10_15_00.7z on the cluster. 00000074.00661227 243ef813 Thu Sep 26 2019 10:18:27 -06:00 [kern_mgwd:info:2284] Info: smf-net: failed due to no more data or timeout. timeout=0 sec, fd=698, numFdReady=0, bytesRcvd=0, FD_ISSET=false, buflength=512 00000074.00661228 243ef826 Thu Sep 26 2019 10:18:29 -06:00 [kern_mgwd:info:2284] 0x81da82500: 0: WARNING: FileReplication: The file replication service successfully distributed package nmg-fas8040.8hour.2019-09-26.10_15_00.7z:0 to 169.254.196.32. 00000074.00661229 243ef93d Thu Sep 26 2019 10:18:57 -06:00 [kern_mgwd:info:2284] 0x81d1e6500: 8603e80000297706: WARNING: FileReplication: Initiating unpublish request of nmg-fas8040.8hour.2019-09-26.10_15_00.7z on the cluster. 00000074.00661264 243f04f7 Thu Sep 26 2019 10:23:57 -06:00 [kern_mgwd:info:2284] 0x81d1ea100: 86ffff0000000035: WARNING: job_manager::job_store: run:src/job_store_support.cc:568 Job Mgr: rdb_transaction history: Timeout/0 OK/300 OK/381 OK/500 00000074.00661266 243f07e2 Thu Sep 26 2019 10:25:11 -06:00 [kern_mgwd:info:2284] Starting a backup of the var filesystem. 00000074.006612a7 243f1b6c Thu Sep 26 2019 10:33:32 -06:00 [kern_mgwd:info:2284] 0x81d1e7400: 8603e80000297781: WARNING: job_manager::job_sched: modify_schedule:src/job_sched.cc:800 job_manager::job_sched::modify_schedule: Calling set_scheduler on the record: Current schedule = 0x81c45a600; New schedule = 0x81c0eb0c0 00000074.006612a8 243f1b6c Thu Sep 26 2019 10:33:32 -06:00 [kern_mgwd:info:2284] 0x81d1ea100: 86ffff0000000035: WARNING: job_manager::job_store: run:src/job_store_support.cc:568 Job Mgr: rdb_transaction history: OK/0 OK/207 OK/507 00000074.006612e6 243f367e Thu Sep 26 2019 10:45:05 -06:00 [kern_mgwd:info:2284] 0x81d1ea100: 86ffff0000000035: WARNING: job_manager::job_store: run:src/job_store_support.cc:568 Job Mgr: rdb_transaction history: OK/0 OK/300 OK/600 00000074.0066135f 243f59a6 Thu Sep 26 2019 11:00:05 -06:00 [kern_mgwd:info:2284] 0x81d1ea100: 86ffff0000000035: WARNING: job_manager::job_store: run:src/job_store_support.cc:568 Job Mgr: rdb_transaction history: Timeout/0 OK/300 OK/600 00000074.006613c7 243f7cce Thu Sep 26 2019 11:15:05 -06:00 [kern_mgwd:info:2284] 0x81d1ea100: 86ffff0000000035: WARNING: job_manager::job_store: run:src/job_store_support.cc:568 Job Mgr: rdb_transaction history: Timeout/0 OK/300 OK/600 00000074.0066141b 243f9ff6 Thu Sep 26 2019 11:30:05 -06:00 [kern_mgwd:info:2284] 0x81d1ea100: 86ffff0000000035: WARNING: job_manager::job_store: run:src/job_store_support.cc:568 Job Mgr: rdb_transaction history: Timeout/0 Timeout/300 Timeout/600 00000074.00661496 243fc31e Thu Sep 26 2019 11:45:05 -06:00 [kern_mgwd:info:2284] 0x81d1ea100: 86ffff0000000035: WARNING: job_manager::job_store: run:src/job_store_support.cc:568 Job Mgr: rdb_transaction history: Timeout/0 OK/300 Timeout/600 00000074.00661510 243fe646 Thu Sep 26 2019 12:00:05 -06:00 [kern_mgwd:info:2284] 0x81d1ea100: 86ffff0000000035: WARNING: job_manager::job_store: run:src/job_store_support.cc:568 Job Mgr: rdb_transaction history: OK/0 Timeout/300 Timeout/600 00000074.00661566 2440096e Thu Sep 26 2019 12:15:05 -06:00 [kern_mgwd:info:2284] 0x81d1ea100: 86ffff0000000035: WARNING: job_manager::job_store: run:src/job_store_support.cc:568 Job Mgr: rdb_transaction history: Timeout/0 OK/300 Timeout/600 00000074.006615cb 24402c96 Thu Sep 26 2019 12:30:05 -06:00 [kern_mgwd:info:2284] 0x81d1ea100: 86ffff0000000035: WARNING: job_manager::job_store: run:src/job_store_support.cc:568 Job Mgr: rdb_transaction history: Timeout/0 OK/300 Timeout/600 00000074.006615f5 244034c0 Thu Sep 26 2019 12:33:34 -06:00 [kern_mgwd:info:2284] 0x81d1e4c00: 8603e8000029789d: WARNING: job_manager::job_sched: modify_schedule:src/job_sched.cc:800 job_manager::job_sched::modify_schedule: Calling set_scheduler on the record: Current schedule = 0x81c45a620; New schedule = 0x81c0e7640 00000074.00661646 24404c30 Thu Sep 26 2019 12:43:34 -06:00 [kern_mgwd:info:2284] 0x81d1ea100: 86ffff0000000035: WARNING: job_manager::job_store: run:src/job_store_support.cc:568 Job Mgr: rdb_transaction history: Timeout/0 Timeout/300 OK/600 00000074.006616b1 244072e6 Thu Sep 26 2019 13:00:05 -06:00 [kern_mgwd:info:2284] 0x81d1ea100: 86ffff0000000035: WARNING: job_manager::job_store: run:src/job_store_support.cc:568 Job Mgr: rdb_transaction history: OK/0 OK/300 OK/600 Timeout/691 00000074.00661701 24408a56 Thu Sep 26 2019 13:10:05 -06:00 [kern_mgwd:info:2284] A [src/rdb/TM.cc 3094 (0x81b6a7e00)]: RW-transaction TID <6,612,612> held by client 1000 for 8 seconds (created: 60820948s, now: 60820956s) (label 'job_manager job tx loop'). 00000074.00661707 2440960e Thu Sep 26 2019 13:15:05 -06:00 [kern_mgwd:info:2284] 0x81d1ea100: 86ffff0000000035: WARNING: job_manager::job_store: run:src/job_store_support.cc:568 Job Mgr: rdb_transaction history: OK/0 OK/300 OK/600 00000074.0066177e 2440b936 Thu Sep 26 2019 13:30:05 -06:00 [kern_mgwd:info:2284] 0x81d1ea100: 86ffff0000000035: WARNING: job_manager::job_store: run:src/job_store_support.cc:568 Job Mgr: rdb_transaction history: OK/0 OK/300 Timeout/600 00000074.006617f8 2440dc5e Thu Sep 26 2019 13:45:05 -06:00 [kern_mgwd:info:2284] 0x81d1ea100: 86ffff0000000035: WARNING: job_manager::job_store: run:src/job_store_support.cc:568 Job Mgr: rdb_transaction history: OK/0 OK/300 Timeout/600 00000074.00661851 2440ff8f Thu Sep 26 2019 14:00:05 -06:00 [kern_mgwd:info:2284] 0x81d1ea100: 86ffff0000000035: WARNING: job_manager::job_store: run:src/job_store_support.cc:568 Job Mgr: rdb_transaction history: OK/0 OK/300 Timeout/600 00000074.006618b4 244122ae Thu Sep 26 2019 14:15:05 -06:00 [kern_mgwd:info:2284] 0x81d1ea100: 86ffff0000000035: WARNING: job_manager::job_store: run:src/job_store_support.cc:568 Job Mgr: rdb_transaction history: Timeout/0 Timeout/300 Timeout/600 00000074.0066192e 244145d6 Thu Sep 26 2019 14:30:05 -06:00 [kern_mgwd:info:2284] 0x81d1ea100: 86ffff0000000035: WARNING: job_manager::job_store: run:src/job_store_support.cc:568 Job Mgr: rdb_transaction history: OK/0 Timeout/300 Timeout/600 00000074.0066199b 24416903 Thu Sep 26 2019 14:45:05 -06:00 [kern_mgwd:info:2284] 0x81d1ea100: 86ffff0000000035: WARNING: job_manager::job_store: run:src/job_store_support.cc:568 Job Mgr: rdb_transaction history: OK/0 Timeout/300 Timeout/600 00000074.006619e7 244185ee Thu Sep 26 2019 14:57:25 -06:00 [kern_mgwd:info:2284] Starting a backup of the var filesystem. 00000074.006619f4 2441861e Thu Sep 26 2019 14:57:30 -06:00 [kern_mgwd:info:2284] A [src/rdb/HAM.cc 1233 (0x81b7b6400)]: checkHASFOConfigVerbose: haConfigured: True, result HA_AGENT_CONFIGURED. 00000074.006619f5 2441861e Thu Sep 26 2019 14:57:30 -06:00 [kern_mgwd:info:2284] 0x81b7b5000: 8503e80000002c20: NOTICE: TABLES::disk: Added 168 disk recs to the shared reference cache (size 84) 00000074.006619f6 2441861e Thu Sep 26 2019 14:57:30 -06:00 [kern_mgwd:info:2284] update_phase_data: populateData - No phase information found entry doesn't exist { ANDU_LOG in populateData() at src/tables/cluster_image.cc:3824 } 00000074.006619f7 2441861e Thu Sep 26 2019 14:57:30 -06:00 [kern_mgwd:info:2284] update_phase_data: populateData - No phase information found entry doesn't exist { ANDU_LOG in populateData() at src/tables/cluster_image.cc:3824 } 00000074.006619f8 2441861e Thu Sep 26 2019 14:57:30 -06:00 [kern_mgwd:info:2284] update_phase_data: populateData - No phase information found entry doesn't exist { ANDU_LOG in populateData() at src/tables/cluster_image.cc:3824 } 00000074.00661a27 2441861f Thu Sep 26 2019 14:57:30 -06:00 [kern_mgwd:info:2284] A [src/rdb/HAM.cc 1233 (0x81b7b9100)]: checkHASFOConfigVerbose: haConfigured: True, result HA_AGENT_CONFIGURED. 00000074.00661a28 2441861f Thu Sep 26 2019 14:57:30 -06:00 [kern_mgwd:info:2284] A [src/rdb/HAM.cc 1233 (0x81b7b8c00)]: checkHASFOConfigVerbose: haConfigured: True, result HA_AGENT_CONFIGURED. 00000074.00661a29 2441861f Thu Sep 26 2019 14:57:30 -06:00 [kern_mgwd:info:2284] 0x81b7b4600: 8503e80000002c2b: INFO: MGWD::mdnsd_utils: start_mdnsd:src/tables/mdnsd_utils.cc:524 mdnsd process start. ref_cnt=0+1. 00000074.00661a2a 2441861f Thu Sep 26 2019 14:57:30 -06:00 [kern_mgwd:info:2284] 0x81b7b4600: 8503e80000002c2b: INFO: MGWD::mdnsd_utils: start_mdnsd:src/tables/mdnsd_utils.cc:531 Starting mdnsd process. 00000074.00661a2f 2441861f Thu Sep 26 2019 14:57:30 -06:00 [kern_mgwd:info:2284] 0x81b7b4600: 8503e80000002c2b: INFO: MGWD::mdnsd_utils: start_mdnsd:src/tables/mdnsd_utils.cc:534 Sleeping for 5 seconds for mdnsd process startup. 00000074.00661a42 24418696 Thu Sep 26 2019 14:57:40 -06:00 [kern_mgwd:info:2284] 0x81b7b4600: 8503e80000002c2b: ERR: dsmfp: reload_mgwd_dsmfp_services:src/tables/dns_sd_dsmfp.cc:1737 Couldn't find any dsmfp services to resolve with error entry doesn't exist. 00000074.00661a43 24418696 Thu Sep 26 2019 14:57:40 -06:00 [kern_mgwd:info:2284] 0x81b7b4600: 8503e80000002c2b: INFO: MGWD::mdnsd_utils: stop_mdnsd:src/tables/mdnsd_utils.cc:555 mdnsd process stop. ref_cnt=1-1. 00000074.00661a44 24418696 Thu Sep 26 2019 14:57:40 -06:00 [kern_mgwd:info:2284] 0x81da81100: 0: INFO: dsmfp_utils: handle_events:src/tables/dns_sd_utils.cc:362 select() loop exited per interrupter. 00000074.00661a45 24418696 Thu Sep 26 2019 14:57:40 -06:00 [kern_mgwd:info:2284] 0x81b7b4600: 8503e80000002c2b: INFO: MGWD::mdnsd_utils: stop_mdnsd:src/tables/mdnsd_utils.cc:567 Stopping mdnsd process. 00000074.00661a84 24418957 Thu Sep 26 2019 14:58:53 -06:00 [kern_mgwd:info:2284] A [src/rdb/HAM.cc 1233 (0x81b148c00)]: checkHASFOConfigVerbose: haConfigured: True, result HA_AGENT_CONFIGURED. 00000074.00661a85 24418957 Thu Sep 26 2019 14:58:53 -06:00 [kern_mgwd:info:2284] 0x81b7b7d00: 8503e80000002c4e: ERR: AggrEfficiency: src/tables/aggr_efficiency.cc:smdb_error aggr_efficiency_iterator::_getAggrDetails(const smdb_type_aggr_name &, smdb_type_Uuid &, smdb_type_filerid &):122 Failed to get aggregate information from VLDB for aggregate , Reason: entry doesn't exist 00000074.00661a86 24418957 Thu Sep 26 2019 14:58:53 -06:00 [kern_mgwd:info:2284] 0x81b149b00: 8503e80000002c49: NOTICE: TABLES::disk: Added 168 disk recs to the shared reference cache (size 84) 00000074.00661a89 24418968 Thu Sep 26 2019 14:58:54 -06:00 [kern_mgwd:info:2284] A [src/rdb/HAM.cc 1233 (0x81b7b6400)]: checkHASFOConfigVerbose: haConfigured: True, result HA_AGENT_CONFIGURED. 00000074.00661ab1 24418c26 Thu Sep 26 2019 15:00:05 -06:00 [kern_mgwd:info:2284] 0x81d1ea100: 86ffff0000000035: WARNING: job_manager::job_store: run:src/job_store_support.cc:568 Job Mgr: rdb_transaction history: Timeout/0 OK/300 OK/600 00000074.00661b9c 2441af4d Thu Sep 26 2019 15:15:05 -06:00 [kern_mgwd:info:2284] 0x81d1ea100: 86ffff0000000035: WARNING: job_manager::job_store: run:src/job_store_support.cc:568 Job Mgr: rdb_transaction history: Timeout/0 Timeout/300 OK/600 00000074.00661c15 2441d276 Thu Sep 26 2019 15:30:05 -06:00 [kern_mgwd:info:2284] 0x81d1ea100: 86ffff0000000035: WARNING: job_manager::job_store: run:src/job_store_support.cc:568 Job Mgr: rdb_transaction history: Timeout/0 Timeout/300 Timeout/600